-- Logs begin at Wed 2022-09-21 15:42:01 UTC, end at Wed 2022-09-21 16:44:52 UTC. -- Sep 21 16:06:53.359168 dv-cinder-858621-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 21 16:06:53.369444 dv-cinder-858621-1-smb devstack@keystone.service[81459]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 21 16:06:53.371384 dv-cinder-858621-1-smb devstack@keystone.service[81459]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 21 16:06:53 2022] *** Sep 21 16:06:53.371384 dv-cinder-858621-1-smb devstack@keystone.service[81459]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 21 16:06:53.371384 dv-cinder-858621-1-smb devstack@keystone.service[81459]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 21 16:06:53.371384 dv-cinder-858621-1-smb devstack@keystone.service[81459]: nodename: dv-cinder-858621-1-smb Sep 21 16:06:53.371384 dv-cinder-858621-1-smb devstack@keystone.service[81459]: machine: x86_64 Sep 21 16:06:53.371384 dv-cinder-858621-1-smb devstack@keystone.service[81459]: clock source: unix Sep 21 16:06:53.371384 dv-cinder-858621-1-smb devstack@keystone.service[81459]: pcre jit disabled Sep 21 16:06:53.371384 dv-cinder-858621-1-smb devstack@keystone.service[81459]: detected number of CPU cores: 4 Sep 21 16:06:53.371384 dv-cinder-858621-1-smb devstack@keystone.service[81459]: current working directory: / Sep 21 16:06:53.371384 dv-cinder-858621-1-smb devstack@keystone.service[81459]: detected binary path: /usr/bin/uwsgi-core Sep 21 16:06:53.371384 dv-cinder-858621-1-smb devstack@keystone.service[81459]: your processes number limit is 47680 Sep 21 16:06:53.371960 dv-cinder-858621-1-smb devstack@keystone.service[81459]: your memory page size is 4096 bytes Sep 21 16:06:53.371960 dv-cinder-858621-1-smb devstack@keystone.service[81459]: detected max file descriptor number: 2048 Sep 21 16:06:53.371960 dv-cinder-858621-1-smb devstack@keystone.service[81459]: lock engine: pthread robust mutexes Sep 21 16:06:53.371960 dv-cinder-858621-1-smb devstack@keystone.service[81459]: thunder lock: enabled Sep 21 16:06:53.371960 dv-cinder-858621-1-smb devstack@keystone.service[81459]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 21 16:06:53.371960 dv-cinder-858621-1-smb devstack@keystone.service[81459]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 21 16:06:53.410444 dv-cinder-858621-1-smb devstack@keystone.service[81459]: Python main interpreter initialized at 0x5649f4f1d9c0 Sep 21 16:06:53.410444 dv-cinder-858621-1-smb devstack@keystone.service[81459]: python threads support enabled Sep 21 16:06:53.410444 dv-cinder-858621-1-smb devstack@keystone.service[81459]: your server socket listen backlog is limited to 100 connections Sep 21 16:06:53.410444 dv-cinder-858621-1-smb devstack@keystone.service[81459]: your mercy for graceful operations on workers is 90 seconds Sep 21 16:06:53.410839 dv-cinder-858621-1-smb devstack@keystone.service[81459]: mapped 403077 bytes (393 KB) for 2 cores Sep 21 16:06:53.410916 dv-cinder-858621-1-smb devstack@keystone.service[81459]: *** Operational MODE: preforking *** Sep 21 16:06:53.411148 dv-cinder-858621-1-smb devstack@keystone.service[81459]: *** uWSGI is running in multiple interpreter mode *** Sep 21 16:06:53.411148 dv-cinder-858621-1-smb devstack@keystone.service[81459]: spawned uWSGI master process (pid: 81459) Sep 21 16:06:53.411362 dv-cinder-858621-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 21 16:06:53.412449 dv-cinder-858621-1-smb devstack@keystone.service[81459]: spawned uWSGI worker 1 (pid: 81471, cores: 1) Sep 21 16:06:53.412449 dv-cinder-858621-1-smb devstack@keystone.service[81459]: spawned uWSGI worker 2 (pid: 81472, cores: 1) Sep 21 16:06:53.412449 dv-cinder-858621-1-smb devstack@keystone.service[81459]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 21 16:06:57.748588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 16:06:57.748588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: from cryptography.utils import int_from_bytes Sep 21 16:06:57.749392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 16:06:57.749392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: from cryptography.utils import int_from_bytes Sep 21 16:06:57.750580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 16:06:57.750580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: from cryptography.utils import int_from_bytes Sep 21 16:06:57.751026 dv-cinder-858621-1-smb devstack@keystone.service[81472]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 16:06:57.751026 dv-cinder-858621-1-smb devstack@keystone.service[81472]: from cryptography.utils import int_from_bytes Sep 21 16:06:57.799195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 16:06:57.799398 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 16:06:57.799573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] command line args: [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 16:06:57.799846 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 16:06:57.800028 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ================================================================================ {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 16:06:57.800284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] admin_token = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.800531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] config_dir = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.800743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.800930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] config_source = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.801113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] debug = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.801316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 16:06:57.801403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.801594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 16:06:57.801665 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.801731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] command line args: [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 16:06:57.801867 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.801953 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 16:06:57.802103 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.802212 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ================================================================================ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 16:06:57.802351 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.802460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] admin_token = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.802587 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] list_limit = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.802722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_dir = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.802834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] log_config_append = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.802938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.803034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.803127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_source = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.803227 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] log_dir = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.803333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] debug = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.803435 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] log_file = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.803530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.803638 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.803756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.803756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.803950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.804028 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.804150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.804232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.804305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.804378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.804488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.804606 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.804723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_config_append = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.804801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.804928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.805013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_dir = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.805098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.805178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.805294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.805375 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.805458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.805561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.805691 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.805811 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.805926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.806061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.806260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.806853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.806973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.807058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.807221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.807307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.807472 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.807710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.807793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.807904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] publish_errors = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.808034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.808139 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.808219 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.808374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.808497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.808625 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.808738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.808815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.808885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.809040 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.809152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.809277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] standard_threads = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.809514 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.809647 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.809759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.809854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] publish_errors = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.809938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.810054 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.810133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] use_journal = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.810265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] use_json = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.810349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.810428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] use_stderr = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.810512 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.810606 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] use_syslog = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.810684 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.810839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.810967 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.811100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.811185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] standard_threads = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.811342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.811421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.811585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.811670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.811749 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.811827 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.811928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_journal = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.812077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.812154 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_json = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.812268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_stderr = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.812352 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.812445 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_syslog = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.812556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.812677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:06:57.812827 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.812959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.813080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.813202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.813332 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.813467 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.813586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.813711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.813827 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.813970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.814078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.814213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.814341 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.814465 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.814545 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.814703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.814788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.814954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.815030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.815202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.815292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.815453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.815531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.815691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.815770 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.815941 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.816026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.816179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.816257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.816428 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.816505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.816679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.816796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.816954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.817081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.817192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.817287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.817432 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.817508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.817668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.817741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.817907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.817987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.818160 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.818240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.818412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.818496 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.818649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.818736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.818885 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.818962 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.819127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.819203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.819363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.819450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.819598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.819676 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.819838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.819917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.820076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.820165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.820318 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.820402 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.820549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.820635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.820806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.820899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.821044 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.821122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.821280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.821364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.821515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.821605 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.821780 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.821864 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.822018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.822095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.822259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.822411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.822487 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.822557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.822721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.822798 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.822953 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.823039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.823187 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.823265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.823421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.823498 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.823659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.823743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.823903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.823981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.824137 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.824214 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.824376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.824460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.824608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.824711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.824871 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.824950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.825105 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.825193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.825356 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.825434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.825593 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.825708 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.825818 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.825926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.826054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.826158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.826291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.826396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.826534 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.826648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.826769 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.826890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.827003 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.827089 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.827241 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.827354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.827481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.827569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.827721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.827802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.827956 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.828047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.828216 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.828295 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.828454 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.828531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.828707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.828792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.828950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.829034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.829188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.829270 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.829428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.829505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.829674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.829757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.829920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.830010 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.830162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.830241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.830400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.830482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.830638 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.830717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.830883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.830962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.831112 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.831194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.831352 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.831430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.831590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.831667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.831838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.831917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.832077 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.832155 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.832326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.832404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.832565 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.832651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.832824 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.832904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.833065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.833146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.833303 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.833382 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.833539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.833617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.833774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.833893 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.834045 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.834122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.834228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.834307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.834460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.834548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.834697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.834789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.834929 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.835014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.835171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.835257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.835409 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.835497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.835646 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.835729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.835881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.835959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.836114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.836202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.836597 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.836714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.836869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.836950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.837104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.837195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] auth.external = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.837339 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.837423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.837601 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.837678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.837851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.837959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.838093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.838183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] auth.password = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.838325 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] auth.token = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.838411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.838570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.838652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.838810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.838901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.839058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.external = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.839145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.839291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.839376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.839548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.839639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.839800 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.839879 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.840031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.password = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.840109 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.840266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.token = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.840353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] credential.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.840511 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.840590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.840783 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.840865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.841038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.841129 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.841286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.841374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.841535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.841614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.841760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.841847 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.842004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.842083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.842243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.842322 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.842488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.842574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.842738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.842818 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.842990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.843070 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.843244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.843333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.843492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.843573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.843736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.843823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.843988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.844076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.844224 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.844303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.844463 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.844542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.844730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.844825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.844984 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.845065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.845218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.845297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.845467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.845555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.845707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.845788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.845964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.846044 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.846204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.846291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.846452 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.846530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.846688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.846770 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.846937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.847026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.847172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.847250 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.847418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.847502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.847659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.847747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.847894 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.847973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.848131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.848248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.848410 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.848488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.848599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.848795 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.848874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.849004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.849092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.849167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.849346 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.849464 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.849585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.849688 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.849819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.849901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.850053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.850134 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.850302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.850381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.850537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.850618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.850778 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.850857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.851029 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.851108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.851280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.851383 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.851514 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.851593 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.851751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.851829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.851986 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.852102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.852234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.852312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.852475 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.852554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.852733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.852818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.853490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.853632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.853745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.853825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.853989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.854071 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.854240 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.854320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.854519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.854599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.854755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.854835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.854997 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.855076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.855232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.855312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.855471 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.855553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.855715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.855794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.855946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.856024 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.856187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.856275 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.856422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.856502 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.856663 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.856808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.856928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.857011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.857166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.857244 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.857405 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.857484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.857647 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.857728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.857880 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.857960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.858121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.858271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.858359 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.858514 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.858595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.858751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.858830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.859006 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.859087 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.859260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.859341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.859497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.859576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.859734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.859814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.859974 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.860053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.860211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.860289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.860447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.860528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.860712 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.860795 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.860955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.861033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.861196 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.861277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.861435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.861515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.861676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.861756 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.861912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.861993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.862143 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.862222 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.862384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.862464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.862623 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.862705 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.862863 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.862942 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.863097 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.863183 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.863348 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.863429 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.863587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.863666 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.863822 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.863901 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.864061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.864143 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.864304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.864384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.864536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.864614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.864794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.864877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.865040 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.865118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.865281 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.865360 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.865521 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.865603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.865759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.865838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.866006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.866084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.866241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.866323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.866483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.866561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.866721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.866803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.866961 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.867042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.867201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.867280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.867438 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.867516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.867678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.867759 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.867918 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.868054 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.868167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.868300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.868411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.868561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.869329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.869422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.869496 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.869628 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.869723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.869907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.869988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.870152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.870232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.870397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.870486 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.870652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.870733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.870900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.870979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.871137 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.871225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.871380 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.871460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.871619 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.871697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.871863 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.871950 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.872103 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] role.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.872184 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.872343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.872421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] role.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.872577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.872756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.872858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.872939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.873097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.873176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.873350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.873431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.873590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.873669 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.873836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.873915 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.874075 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.874156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.874323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.874402 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.874556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.874634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.874796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.874877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.875044 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.875124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.875295 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.875374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.875543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.875624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.875791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.875878 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.876041 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.876232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.876320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.876473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.876554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.876748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.876834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.877005 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.877098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.877259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.877339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.877508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.877593 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.877744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.877831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.878002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.878176 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.878255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.878419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.878499 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.878674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.878756 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.878928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.879007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.879163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.879251 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.879415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.879495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.879652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.879732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.879906 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.879992 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.880150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.880229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.880388 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.880467 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.880620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.880726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.880878 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.880959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.881114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.881194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.881361 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.881448 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.881601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.881681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.881857 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.881936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.882099 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.882187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.882336 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.882415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.882569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.882648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.882807 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.882895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.883048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.883128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.883284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.883362 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.883523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.883610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.883758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.883836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.884006 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.884085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.884310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.884406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.884545 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.884634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.884814 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.884899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.885081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.885160 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.885322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.885404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.connection = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.885565 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.885644 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.885803 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.885883 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.886040 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.886120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.886284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.886363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.886520 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.886600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.886759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.886849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.886996 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.887078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.887235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.887315 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.887480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.887560 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.887717 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.887804 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.887962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.888042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.888199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.888278 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.888436 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.888517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.888672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.888815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.888941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.889022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.889175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.889313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.889417 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.889495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.889654 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.889733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.889816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 16:06:57.889891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.890125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.890374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.890615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.890863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.891097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.891341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.891578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:06:57.891750 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 16:06:57.919659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:57.919891 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:57.920125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:57.920758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:57.920997 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:57.921225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:57.928705 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:57.929715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:57.958816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:57.959022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:57.959119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:57.959195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.020645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.023145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.069979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.070216 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.070800 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.071042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.230132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.230360 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.230589 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.230814 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.231035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.231255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.232704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.232938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.233157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.233370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.233581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.233792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.254192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.254358 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.254442 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.254529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.254649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.254738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.254879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.254968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.255092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.255176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.255307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.255391 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.255522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.255615 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.266786 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.267027 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.279894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.280064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.280154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.280286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.280371 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.280512 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.280595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.280773 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.280877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.280957 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.281031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.281166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.281250 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.281443 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 16:06:58.298231 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.298396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.298482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 16:06:58.298610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 16:06:58.298759 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.298954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 16:06:58.299038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.299155 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 16:06:58.299238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.299432 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.299524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.299696 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.299777 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.299944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.300023 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.300201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.309602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.309875 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.309958 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.310139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.310222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.310416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.310501 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.310718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.317370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.317748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.320240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.320530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.320662 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.320834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.320975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.321113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.321261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.321392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.321544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.321646 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.321857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.321946 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.322125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.322205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.322396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.322476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.322671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.323021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.323098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.323171 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.323244 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.323459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.346600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.347015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.348056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.348338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.348499 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.348813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.353616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.353985 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.354191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.354336 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.354490 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.354615 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.360978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.361094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.361266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.361354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.367022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.367127 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.367318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.367402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.367601 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.367699 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.367881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.367965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.368170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.368264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.368422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.368508 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.368773 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.368868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.369041 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.369124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.384543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.384651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.384851 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.384936 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.388708 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.388808 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.391881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.391992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.392174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.392292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.396326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.396552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.399405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.399709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.403162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.403459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.403543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.403740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.403823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.404021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.404111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.404291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.404375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.404569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.404726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.404865 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.420781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.421035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.421166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.421317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.421442 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.421592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.421721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.421846 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.428361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.428634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.429924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.430188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.431479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.431724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.431853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.432004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.434412 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.434701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.434861 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.435003 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.435128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.435266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.435394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.435521 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.435653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.435914 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.446664 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.446996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.447183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.447271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.447476 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.447579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.447764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.447917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.448051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.448203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.448437 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.448529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.448760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.449048 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.464609 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.465293 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.467504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.468222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.470385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.471154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.471828 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.472604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.473318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.473600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.473995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.474088 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.474377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.474771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.481342 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.481775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.482813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.483246 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.486201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.486610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.486901 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.486985 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.487182 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.487292 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.487576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.487852 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.495162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.495452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.495734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.497728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.498037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.498318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.502691 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.502981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.503266 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.503543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.503829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.504103 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.504384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.504667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.504964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.505237 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.505521 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.505799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.506069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.506353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.506748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 16:06:58.507034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.507314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.507590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.507861 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.508132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.508401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.508703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.508977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.509798 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.510082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.510367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.510660 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.510938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 16:06:58.544017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649f4f1d9c0 pid: 81471 (default app) Sep 21 16:06:58.545349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649f4f1d9c0 pid: 81472 (default app) Sep 21 16:06:58.547334 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e17c6-8d18-43af-8571-24dfb6f4b06c None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:06:58.547624 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e17c6-8d18-43af-8571-24dfb6f4b06c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:06:58.547896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e17c6-8d18-43af-8571-24dfb6f4b06c None None] PATH_INFO: `/v3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:06:58.552058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Wed Sep 21 16:06:58 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:05.365040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b088b75-b186-4430-9156-957cc49a17af None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:05.365619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b088b75-b186-4430-9156-957cc49a17af None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:05.365619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b088b75-b186-4430-9156-957cc49a17af None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:05.369905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:07:05.375269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e2304-c697-4e5e-9296-fca80eaa8fad None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:05.375701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e2304-c697-4e5e-9296-fca80eaa8fad None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:05.375838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e2304-c697-4e5e-9296-fca80eaa8fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:05.446138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: INFO dbcounter [None req-426e2304-c697-4e5e-9296-fca80eaa8fad None None] Registered counter for database keystone Sep 21 16:07:05.466518 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG oslo_db.sqlalchemy.engines [None req-426e2304-c697-4e5e-9296-fca80eaa8fad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:07:05.472671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writer thread running {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:07:05.652129 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG passlib.handlers.bcrypt [None req-426e2304-c697-4e5e-9296-fca80eaa8fad None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81471) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 21 16:07:05.652511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG passlib.handlers.bcrypt [None req-426e2304-c697-4e5e-9296-fca80eaa8fad None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81471) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 21 16:07:05.711598 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-426e2304-c697-4e5e-9296-fca80eaa8fad None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:05.713676 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-426e2304-c697-4e5e-9296-fca80eaa8fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:05.840180 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 21 16:07:06.136934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b088b75-b186-4430-9156-957cc49a17af None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:06.206947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: INFO dbcounter [None req-6b088b75-b186-4430-9156-957cc49a17af None None] Registered counter for database keystone Sep 21 16:07:06.228956 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG oslo_db.sqlalchemy.engines [None req-6b088b75-b186-4430-9156-957cc49a17af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:07:06.235086 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writer thread running {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:07:06.354359 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b088b75-b186-4430-9156-957cc49a17af None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:06.358717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ea84c-ba85-4cc2-bddf-3be78dd71447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:06.359338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ea84c-ba85-4cc2-bddf-3be78dd71447 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:06.359622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ea84c-ba85-4cc2-bddf-3be78dd71447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:06.359892 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ea84c-ba85-4cc2-bddf-3be78dd71447 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:06.368297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ea84c-ba85-4cc2-bddf-3be78dd71447 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:06.419298 dv-cinder-858621-1-smb devstack@keystone.service[81472]: WARNING keystone.common.rbac_enforcer.enforcer [None req-461ea84c-ba85-4cc2-bddf-3be78dd71447 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 21 16:07:06.419587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ea84c-ba85-4cc2-bddf-3be78dd71447 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:06.429796 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Sep 21 16:07:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:07:06.436203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e2304-c697-4e5e-9296-fca80eaa8fad None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:06.453767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e2304-c697-4e5e-9296-fca80eaa8fad None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:06.458297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842a640-463b-4713-a86f-2f443f562ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:06.459412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a640-463b-4713-a86f-2f443f562ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:06.459693 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a640-463b-4713-a86f-2f443f562ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:06.459967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a640-463b-4713-a86f-2f443f562ec4 admin admin] PATH_INFO: `/v3/projects/f8aed661a1ae4dc6adb9120d20a01acd` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:06.461590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842a640-463b-4713-a86f-2f443f562ec4 admin admin] RBAC: Authorizing `identity:get_project(project_id=f8aed661a1ae4dc6adb9120d20a01acd)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:06.514181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8842a640-463b-4713-a86f-2f443f562ec4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 21 16:07:06.514544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842a640-463b-4713-a86f-2f443f562ec4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:06.519167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Sep 21 16:07:06 2022] GET /identity/v3/projects/f8aed661a1ae4dc6adb9120d20a01acd => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:08.667211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6da4a-456c-44b1-b86f-aa4e7dc0e17f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:08.667792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6da4a-456c-44b1-b86f-aa4e7dc0e17f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:08.667792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6da4a-456c-44b1-b86f-aa4e7dc0e17f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:08.671893 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:08.677740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867b659-862a-4ec1-99c8-e4a912bdd164 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:08.678160 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867b659-862a-4ec1-99c8-e4a912bdd164 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:08.678275 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867b659-862a-4ec1-99c8-e4a912bdd164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:08.699218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0867b659-862a-4ec1-99c8-e4a912bdd164 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:08.700766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0867b659-862a-4ec1-99c8-e4a912bdd164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:08.708573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 21 16:07:08.979851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6da4a-456c-44b1-b86f-aa4e7dc0e17f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:08.991921 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6da4a-456c-44b1-b86f-aa4e7dc0e17f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:08.996725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593bb9ff-5856-489e-8b4f-67efcea2036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:08.997328 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bb9ff-5856-489e-8b4f-67efcea2036d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:08.997610 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bb9ff-5856-489e-8b4f-67efcea2036d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:08.997882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bb9ff-5856-489e-8b4f-67efcea2036d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:09.005578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593bb9ff-5856-489e-8b4f-67efcea2036d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:09.007343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593bb9ff-5856-489e-8b4f-67efcea2036d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:09.016218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Sep 21 16:07:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:07:09.022168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867b659-862a-4ec1-99c8-e4a912bdd164 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:09.031293 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867b659-862a-4ec1-99c8-e4a912bdd164 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:09.035643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e72e57-bbbc-46c5-a0c6-189d5e442f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:09.036271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e72e57-bbbc-46c5-a0c6-189d5e442f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:09.036550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e72e57-bbbc-46c5-a0c6-189d5e442f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:09.036861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e72e57-bbbc-46c5-a0c6-189d5e442f80 admin admin] PATH_INFO: `/v3/users/40395749310542bc824e993a4d655097` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:09.038170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e72e57-bbbc-46c5-a0c6-189d5e442f80 admin admin] RBAC: Authorizing `identity:get_user(user_id=40395749310542bc824e993a4d655097)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:09.040010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e72e57-bbbc-46c5-a0c6-189d5e442f80 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:09.042199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Wed Sep 21 16:07:09 2022] GET /identity/v3/users/40395749310542bc824e993a4d655097 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:11.290652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bff50-8fe8-4cde-a357-6fb63ea11dbc None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:11.291256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bff50-8fe8-4cde-a357-6fb63ea11dbc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:11.291556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bff50-8fe8-4cde-a357-6fb63ea11dbc None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:11.293954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:11.301836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38e2f-32a4-43d5-903c-9b899e0c570d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:11.302622 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38e2f-32a4-43d5-903c-9b899e0c570d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:11.302871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38e2f-32a4-43d5-903c-9b899e0c570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:11.323249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-6fa38e2f-32a4-43d5-903c-9b899e0c570d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:11.324550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6fa38e2f-32a4-43d5-903c-9b899e0c570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:11.357396 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094d069-69ce-46a7-913c-45d6d4ca1ddd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:11.357855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094d069-69ce-46a7-913c-45d6d4ca1ddd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:11.358324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094d069-69ce-46a7-913c-45d6d4ca1ddd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:11.360602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:07:11.367617 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc821d1b-af5d-49f2-a19b-6cd37dc7e92d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:11.368084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc821d1b-af5d-49f2-a19b-6cd37dc7e92d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:11.368527 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc821d1b-af5d-49f2-a19b-6cd37dc7e92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:11.417717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG passlib.handlers.bcrypt [None req-bc821d1b-af5d-49f2-a19b-6cd37dc7e92d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81472) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 21 16:07:11.418227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG passlib.handlers.bcrypt [None req-bc821d1b-af5d-49f2-a19b-6cd37dc7e92d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81472) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 21 16:07:11.421726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:11.470421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bc821d1b-af5d-49f2-a19b-6cd37dc7e92d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:11.472157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bc821d1b-af5d-49f2-a19b-6cd37dc7e92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:11.582729 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:07:11.706290 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa38e2f-32a4-43d5-903c-9b899e0c570d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:11.733316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:11.856975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa38e2f-32a4-43d5-903c-9b899e0c570d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:11.899799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ef0ff-da51-49a9-9a8b-c69ff1ba1ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:11.900556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ef0ff-da51-49a9-9a8b-c69ff1ba1ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:11.900935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ef0ff-da51-49a9-9a8b-c69ff1ba1ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:11.901276 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ef0ff-da51-49a9-9a8b-c69ff1ba1ec8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:11.911743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc821d1b-af5d-49f2-a19b-6cd37dc7e92d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:11.915718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ef0ff-da51-49a9-9a8b-c69ff1ba1ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-366ef0ff-da51-49a9-9a8b-c69ff1ba1ec8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:11.924965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:11.926510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:11.927528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:11.927528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:11.927528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:11.927528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:11.927528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:11.927528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:11.927528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:11.927528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:11.927528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:11.927528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:11.927528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:11.927528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:07:11.927528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:07:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:11.932827 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ef0ff-da51-49a9-9a8b-c69ff1ba1ec8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:12.048953 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:12.056217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc821d1b-af5d-49f2-a19b-6cd37dc7e92d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:12.060613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:12.076365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ef0ff-da51-49a9-9a8b-c69ff1ba1ec8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:12.098940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698c468-0dcc-439a-8ed4-239d8b9b6499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:12.099813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698c468-0dcc-439a-8ed4-239d8b9b6499 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:12.100086 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698c468-0dcc-439a-8ed4-239d8b9b6499 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:12.100351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698c468-0dcc-439a-8ed4-239d8b9b6499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:12.122235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91346d-262d-49d7-b2ba-56dd3bd6ef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:12.122856 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91346d-262d-49d7-b2ba-56dd3bd6ef30 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:12.123135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91346d-262d-49d7-b2ba-56dd3bd6ef30 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:12.123402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91346d-262d-49d7-b2ba-56dd3bd6ef30 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:12.124161 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91346d-262d-49d7-b2ba-56dd3bd6ef30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:12.124374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91346d-262d-49d7-b2ba-56dd3bd6ef30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:12.125828 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91346d-262d-49d7-b2ba-56dd3bd6ef30 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:12.139273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:12.144949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91346d-262d-49d7-b2ba-56dd3bd6ef30 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:12.185284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698c468-0dcc-439a-8ed4-239d8b9b6499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:12.186964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698c468-0dcc-439a-8ed4-239d8b9b6499 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:12.275994 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91346d-262d-49d7-b2ba-56dd3bd6ef30 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:12.321891 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de12b5-9547-403b-92b6-28432f37f8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:12.323378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de12b5-9547-403b-92b6-28432f37f8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:12.323378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de12b5-9547-403b-92b6-28432f37f8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:12.323713 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de12b5-9547-403b-92b6-28432f37f8d2 None admin] PATH_INFO: `/v3/users/40395749310542bc824e993a4d655097` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:12.324088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:07:12.325967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de12b5-9547-403b-92b6-28432f37f8d2 None admin] RBAC: Authorizing `identity:get_user(user_id=40395749310542bc824e993a4d655097)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:12.327512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de12b5-9547-403b-92b6-28432f37f8d2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:12.329482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:12 2022] GET /identity/v3/users/40395749310542bc824e993a4d655097 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:12.330307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698c468-0dcc-439a-8ed4-239d8b9b6499 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:12.334409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:12.335345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de12b5-9547-403b-92b6-28432f37f8d2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:12.354957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:12.449788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698c468-0dcc-439a-8ed4-239d8b9b6499 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:12.472403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de12b5-9547-403b-92b6-28432f37f8d2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:12.499168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340cd78-9d7c-4524-b5ed-9190d713e3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:12.500176 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340cd78-9d7c-4524-b5ed-9190d713e3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:12.500584 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340cd78-9d7c-4524-b5ed-9190d713e3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:12.500986 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340cd78-9d7c-4524-b5ed-9190d713e3e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:12.519889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2bf4-9028-4916-b279-2793d16c1394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:12.520646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2bf4-9028-4916-b279-2793d16c1394 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:12.521100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2bf4-9028-4916-b279-2793d16c1394 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:12.521462 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2bf4-9028-4916-b279-2793d16c1394 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:12.522728 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e2bf4-9028-4916-b279-2793d16c1394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:12.523793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340cd78-9d7c-4524-b5ed-9190d713e3e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:12.524397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e2bf4-9028-4916-b279-2793d16c1394 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:12.525504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340cd78-9d7c-4524-b5ed-9190d713e3e8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:12.526286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:07:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:12.532416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2bf4-9028-4916-b279-2793d16c1394 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8340cd78-9d7c-4524-b5ed-9190d713e3e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:07:12.546535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:12.548505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:07:12.550065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:07:12.550065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:07:12.550065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:07:12.550065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:07:12.555249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340cd78-9d7c-4524-b5ed-9190d713e3e8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:12.622812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:12.632524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:12.657844 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2bf4-9028-4916-b279-2793d16c1394 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:12.678122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340cd78-9d7c-4524-b5ed-9190d713e3e8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:12.698875 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302918eb-897f-46f9-a71f-4510d3191e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:12.699570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302918eb-897f-46f9-a71f-4510d3191e8f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:12.699981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302918eb-897f-46f9-a71f-4510d3191e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:12.700241 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302918eb-897f-46f9-a71f-4510d3191e8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:12.701066 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302918eb-897f-46f9-a71f-4510d3191e8f None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.domain.id=default, user.id=40395749310542bc824e993a4d655097) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:12.701433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302918eb-897f-46f9-a71f-4510d3191e8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:12.703314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302918eb-897f-46f9-a71f-4510d3191e8f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:12.711680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Sep 21 16:07:12 2022] GET /identity/v3/role_assignments?user.id=40395749310542bc824e993a4d655097&scope.domain.id=default&role.id=beec000223e041209205627bfa0dbed1 => generated 233 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:12.718336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917d6d3-eb44-4607-a945-6873db081c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:12.719039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917d6d3-eb44-4607-a945-6873db081c7d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:12.719371 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917d6d3-eb44-4607-a945-6873db081c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:12.719696 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917d6d3-eb44-4607-a945-6873db081c7d None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:12.720428 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917d6d3-eb44-4607-a945-6873db081c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:12.720840 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917d6d3-eb44-4607-a945-6873db081c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:12.722361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917d6d3-eb44-4607-a945-6873db081c7d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:12.743865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:16.004150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f3ae-cdcb-401d-a90d-73594016ed64 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:16.005184 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f3ae-cdcb-401d-a90d-73594016ed64 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:16.005653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f3ae-cdcb-401d-a90d-73594016ed64 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:16.007309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:16.013914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072e2a9-7234-48ab-8ccd-594f9127b0d7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:16.014848 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072e2a9-7234-48ab-8ccd-594f9127b0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:16.015300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072e2a9-7234-48ab-8ccd-594f9127b0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:16.049984 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6072e2a9-7234-48ab-8ccd-594f9127b0d7 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:16.051672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6072e2a9-7234-48ab-8ccd-594f9127b0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:16.109184 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ad94a-8cc5-4b07-bd4d-bc9eb33f7eb5 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:16.109787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ad94a-8cc5-4b07-bd4d-bc9eb33f7eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:16.110239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ad94a-8cc5-4b07-bd4d-bc9eb33f7eb5 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:16.113393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 13/23] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:07:16.122227 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370f630-333b-47e9-994f-d1fadc08a3f5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:16.125324 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370f630-333b-47e9-994f-d1fadc08a3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:16.125804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370f630-333b-47e9-994f-d1fadc08a3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:16.162069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1370f630-333b-47e9-994f-d1fadc08a3f5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:16.163645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1370f630-333b-47e9-994f-d1fadc08a3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:16.197112 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 11/24] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:16.310488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 14/25] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:16.633767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaac6c-7cf9-44c3-b9c9-6281e71b49f7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:16.634477 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaac6c-7cf9-44c3-b9c9-6281e71b49f7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:16.635519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaac6c-7cf9-44c3-b9c9-6281e71b49f7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:16.637213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 12/26] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:16.643199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880672c0-4aa0-4809-864f-0e2e4518152d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:16.643475 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880672c0-4aa0-4809-864f-0e2e4518152d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:16.643910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880672c0-4aa0-4809-864f-0e2e4518152d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:16.670991 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-880672c0-4aa0-4809-864f-0e2e4518152d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:16.672431 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-880672c0-4aa0-4809-864f-0e2e4518152d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:16.774635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 15/27] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:16.786011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adaac6c-7cf9-44c3-b9c9-6281e71b49f7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:16.844847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880672c0-4aa0-4809-864f-0e2e4518152d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:16.852502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:16.886218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:17.006512 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adaac6c-7cf9-44c3-b9c9-6281e71b49f7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:17.063031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880672c0-4aa0-4809-864f-0e2e4518152d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:17.094757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235e85e-d976-48ca-bbf2-a11b5c18717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:17.095435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235e85e-d976-48ca-bbf2-a11b5c18717b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:17.095720 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235e85e-d976-48ca-bbf2-a11b5c18717b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:17.095995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235e85e-d976-48ca-bbf2-a11b5c18717b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:17.124531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235e85e-d976-48ca-bbf2-a11b5c18717b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0235e85e-d976-48ca-bbf2-a11b5c18717b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:17.131442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:17.132543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:17.133522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:17.133522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:17.133522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:17.133522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:17.133522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:17.133522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:17.133522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:17.133522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:17.133522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:17.133522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:17.133522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:17.133522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:07:17.139737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 13/28] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:07:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:17.148673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8b0f9-c8f2-4492-801b-2e8c1a86fd2c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:17.148991 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8b0f9-c8f2-4492-801b-2e8c1a86fd2c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:17.149274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8b0f9-c8f2-4492-801b-2e8c1a86fd2c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:17.150758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 14/29] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:17.154478 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0c851-0c6e-47a3-be58-0133b568c87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:17.155151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0c851-0c6e-47a3-be58-0133b568c87f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:17.155816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0c851-0c6e-47a3-be58-0133b568c87f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:17.156105 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0c851-0c6e-47a3-be58-0133b568c87f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:17.157474 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8b0f9-c8f2-4492-801b-2e8c1a86fd2c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:17.183995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0c851-0c6e-47a3-be58-0133b568c87f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:17.185570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0c851-0c6e-47a3-be58-0133b568c87f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-3ca0c851-0c6e-47a3-be58-0133b568c87f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:07:17.215345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:17.217531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:07:17.219559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:07:17.219559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:07:17.219559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:07:17.219559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 16/30] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:17.225940 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf61d22-2b89-4e41-a098-fb9c7a7933b6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:17.226231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf61d22-2b89-4e41-a098-fb9c7a7933b6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:17.226430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf61d22-2b89-4e41-a098-fb9c7a7933b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:17.248383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5cf61d22-2b89-4e41-a098-fb9c7a7933b6 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:17.250049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5cf61d22-2b89-4e41-a098-fb9c7a7933b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:17.314214 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8b0f9-c8f2-4492-801b-2e8c1a86fd2c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:17.316830 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:17.326076 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:17.343061 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 17/31] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:17.344150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf61d22-2b89-4e41-a098-fb9c7a7933b6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:17.360762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a177be6-02dd-4bed-bd2a-15b24d21ff6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:17.361644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a177be6-02dd-4bed-bd2a-15b24d21ff6f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:17.362080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a177be6-02dd-4bed-bd2a-15b24d21ff6f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:17.362547 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a177be6-02dd-4bed-bd2a-15b24d21ff6f None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:17.363398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a177be6-02dd-4bed-bd2a-15b24d21ff6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:17.364007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a177be6-02dd-4bed-bd2a-15b24d21ff6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:17.365717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a177be6-02dd-4bed-bd2a-15b24d21ff6f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:17.380611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 15/32] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:17.381818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a177be6-02dd-4bed-bd2a-15b24d21ff6f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:17.498718 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a177be6-02dd-4bed-bd2a-15b24d21ff6f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:17.507208 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf61d22-2b89-4e41-a098-fb9c7a7933b6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:17.543855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763903af-24f6-4577-897e-c714b92c642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:17.544737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763903af-24f6-4577-897e-c714b92c642d None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:17.545013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763903af-24f6-4577-897e-c714b92c642d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:17.545286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763903af-24f6-4577-897e-c714b92c642d None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:17.545966 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763903af-24f6-4577-897e-c714b92c642d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:17.547361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763903af-24f6-4577-897e-c714b92c642d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:17.583589 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27932aed-159c-46bb-a23e-ec2ae6562fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:17.584261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27932aed-159c-46bb-a23e-ec2ae6562fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:17.584547 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27932aed-159c-46bb-a23e-ec2ae6562fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:17.584848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27932aed-159c-46bb-a23e-ec2ae6562fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:17.585557 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27932aed-159c-46bb-a23e-ec2ae6562fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:17.585867 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27932aed-159c-46bb-a23e-ec2ae6562fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:17.589012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27932aed-159c-46bb-a23e-ec2ae6562fd2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:17.619332 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 18/33] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:17.620502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27932aed-159c-46bb-a23e-ec2ae6562fd2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:17.674808 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:17.699142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 16/34] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 21 16:07:17 2022] POST /identity/v3/roles => generated 225 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:07:17.700419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763903af-24f6-4577-897e-c714b92c642d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:17.741506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:17.750669 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27932aed-159c-46bb-a23e-ec2ae6562fd2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:17.798796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfb66b-4769-4363-a8ab-3d9536c1094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:17.799456 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfb66b-4769-4363-a8ab-3d9536c1094c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:17.799734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfb66b-4769-4363-a8ab-3d9536c1094c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:17.800007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfb66b-4769-4363-a8ab-3d9536c1094c None admin] PATH_INFO: `/v3/users/40395749310542bc824e993a4d655097` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:17.801359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfb66b-4769-4363-a8ab-3d9536c1094c None admin] RBAC: Authorizing `identity:get_user(user_id=40395749310542bc824e993a4d655097)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:17.802848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfb66b-4769-4363-a8ab-3d9536c1094c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:17.804603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 19/35] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:17 2022] GET /identity/v3/users/40395749310542bc824e993a4d655097 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:17.810820 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb63e-ef34-46d5-8a6c-2545585fafdc None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:17.811132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb63e-ef34-46d5-8a6c-2545585fafdc None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:17.811366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb63e-ef34-46d5-8a6c-2545585fafdc None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:17.813021 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 20/36] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:17.813778 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb63e-ef34-46d5-8a6c-2545585fafdc None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:17.845167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763903af-24f6-4577-897e-c714b92c642d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:17.897779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb6c4d-d4c5-4aee-8696-5eefc966fc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:17.898974 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb6c4d-d4c5-4aee-8696-5eefc966fc12 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:17.898974 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb6c4d-d4c5-4aee-8696-5eefc966fc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:17.898974 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb6c4d-d4c5-4aee-8696-5eefc966fc12 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:17.899865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb6c4d-d4c5-4aee-8696-5eefc966fc12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:17.902389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb6c4d-d4c5-4aee-8696-5eefc966fc12 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:17.938379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 17/37] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 21 16:07:17 2022] POST /identity/v3/projects => generated 301 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:07:17.939353 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb6c4d-d4c5-4aee-8696-5eefc966fc12 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:17.951651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb63e-ef34-46d5-8a6c-2545585fafdc None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:17.978251 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:18.003766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958712e-5854-405b-8690-b67d67182f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:18.004800 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958712e-5854-405b-8690-b67d67182f45 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:18.005088 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958712e-5854-405b-8690-b67d67182f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:18.005357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958712e-5854-405b-8690-b67d67182f45 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:18.006076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958712e-5854-405b-8690-b67d67182f45 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:18.007570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958712e-5854-405b-8690-b67d67182f45 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:18.047002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:18.069114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb6c4d-d4c5-4aee-8696-5eefc966fc12 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:18.108153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982e7f4-9942-45da-baae-1b45e27c774f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:18.108957 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e7f4-9942-45da-baae-1b45e27c774f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:18.109106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e7f4-9942-45da-baae-1b45e27c774f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:18.109358 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e7f4-9942-45da-baae-1b45e27c774f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:18.110528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982e7f4-9942-45da-baae-1b45e27c774f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:18.111992 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982e7f4-9942-45da-baae-1b45e27c774f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:18.118741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 18/38] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:07:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:18.118741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18d0b6-64e2-4182-b725-42d254a99bf8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:18.118741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18d0b6-64e2-4182-b725-42d254a99bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:18.118741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18d0b6-64e2-4182-b725-42d254a99bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:18.137327 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ec18d0b6-64e2-4182-b725-42d254a99bf8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:18.138853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ec18d0b6-64e2-4182-b725-42d254a99bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:18.148275 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 21/39] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 21 16:07:17 2022] POST /identity/v3/roles => generated 219 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:07:18.150011 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d905324-456d-435b-86c7-23be5ef9c2f5 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:18.150316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d905324-456d-435b-86c7-23be5ef9c2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:18.150587 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d905324-456d-435b-86c7-23be5ef9c2f5 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:18.152036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 22/40] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:18.152737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d905324-456d-435b-86c7-23be5ef9c2f5 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:18.235501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 19/41] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:18.236665 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd78e1-7e37-414f-b9af-49c51b2808f5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:18.236988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd78e1-7e37-414f-b9af-49c51b2808f5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:18.237281 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd78e1-7e37-414f-b9af-49c51b2808f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:18.259439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2acd78e1-7e37-414f-b9af-49c51b2808f5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:18.260626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2acd78e1-7e37-414f-b9af-49c51b2808f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:18.326230 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d905324-456d-435b-86c7-23be5ef9c2f5 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:18.355609 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 20/42] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:18.373409 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0e520-a90f-4c16-bc53-46b81cdc2fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:18.374158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0e520-a90f-4c16-bc53-46b81cdc2fc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:18.374566 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0e520-a90f-4c16-bc53-46b81cdc2fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:18.374850 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0e520-a90f-4c16-bc53-46b81cdc2fc1 None admin] PATH_INFO: `/v3/domains/default/users/40395749310542bc824e993a4d655097/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:18.377771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0e520-a90f-4c16-bc53-46b81cdc2fc1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=40395749310542bc824e993a4d655097, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:18.379476 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0e520-a90f-4c16-bc53-46b81cdc2fc1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:18.398712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 23/43] 10.222.0.16 () {58 vars in 1361 bytes} [Wed Sep 21 16:07:18 2022] PUT /identity/v3/domains/default/users/40395749310542bc824e993a4d655097/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:07:18.514357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd78e1-7e37-414f-b9af-49c51b2808f5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:18.526661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:18.624496 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd78e1-7e37-414f-b9af-49c51b2808f5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:18.637784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0e520-a90f-4c16-bc53-46b81cdc2fc1 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:18.660565 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19849c18-7063-4a91-8df4-da0fe0a05dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:18.661274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19849c18-7063-4a91-8df4-da0fe0a05dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:18.661560 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19849c18-7063-4a91-8df4-da0fe0a05dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:18.661835 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19849c18-7063-4a91-8df4-da0fe0a05dc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:18.663049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19849c18-7063-4a91-8df4-da0fe0a05dc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:18.664592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19849c18-7063-4a91-8df4-da0fe0a05dc4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:18.666679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 21/44] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:07:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:18.672314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19849c18-7063-4a91-8df4-da0fe0a05dc4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:18.757891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:18.780734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:18.783148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19849c18-7063-4a91-8df4-da0fe0a05dc4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:18.834801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecd380-4ae5-4f58-96c7-cf093b9ac224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:18.836013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecd380-4ae5-4f58-96c7-cf093b9ac224 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:18.836485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecd380-4ae5-4f58-96c7-cf093b9ac224 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:18.837093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecd380-4ae5-4f58-96c7-cf093b9ac224 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:18.838125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecd380-4ae5-4f58-96c7-cf093b9ac224 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:18.840712 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecd380-4ae5-4f58-96c7-cf093b9ac224 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:18.881192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 21 16:07:18 2022] POST /identity/v3/projects => generated 312 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:07:18.885048 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0e520-a90f-4c16-bc53-46b81cdc2fc1 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:18.927257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe204d64-715c-40aa-9dfd-1eeebf2bcdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:18.927938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe204d64-715c-40aa-9dfd-1eeebf2bcdf4 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:18.928227 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe204d64-715c-40aa-9dfd-1eeebf2bcdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:18.928506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe204d64-715c-40aa-9dfd-1eeebf2bcdf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:18.929240 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe204d64-715c-40aa-9dfd-1eeebf2bcdf4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:18.930889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe204d64-715c-40aa-9dfd-1eeebf2bcdf4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:18.952739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 21 16:07:18 2022] POST /identity/v3/roles => generated 223 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:07:20.589957 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe5bb-1f9e-4a22-8fe0-0589648b4d14 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:20.590495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe5bb-1f9e-4a22-8fe0-0589648b4d14 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:20.590495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe5bb-1f9e-4a22-8fe0-0589648b4d14 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:20.591975 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:20.597265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc224c2-3867-49e0-a8b5-d0979c6bb748 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:20.597702 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc224c2-3867-49e0-a8b5-d0979c6bb748 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:20.597826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc224c2-3867-49e0-a8b5-d0979c6bb748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:20.616133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-afc224c2-3867-49e0-a8b5-d0979c6bb748 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:20.617699 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-afc224c2-3867-49e0-a8b5-d0979c6bb748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:20.691247 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:20.958767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfe5bb-1f9e-4a22-8fe0-0589648b4d14 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:21.081651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfe5bb-1f9e-4a22-8fe0-0589648b4d14 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:21.109767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:21.121895 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78aec9-6980-4862-8a86-a4cab4da7e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:21.122239 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78aec9-6980-4862-8a86-a4cab4da7e78 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:21.122890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78aec9-6980-4862-8a86-a4cab4da7e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:21.123168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78aec9-6980-4862-8a86-a4cab4da7e78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:21.124187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349739-ddff-4fd7-b27a-533936147505 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:21.124481 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349739-ddff-4fd7-b27a-533936147505 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:21.124790 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349739-ddff-4fd7-b27a-533936147505 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:21.126145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 26/49] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:21.131766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445e158-a042-4e12-8c91-2b030f8f3171 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:21.132052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445e158-a042-4e12-8c91-2b030f8f3171 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:21.132325 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445e158-a042-4e12-8c91-2b030f8f3171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:21.135162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78aec9-6980-4862-8a86-a4cab4da7e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ce78aec9-6980-4862-8a86-a4cab4da7e78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:21.140093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:21.140999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:21.141886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:21.141886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:21.141886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:21.141886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:21.141886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:21.141886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:21.141886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:21.141886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:21.141886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:21.141886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:21.141886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:21.141886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:07:21.141886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 24/50] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:07:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:21.149119 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78aec9-6980-4862-8a86-a4cab4da7e78 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:21.155473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5445e158-a042-4e12-8c91-2b030f8f3171 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:21.156733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5445e158-a042-4e12-8c91-2b030f8f3171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:21.177431 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:21.237470 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 27/51] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:07:21.379387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78aec9-6980-4862-8a86-a4cab4da7e78 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:21.415586 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec43fa0-9821-4901-83ca-235cee73e3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:21.416795 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec43fa0-9821-4901-83ca-235cee73e3ae None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:21.417094 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec43fa0-9821-4901-83ca-235cee73e3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:21.417356 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec43fa0-9821-4901-83ca-235cee73e3ae None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:21.418038 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec43fa0-9821-4901-83ca-235cee73e3ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:21.418343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec43fa0-9821-4901-83ca-235cee73e3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:21.419757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec43fa0-9821-4901-83ca-235cee73e3ae None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:21.428888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 25/52] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:21.434904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445e158-a042-4e12-8c91-2b030f8f3171 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:21.507600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec43fa0-9821-4901-83ca-235cee73e3ae None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:21.558875 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445e158-a042-4e12-8c91-2b030f8f3171 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:21.567487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:21.599533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c908bc-c62d-4e06-8d74-a329e6b4789b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:21.600569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c908bc-c62d-4e06-8d74-a329e6b4789b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:21.600890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c908bc-c62d-4e06-8d74-a329e6b4789b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:21.601186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c908bc-c62d-4e06-8d74-a329e6b4789b None admin] PATH_INFO: `/v3/users/40395749310542bc824e993a4d655097` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:21.602488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c908bc-c62d-4e06-8d74-a329e6b4789b None admin] RBAC: Authorizing `identity:get_user(user_id=40395749310542bc824e993a4d655097)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:21.604764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c908bc-c62d-4e06-8d74-a329e6b4789b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:21.606491 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 28/53] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:21 2022] GET /identity/v3/users/40395749310542bc824e993a4d655097 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:21.612122 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c908bc-c62d-4e06-8d74-a329e6b4789b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:21.625215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec43fa0-9821-4901-83ca-235cee73e3ae None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:21.637914 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:21.662189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038aede8-cf6d-479e-a71f-9e1480886fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:21.662843 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aede8-cf6d-479e-a71f-9e1480886fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:21.663132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aede8-cf6d-479e-a71f-9e1480886fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:21.663409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aede8-cf6d-479e-a71f-9e1480886fb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:21.664630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038aede8-cf6d-479e-a71f-9e1480886fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:21.666744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038aede8-cf6d-479e-a71f-9e1480886fb0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:21.668453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 26/54] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:07:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:21.674462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038aede8-cf6d-479e-a71f-9e1480886fb0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:21.721823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c908bc-c62d-4e06-8d74-a329e6b4789b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:21.762424 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ec69c-da31-4796-a431-bcadb20ee761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:21.762970 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ec69c-da31-4796-a431-bcadb20ee761 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:21.763258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ec69c-da31-4796-a431-bcadb20ee761 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:21.763530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ec69c-da31-4796-a431-bcadb20ee761 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:21.764664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ec69c-da31-4796-a431-bcadb20ee761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:21.766161 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ec69c-da31-4796-a431-bcadb20ee761 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:21.767774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 29/55] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:07:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:21.776207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ec69c-da31-4796-a431-bcadb20ee761 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:21.787050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038aede8-cf6d-479e-a71f-9e1480886fb0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:21.808442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:21.835045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d47910-f4f8-448b-a03a-7db0d3f7b516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:21.835776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47910-f4f8-448b-a03a-7db0d3f7b516 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:21.836134 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47910-f4f8-448b-a03a-7db0d3f7b516 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:21.836488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47910-f4f8-448b-a03a-7db0d3f7b516 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:21.837326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d47910-f4f8-448b-a03a-7db0d3f7b516 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:21.839757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d47910-f4f8-448b-a03a-7db0d3f7b516 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:21.865425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 27/56] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Sep 21 16:07:21 2022] POST /identity/v3/projects => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:07:21.888893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:21.899768 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ec69c-da31-4796-a431-bcadb20ee761 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:21.937737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd64cf-17fa-4614-97df-2bf211759ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:21.938362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd64cf-17fa-4614-97df-2bf211759ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:21.938644 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd64cf-17fa-4614-97df-2bf211759ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:21.938917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd64cf-17fa-4614-97df-2bf211759ae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:21.939659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd64cf-17fa-4614-97df-2bf211759ae8 None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.domain.id=default, user.id=40395749310542bc824e993a4d655097) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:21.939968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd64cf-17fa-4614-97df-2bf211759ae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:21.941496 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd64cf-17fa-4614-97df-2bf211759ae8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:21.948532 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 30/57] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Sep 21 16:07:21 2022] GET /identity/v3/role_assignments?user.id=40395749310542bc824e993a4d655097&scope.domain.id=default&role.id=beec000223e041209205627bfa0dbed1 => generated 530 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:24.022881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2a2f1-c78a-4fea-b8af-8b296b42968d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:24.023425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2a2f1-c78a-4fea-b8af-8b296b42968d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:24.023425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2a2f1-c78a-4fea-b8af-8b296b42968d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:24.024795 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 28/58] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:24.030714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911f8b7-03cc-4a00-9368-428411655afa None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:24.031105 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911f8b7-03cc-4a00-9368-428411655afa None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:24.031269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911f8b7-03cc-4a00-9368-428411655afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:24.049723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9911f8b7-03cc-4a00-9368-428411655afa None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:24.050947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9911f8b7-03cc-4a00-9368-428411655afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:24.121977 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 31/59] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:24.389421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2a2f1-c78a-4fea-b8af-8b296b42968d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:24.493814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2a2f1-c78a-4fea-b8af-8b296b42968d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:24.529519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711d669-da88-4730-9226-c912be7810dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:24.530162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711d669-da88-4730-9226-c912be7810dc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:24.530447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711d669-da88-4730-9226-c912be7810dc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:24.530729 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711d669-da88-4730-9226-c912be7810dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:24.531856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711d669-da88-4730-9226-c912be7810dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:24.533337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711d669-da88-4730-9226-c912be7810dc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:24.534920 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 29/60] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:07:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:24.540490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911f8b7-03cc-4a00-9368-428411655afa None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:24.623885 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:24.640484 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911f8b7-03cc-4a00-9368-428411655afa None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:24.678281 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea038ccd-53d0-482b-be47-c6675238fe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:24.678895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea038ccd-53d0-482b-be47-c6675238fe2c None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:24.679176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea038ccd-53d0-482b-be47-c6675238fe2c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:24.679449 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea038ccd-53d0-482b-be47-c6675238fe2c None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:24.680108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea038ccd-53d0-482b-be47-c6675238fe2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:24.681580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea038ccd-53d0-482b-be47-c6675238fe2c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:24.711705 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 32/61] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:07:24 2022] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:07:28.839325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6d869-15fb-47a0-9a60-9d88c6e7b22a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:28.840335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6d869-15fb-47a0-9a60-9d88c6e7b22a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:28.840865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6d869-15fb-47a0-9a60-9d88c6e7b22a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:28.842459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 30/62] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:28.848616 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ed2dc-2b9d-4e2f-99de-d6c5a4080ac9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:28.849586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ed2dc-2b9d-4e2f-99de-d6c5a4080ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:28.850085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ed2dc-2b9d-4e2f-99de-d6c5a4080ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:28.881765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-816ed2dc-2b9d-4e2f-99de-d6c5a4080ac9 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:28.883322 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-816ed2dc-2b9d-4e2f-99de-d6c5a4080ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:28.977261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 33/63] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:07:29.465927 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc579c8d-01ac-40e0-809e-7c933fe0230d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:29.466498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc579c8d-01ac-40e0-809e-7c933fe0230d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:29.466990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc579c8d-01ac-40e0-809e-7c933fe0230d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:29.468549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 31/64] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:07:29.478519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace0b2c-4af8-4abc-b1e3-32c312e1e1ae None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:29.479692 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace0b2c-4af8-4abc-b1e3-32c312e1e1ae None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:29.480161 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace0b2c-4af8-4abc-b1e3-32c312e1e1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:29.507039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3ace0b2c-4af8-4abc-b1e3-32c312e1e1ae None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:29.508252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3ace0b2c-4af8-4abc-b1e3-32c312e1e1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:29.610058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:29.616307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 34/65] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:29.649172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc579c8d-01ac-40e0-809e-7c933fe0230d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:29.683780 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315541d-74e9-48d2-966d-c170e9097c16 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:29.684411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315541d-74e9-48d2-966d-c170e9097c16 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:29.684913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315541d-74e9-48d2-966d-c170e9097c16 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:29.686485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 35/66] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:07:29.694681 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cc0db-d047-4edb-b0f3-5ac9a2c66ce9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:29.695274 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cc0db-d047-4edb-b0f3-5ac9a2c66ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:29.695748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cc0db-d047-4edb-b0f3-5ac9a2c66ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:29.722695 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3a6cc0db-d047-4edb-b0f3-5ac9a2c66ce9 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:29.724983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3a6cc0db-d047-4edb-b0f3-5ac9a2c66ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:29.781081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:29.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc579c8d-01ac-40e0-809e-7c933fe0230d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:29.845960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 36/67] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:29.854036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5471a45-2af9-4a02-8ea4-4e2ac590c282 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:29.855670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5471a45-2af9-4a02-8ea4-4e2ac590c282 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:29.856430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5471a45-2af9-4a02-8ea4-4e2ac590c282 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:29.864450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 37/68] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:29 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:29.871603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255321a-dc44-4ce6-b3a3-8c5e7768a799 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:29.872484 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255321a-dc44-4ce6-b3a3-8c5e7768a799 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:29.873389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255321a-dc44-4ce6-b3a3-8c5e7768a799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:29.904751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81bde9-b453-47cc-99a2-41f3819a98f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:29.904751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81bde9-b453-47cc-99a2-41f3819a98f5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:29.904751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81bde9-b453-47cc-99a2-41f3819a98f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:29.904751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81bde9-b453-47cc-99a2-41f3819a98f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:29.921039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81bde9-b453-47cc-99a2-41f3819a98f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:29.925414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e255321a-dc44-4ce6-b3a3-8c5e7768a799 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:29.927753 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e255321a-dc44-4ce6-b3a3-8c5e7768a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fa81bde9-b453-47cc-99a2-41f3819a98f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:29.929994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:29.931634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:29.933734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:29.933734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:29.933734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:29.933734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:29.933734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:29.933734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:29.933734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:29.933734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:29.933734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:29.933734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:29.933734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:07:29.933734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:07:29.933734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 32/69] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:29.934972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81bde9-b453-47cc-99a2-41f3819a98f5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:30.081969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 38/70] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:07:30.083259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255321a-dc44-4ce6-b3a3-8c5e7768a799 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:30.114815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:30.123923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81bde9-b453-47cc-99a2-41f3819a98f5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:30.162104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:30.190142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fc725-35ee-47be-a89c-a9149ee282fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:30.191580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fc725-35ee-47be-a89c-a9149ee282fb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:30.192078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fc725-35ee-47be-a89c-a9149ee282fb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:30.192562 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fc725-35ee-47be-a89c-a9149ee282fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:30.211580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fc725-35ee-47be-a89c-a9149ee282fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3b3fc725-35ee-47be-a89c-a9149ee282fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:30.217300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:30.223118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:30.224508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:30.224508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:30.224508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:30.224508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:30.224508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:30.224508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:30.224508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:30.224508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:30.224508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:30.224508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:30.224508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:07:30.224508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:07:30.224508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 33/71] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:07:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:30.224508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f74531-71f0-4fb8-aa3b-d90466c6bbb7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:30.230027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f74531-71f0-4fb8-aa3b-d90466c6bbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:30.230027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f74531-71f0-4fb8-aa3b-d90466c6bbb7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:30.230027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 34/72] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:30.230027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f74531-71f0-4fb8-aa3b-d90466c6bbb7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:30.234189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255321a-dc44-4ce6-b3a3-8c5e7768a799 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:30.284102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8397d20-8fa0-41bd-b051-c67c41f3bb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:30.285133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8397d20-8fa0-41bd-b051-c67c41f3bb6a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:30.285508 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8397d20-8fa0-41bd-b051-c67c41f3bb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:30.285795 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8397d20-8fa0-41bd-b051-c67c41f3bb6a None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:30.287064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8397d20-8fa0-41bd-b051-c67c41f3bb6a None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:30.287627 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8397d20-8fa0-41bd-b051-c67c41f3bb6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:30.290400 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8397d20-8fa0-41bd-b051-c67c41f3bb6a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:30.311670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 39/73] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:07:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:30.311670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8397d20-8fa0-41bd-b051-c67c41f3bb6a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:30.398256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f74531-71f0-4fb8-aa3b-d90466c6bbb7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:30.439241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cf4c8-59b3-48a3-bf8d-a5cf1b4352f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:30.439887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cf4c8-59b3-48a3-bf8d-a5cf1b4352f3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:30.440167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cf4c8-59b3-48a3-bf8d-a5cf1b4352f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:30.440441 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cf4c8-59b3-48a3-bf8d-a5cf1b4352f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:30.441698 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952cf4c8-59b3-48a3-bf8d-a5cf1b4352f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:30.443178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952cf4c8-59b3-48a3-bf8d-a5cf1b4352f3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:30.444844 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 35/74] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:07:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:30.446062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c061a0-b6cb-46a1-bc06-fc2425d7545e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:30.446532 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c061a0-b6cb-46a1-bc06-fc2425d7545e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:30.446679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c061a0-b6cb-46a1-bc06-fc2425d7545e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:30.462643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8397d20-8fa0-41bd-b051-c67c41f3bb6a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:30.473142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b5c061a0-b6cb-46a1-bc06-fc2425d7545e None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:30.474384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b5c061a0-b6cb-46a1-bc06-fc2425d7545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:30.494811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:30.497258 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:30.513995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa4a3d-c0ee-4448-a656-729528c41b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:30.515007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa4a3d-c0ee-4448-a656-729528c41b91 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:30.515484 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa4a3d-c0ee-4448-a656-729528c41b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:30.515947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa4a3d-c0ee-4448-a656-729528c41b91 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:30.517107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa4a3d-c0ee-4448-a656-729528c41b91 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:30.517601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa4a3d-c0ee-4448-a656-729528c41b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:30.520050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa4a3d-c0ee-4448-a656-729528c41b91 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:30.536355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 40/75] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:07:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:30.538096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa4a3d-c0ee-4448-a656-729528c41b91 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:30.558156 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 36/76] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:30.559350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c061a0-b6cb-46a1-bc06-fc2425d7545e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:30.702031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa4a3d-c0ee-4448-a656-729528c41b91 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:30.711302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c061a0-b6cb-46a1-bc06-fc2425d7545e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:30.752296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18857ea1-5565-442e-ba39-ccce4fefb10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:30.752997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18857ea1-5565-442e-ba39-ccce4fefb10c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:30.753279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18857ea1-5565-442e-ba39-ccce4fefb10c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:30.753553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18857ea1-5565-442e-ba39-ccce4fefb10c None admin] PATH_INFO: `/v3/users/de5b926665fc4538a717ef556ffe0d72` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:30.755431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e9c9a-3925-44ce-9623-1925e57ab474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:30.756259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e9c9a-3925-44ce-9623-1925e57ab474 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:30.756574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e9c9a-3925-44ce-9623-1925e57ab474 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:30.756966 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e9c9a-3925-44ce-9623-1925e57ab474 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:30.769805 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e9c9a-3925-44ce-9623-1925e57ab474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:30.772483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18857ea1-5565-442e-ba39-ccce4fefb10c None admin] RBAC: Authorizing `identity:get_user(user_id=de5b926665fc4538a717ef556ffe0d72)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:30.775350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18857ea1-5565-442e-ba39-ccce4fefb10c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b03e9c9a-3925-44ce-9623-1925e57ab474 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:30.775583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:30.777090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:30.778023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:30.778023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:30.778023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:30.778023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:30.778023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:30.778023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:30.778023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:30.778023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:30.778023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:30.778023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:30.778023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:30.778023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:07:30.778958 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 41/77] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:30 2022] GET /identity/v3/users/de5b926665fc4538a717ef556ffe0d72 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:30.780467 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 37/78] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:07:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:30.781489 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e9c9a-3925-44ce-9623-1925e57ab474 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:30.784793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18857ea1-5565-442e-ba39-ccce4fefb10c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:30.818944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:30.842717 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:30.929571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e9c9a-3925-44ce-9623-1925e57ab474 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:30.938604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18857ea1-5565-442e-ba39-ccce4fefb10c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:30.977402 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc02d7-f3a6-4447-b9c5-a9b243aa19ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:30.978068 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc02d7-f3a6-4447-b9c5-a9b243aa19ad None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:30.978412 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc02d7-f3a6-4447-b9c5-a9b243aa19ad None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:30.979280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc02d7-f3a6-4447-b9c5-a9b243aa19ad None admin] PATH_INFO: `/v3/users/de5b926665fc4538a717ef556ffe0d72` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:30.980968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc02d7-f3a6-4447-b9c5-a9b243aa19ad None admin] RBAC: Authorizing `identity:get_user(user_id=de5b926665fc4538a717ef556ffe0d72)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:30.982655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc02d7-f3a6-4447-b9c5-a9b243aa19ad None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:30.984412 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 38/79] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:30 2022] GET /identity/v3/users/de5b926665fc4538a717ef556ffe0d72 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:30.985276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc02d7-f3a6-4447-b9c5-a9b243aa19ad None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:30.986612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64b0fe-993d-497e-a9f8-baa982b45511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:30.987681 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64b0fe-993d-497e-a9f8-baa982b45511 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:30.988773 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64b0fe-993d-497e-a9f8-baa982b45511 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:30.990462 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64b0fe-993d-497e-a9f8-baa982b45511 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:30.991929 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64b0fe-993d-497e-a9f8-baa982b45511 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:30.995128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64b0fe-993d-497e-a9f8-baa982b45511 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:31.025082 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 42/80] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:07:30 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:07:31.027036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64b0fe-993d-497e-a9f8-baa982b45511 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:31.092149 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:31.118486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc02d7-f3a6-4447-b9c5-a9b243aa19ad None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:31.172352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81657fb9-a8ed-4a80-bc28-86fbf446ad7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:31.173190 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81657fb9-a8ed-4a80-bc28-86fbf446ad7b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:31.173591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81657fb9-a8ed-4a80-bc28-86fbf446ad7b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:31.174877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81657fb9-a8ed-4a80-bc28-86fbf446ad7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:31.206525 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:31.212141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64b0fe-993d-497e-a9f8-baa982b45511 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:31.265626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147d380-5f4c-49ab-87ad-b91d393de7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:31.266586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147d380-5f4c-49ab-87ad-b91d393de7aa None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:31.266997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147d380-5f4c-49ab-87ad-b91d393de7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:31.267411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147d380-5f4c-49ab-87ad-b91d393de7aa None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:31.268250 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147d380-5f4c-49ab-87ad-b91d393de7aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:31.268713 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147d380-5f4c-49ab-87ad-b91d393de7aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:31.270815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147d380-5f4c-49ab-87ad-b91d393de7aa None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:31.283955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 43/81] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:31.285414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147d380-5f4c-49ab-87ad-b91d393de7aa None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:31.298257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81657fb9-a8ed-4a80-bc28-86fbf446ad7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:31.301848 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81657fb9-a8ed-4a80-bc28-86fbf446ad7b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:31.460255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147d380-5f4c-49ab-87ad-b91d393de7aa None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:31.481339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:31.517169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 39/82] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:07:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:07:31.520721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81657fb9-a8ed-4a80-bc28-86fbf446ad7b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:31.528264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bf8e4-9116-4799-80b8-84094d301b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:31.529784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bf8e4-9116-4799-80b8-84094d301b8c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:31.530221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bf8e4-9116-4799-80b8-84094d301b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:31.530638 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bf8e4-9116-4799-80b8-84094d301b8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:31.551387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bf8e4-9116-4799-80b8-84094d301b8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-a26bf8e4-9116-4799-80b8-84094d301b8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:31.560590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:31.562747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:31.564342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:31.564342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:31.564342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:31.564342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:31.564342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:31.564342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:31.564342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:31.564342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:31.564342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:31.564342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:31.564342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:07:31.564342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:07:31.564342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 44/83] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:31.564342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bf8e4-9116-4799-80b8-84094d301b8c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:31.649372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:31.708506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81657fb9-a8ed-4a80-bc28-86fbf446ad7b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:31.726299 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bf8e4-9116-4799-80b8-84094d301b8c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:31.776461 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76be85d-331d-437f-b1b6-746f5d7c0212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:31.777400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76be85d-331d-437f-b1b6-746f5d7c0212 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:31.777836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76be85d-331d-437f-b1b6-746f5d7c0212 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:31.778258 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76be85d-331d-437f-b1b6-746f5d7c0212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:31.789806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bf865-59cb-425a-be17-1edefb32f67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:31.790934 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bf865-59cb-425a-be17-1edefb32f67f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:31.791946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bf865-59cb-425a-be17-1edefb32f67f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:31.792445 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bf865-59cb-425a-be17-1edefb32f67f None admin] PATH_INFO: `/v3/users/40395749310542bc824e993a4d655097` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:31.796451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bf865-59cb-425a-be17-1edefb32f67f None admin] RBAC: Authorizing `identity:get_user(user_id=40395749310542bc824e993a4d655097)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:31.800284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bf865-59cb-425a-be17-1edefb32f67f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:31.805038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 45/84] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:31 2022] GET /identity/v3/users/40395749310542bc824e993a4d655097 => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:31.807504 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bf865-59cb-425a-be17-1edefb32f67f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:31.860640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:31.882169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76be85d-331d-437f-b1b6-746f5d7c0212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:31.883943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76be85d-331d-437f-b1b6-746f5d7c0212 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:31.990704 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:32.008535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bf865-59cb-425a-be17-1edefb32f67f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:32.012389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 40/85] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:07:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:07:32.013369 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76be85d-331d-437f-b1b6-746f5d7c0212 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:32.053218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165dec3-d3e0-4a18-94e2-f2e4d47ca2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:32.054541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dec3-d3e0-4a18-94e2-f2e4d47ca2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:32.055206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dec3-d3e0-4a18-94e2-f2e4d47ca2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:32.055983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dec3-d3e0-4a18-94e2-f2e4d47ca2c7 None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:32.058654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165dec3-d3e0-4a18-94e2-f2e4d47ca2c7 None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:32.061739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165dec3-d3e0-4a18-94e2-f2e4d47ca2c7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:32.066126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 46/86] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:31 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:32.068302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165dec3-d3e0-4a18-94e2-f2e4d47ca2c7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:32.157098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:32.190002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76be85d-331d-437f-b1b6-746f5d7c0212 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:32.256192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256ad91-70b1-416c-8b20-a4a029a4df6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:32.256863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ad91-70b1-416c-8b20-a4a029a4df6c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:32.257341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ad91-70b1-416c-8b20-a4a029a4df6c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:32.257813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ad91-70b1-416c-8b20-a4a029a4df6c None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:32.258970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256ad91-70b1-416c-8b20-a4a029a4df6c None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:32.259489 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256ad91-70b1-416c-8b20-a4a029a4df6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:32.262713 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256ad91-70b1-416c-8b20-a4a029a4df6c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:32.279736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 41/87] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:07:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:32.281188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256ad91-70b1-416c-8b20-a4a029a4df6c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:32.295707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165dec3-d3e0-4a18-94e2-f2e4d47ca2c7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:32.364666 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e12bb3-090c-4cf1-a63c-fc7c67e577bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:32.365544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e12bb3-090c-4cf1-a63c-fc7c67e577bc None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:32.365970 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e12bb3-090c-4cf1-a63c-fc7c67e577bc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:32.366411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e12bb3-090c-4cf1-a63c-fc7c67e577bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:32.395585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:32.458756 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e12bb3-090c-4cf1-a63c-fc7c67e577bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:32.460481 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e12bb3-090c-4cf1-a63c-fc7c67e577bc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:32.468989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256ad91-70b1-416c-8b20-a4a029a4df6c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:32.533133 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d3caa-3ff5-44b6-acb8-d0d0b67f4117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:32.534281 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d3caa-3ff5-44b6-acb8-d0d0b67f4117 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:32.534770 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d3caa-3ff5-44b6-acb8-d0d0b67f4117 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:32.535262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d3caa-3ff5-44b6-acb8-d0d0b67f4117 None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:32.537707 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d3caa-3ff5-44b6-acb8-d0d0b67f4117 None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:32.540299 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d3caa-3ff5-44b6-acb8-d0d0b67f4117 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:32.544527 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 42/88] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:32 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:32.550406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d3caa-3ff5-44b6-acb8-d0d0b67f4117 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:32.577409 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 47/89] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:07:32.578759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e12bb3-090c-4cf1-a63c-fc7c67e577bc None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:32.584946 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:32.643188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:32.692582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e12bb3-090c-4cf1-a63c-fc7c67e577bc None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:32.733456 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dc4cc-e6fa-482f-b433-36794fce2ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:32.734480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc4cc-e6fa-482f-b433-36794fce2ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:32.734916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc4cc-e6fa-482f-b433-36794fce2ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:32.735440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc4cc-e6fa-482f-b433-36794fce2ab8 None admin] PATH_INFO: `/v3/users/de5b926665fc4538a717ef556ffe0d72` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:32.736841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dc4cc-e6fa-482f-b433-36794fce2ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=de5b926665fc4538a717ef556ffe0d72)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:32.738489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dc4cc-e6fa-482f-b433-36794fce2ab8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:32.740497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 48/90] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:32 2022] GET /identity/v3/users/de5b926665fc4538a717ef556ffe0d72 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:32.741524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dc4cc-e6fa-482f-b433-36794fce2ab8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:32.751501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d3caa-3ff5-44b6-acb8-d0d0b67f4117 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:32.817063 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61369a6d-3687-4f3c-a2b9-3ec378d7f704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:32.818229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61369a6d-3687-4f3c-a2b9-3ec378d7f704 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:32.818694 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61369a6d-3687-4f3c-a2b9-3ec378d7f704 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:32.819188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61369a6d-3687-4f3c-a2b9-3ec378d7f704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:32.820661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61369a6d-3687-4f3c-a2b9-3ec378d7f704 None admin] RBAC: Adding query filter params (role.id=e43d5cbe01fb477f98fbe79db2fd2e5c, scope.project.id=0f6eedc7ec584320b4fdd810045aef8f, user.id=de5b926665fc4538a717ef556ffe0d72) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:32.822073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61369a6d-3687-4f3c-a2b9-3ec378d7f704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:32.823853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61369a6d-3687-4f3c-a2b9-3ec378d7f704 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:32.848022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 43/91] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:07:32 2022] GET /identity/v3/role_assignments?user.id=de5b926665fc4538a717ef556ffe0d72&scope.project.id=0f6eedc7ec584320b4fdd810045aef8f&role.id=e43d5cbe01fb477f98fbe79db2fd2e5c => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:32.850105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61369a6d-3687-4f3c-a2b9-3ec378d7f704 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:32.858774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dc4cc-e6fa-482f-b433-36794fce2ab8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:32.888579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:32.902089 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b116ad-1f2d-42a2-88f9-140ad59ae3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:32.903150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b116ad-1f2d-42a2-88f9-140ad59ae3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:32.903691 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b116ad-1f2d-42a2-88f9-140ad59ae3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:32.904291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b116ad-1f2d-42a2-88f9-140ad59ae3c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:32.905306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b116ad-1f2d-42a2-88f9-140ad59ae3c5 None admin] RBAC: Adding query filter params (role.id=fdf188800dba4eee980df53694a7ed69, scope.project.id=0f6eedc7ec584320b4fdd810045aef8f, user.id=de5b926665fc4538a717ef556ffe0d72) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:32.905852 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b116ad-1f2d-42a2-88f9-140ad59ae3c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:32.907640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b116ad-1f2d-42a2-88f9-140ad59ae3c5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:32.914783 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 49/92] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:07:32 2022] GET /identity/v3/role_assignments?user.id=de5b926665fc4538a717ef556ffe0d72&scope.project.id=0f6eedc7ec584320b4fdd810045aef8f&role.id=fdf188800dba4eee980df53694a7ed69 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:32.916128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b116ad-1f2d-42a2-88f9-140ad59ae3c5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:33.104943 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b116ad-1f2d-42a2-88f9-140ad59ae3c5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:33.121107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:33.203207 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61369a6d-3687-4f3c-a2b9-3ec378d7f704 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:33.223534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab5e21-e5af-4dd2-98cf-47aadca8822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:33.224619 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab5e21-e5af-4dd2-98cf-47aadca8822e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:33.225157 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab5e21-e5af-4dd2-98cf-47aadca8822e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:33.225657 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab5e21-e5af-4dd2-98cf-47aadca8822e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:33.306975 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a188b9-1bfb-4d77-b067-4cabf746342e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:33.307643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a188b9-1bfb-4d77-b067-4cabf746342e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:33.307929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a188b9-1bfb-4d77-b067-4cabf746342e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:33.308207 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a188b9-1bfb-4d77-b067-4cabf746342e None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:33.313463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a188b9-1bfb-4d77-b067-4cabf746342e None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:33.314973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a188b9-1bfb-4d77-b067-4cabf746342e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:33.316735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 44/93] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:32 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:33.326920 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a188b9-1bfb-4d77-b067-4cabf746342e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:33.482664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:33.535911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab5e21-e5af-4dd2-98cf-47aadca8822e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:33.545231 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a188b9-1bfb-4d77-b067-4cabf746342e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:33.547144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab5e21-e5af-4dd2-98cf-47aadca8822e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:33.614697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68610c5-a373-4758-8014-c8b026e767bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:33.615707 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68610c5-a373-4758-8014-c8b026e767bd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:33.616202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68610c5-a373-4758-8014-c8b026e767bd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:33.616668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68610c5-a373-4758-8014-c8b026e767bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:33.618072 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68610c5-a373-4758-8014-c8b026e767bd None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=0f6eedc7ec584320b4fdd810045aef8f, user.id=40395749310542bc824e993a4d655097) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:33.618593 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68610c5-a373-4758-8014-c8b026e767bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:33.622095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68610c5-a373-4758-8014-c8b026e767bd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:33.640733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 45/94] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:07:33 2022] GET /identity/v3/role_assignments?user.id=40395749310542bc824e993a4d655097&scope.project.id=0f6eedc7ec584320b4fdd810045aef8f&role.id=beec000223e041209205627bfa0dbed1 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:33.762875 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 50/95] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 847 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:07:33.773577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68610c5-a373-4758-8014-c8b026e767bd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:33.805668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:33.967886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68610c5-a373-4758-8014-c8b026e767bd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:34.011596 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dd7d9-c09d-44aa-8833-2155c1f4da66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:34.012647 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dd7d9-c09d-44aa-8833-2155c1f4da66 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:34.013247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dd7d9-c09d-44aa-8833-2155c1f4da66 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:34.013725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dd7d9-c09d-44aa-8833-2155c1f4da66 None admin] PATH_INFO: `/v3/projects/d888fc16a8ba4a7eb5747166a04ff7e9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:34.015241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92dd7d9-c09d-44aa-8833-2155c1f4da66 None admin] RBAC: Authorizing `identity:get_project(project_id=d888fc16a8ba4a7eb5747166a04ff7e9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:34.016948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92dd7d9-c09d-44aa-8833-2155c1f4da66 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:34.018849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 46/96] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:33 2022] GET /identity/v3/projects/d888fc16a8ba4a7eb5747166a04ff7e9 => generated 312 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:34.028087 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab5e21-e5af-4dd2-98cf-47aadca8822e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:34.216653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:34.234981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab5e21-e5af-4dd2-98cf-47aadca8822e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:34.282127 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65a2fb-6844-42fb-b7ae-31f578165905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:34.282670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a2fb-6844-42fb-b7ae-31f578165905 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:34.282952 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a2fb-6844-42fb-b7ae-31f578165905 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:34.283308 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a2fb-6844-42fb-b7ae-31f578165905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:34.283968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65a2fb-6844-42fb-b7ae-31f578165905 None admin] RBAC: Adding query filter params (role.id=e43d5cbe01fb477f98fbe79db2fd2e5c, scope.project.id=d888fc16a8ba4a7eb5747166a04ff7e9, user.id=de5b926665fc4538a717ef556ffe0d72) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:34.284282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65a2fb-6844-42fb-b7ae-31f578165905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:34.285818 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65a2fb-6844-42fb-b7ae-31f578165905 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:34.292314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 51/97] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:07:34 2022] GET /identity/v3/role_assignments?user.id=de5b926665fc4538a717ef556ffe0d72&scope.project.id=d888fc16a8ba4a7eb5747166a04ff7e9&role.id=e43d5cbe01fb477f98fbe79db2fd2e5c => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:34.630460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd192a7-3659-4d4d-891b-3de423798c04 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:34.630998 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd192a7-3659-4d4d-891b-3de423798c04 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:34.630998 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd192a7-3659-4d4d-891b-3de423798c04 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:34.632347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 47/98] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:34.640990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620d742-38ff-4d7e-a8ed-473deac98624 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:34.641289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620d742-38ff-4d7e-a8ed-473deac98624 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:34.641541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620d742-38ff-4d7e-a8ed-473deac98624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:34.674843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9620d742-38ff-4d7e-a8ed-473deac98624 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:34.676084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9620d742-38ff-4d7e-a8ed-473deac98624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:34.775674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 52/99] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:34.967524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cae2e3-ae37-43a1-ad71-93b2295b6d8e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:34.967866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cae2e3-ae37-43a1-ad71-93b2295b6d8e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:34.967978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cae2e3-ae37-43a1-ad71-93b2295b6d8e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:34.969578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 48/100] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:34.975126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbc9c0-83a0-4fca-9be9-24ee6f6307e5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:34.975428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbc9c0-83a0-4fca-9be9-24ee6f6307e5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:34.975703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbc9c0-83a0-4fca-9be9-24ee6f6307e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:34.998923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5cfbc9c0-83a0-4fca-9be9-24ee6f6307e5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:35.000152 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5cfbc9c0-83a0-4fca-9be9-24ee6f6307e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:35.101368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 53/101] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:35.466204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cae2e3-ae37-43a1-ad71-93b2295b6d8e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:35.608504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:35.637429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cae2e3-ae37-43a1-ad71-93b2295b6d8e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:35.654537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbc9c0-83a0-4fca-9be9-24ee6f6307e5 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:35.678725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:35.733623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c7c82-55b2-463d-9435-db98565dea85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:35.734211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c7c82-55b2-463d-9435-db98565dea85 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:35.734501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c7c82-55b2-463d-9435-db98565dea85 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:35.734785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c7c82-55b2-463d-9435-db98565dea85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:35.736062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c7c82-55b2-463d-9435-db98565dea85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:35.737631 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c7c82-55b2-463d-9435-db98565dea85 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:35.739439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 49/102] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:07:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:35.745793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c7c82-55b2-463d-9435-db98565dea85 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:35.862110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbc9c0-83a0-4fca-9be9-24ee6f6307e5 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:35.937389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febea9c-c330-4a18-b1cb-775b0fd7d505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:35.938047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febea9c-c330-4a18-b1cb-775b0fd7d505 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:35.938329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febea9c-c330-4a18-b1cb-775b0fd7d505 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:35.938600 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febea9c-c330-4a18-b1cb-775b0fd7d505 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:35.943445 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c7c82-55b2-463d-9435-db98565dea85 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:35.960954 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febea9c-c330-4a18-b1cb-775b0fd7d505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-2febea9c-c330-4a18-b1cb-775b0fd7d505 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:35.966687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:35.967648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:35.968448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:35.968448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:35.968448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:35.968448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:35.968448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:35.968448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:35.968448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:35.968448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:35.968448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:35.968448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:35.968448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:07:35.968448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:07:35.968448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 54/103] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:07:35.975364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febea9c-c330-4a18-b1cb-775b0fd7d505 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:35.985410 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d2cad-d787-4efd-bdda-9df71690b78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:35.985959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d2cad-d787-4efd-bdda-9df71690b78e None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:35.986242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d2cad-d787-4efd-bdda-9df71690b78e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:35.986519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d2cad-d787-4efd-bdda-9df71690b78e None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:35.987365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d2cad-d787-4efd-bdda-9df71690b78e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:35.988899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d2cad-d787-4efd-bdda-9df71690b78e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:36.045517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:36.065112 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 50/104] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 21 16:07:35 2022] POST /identity/v3/projects => generated 302 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:07:36.131091 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:36.180908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febea9c-c330-4a18-b1cb-775b0fd7d505 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:36.255116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa1dd3-505b-4f25-800d-d4c3f9dc4696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:36.256102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa1dd3-505b-4f25-800d-d4c3f9dc4696 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:36.256607 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa1dd3-505b-4f25-800d-d4c3f9dc4696 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:36.257147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa1dd3-505b-4f25-800d-d4c3f9dc4696 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:36.258343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa1dd3-505b-4f25-800d-d4c3f9dc4696 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:36.258895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa1dd3-505b-4f25-800d-d4c3f9dc4696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:36.261953 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa1dd3-505b-4f25-800d-d4c3f9dc4696 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:36.280058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 55/105] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:07:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:36.287121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d2cad-d787-4efd-bdda-9df71690b78e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:36.489769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d2cad-d787-4efd-bdda-9df71690b78e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:36.569050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c8f41-157e-4994-9a6b-a72cf4c9557e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:36.570057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c8f41-157e-4994-9a6b-a72cf4c9557e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:36.570546 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c8f41-157e-4994-9a6b-a72cf4c9557e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:36.571022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c8f41-157e-4994-9a6b-a72cf4c9557e None admin] PATH_INFO: `/v3/users/cbaf5a1d211147f8832ee30a1f8bfba5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:36.609817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c8f41-157e-4994-9a6b-a72cf4c9557e None admin] RBAC: Authorizing `identity:get_user(user_id=cbaf5a1d211147f8832ee30a1f8bfba5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:36.612648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c8f41-157e-4994-9a6b-a72cf4c9557e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:36.616157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 51/106] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:36 2022] GET /identity/v3/users/cbaf5a1d211147f8832ee30a1f8bfba5 => generated 289 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:36.622463 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa1dd3-505b-4f25-800d-d4c3f9dc4696 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:36.879917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa1dd3-505b-4f25-800d-d4c3f9dc4696 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:36.962662 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbe646-791a-488b-a591-00b33b3ede04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:36.964516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbe646-791a-488b-a591-00b33b3ede04 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:36.965039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbe646-791a-488b-a591-00b33b3ede04 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:36.965519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbe646-791a-488b-a591-00b33b3ede04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:36.976903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:37.110377 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61c730-2845-4b02-9991-1347908170fb None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:37.111182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61c730-2845-4b02-9991-1347908170fb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:37.111323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61c730-2845-4b02-9991-1347908170fb None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:37.113954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 52/107] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:07:37.124809 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867a51a-5e4d-461e-b738-bbaee625734d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:37.125719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867a51a-5e4d-461e-b738-bbaee625734d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:37.126461 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867a51a-5e4d-461e-b738-bbaee625734d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:37.143307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbe646-791a-488b-a591-00b33b3ede04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:37.145855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbe646-791a-488b-a591-00b33b3ede04 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:37.174906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a867a51a-5e4d-461e-b738-bbaee625734d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:37.177434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a867a51a-5e4d-461e-b738-bbaee625734d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:37.341248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:37.382132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 53/108] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:07:37.460572 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 56/109] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 839 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:07:37.463702 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a05f21-e433-4d95-82eb-b0ad2cd8f28d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:37.464241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a05f21-e433-4d95-82eb-b0ad2cd8f28d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:37.464836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a05f21-e433-4d95-82eb-b0ad2cd8f28d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:37.466644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 54/110] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:37.467816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbe646-791a-488b-a591-00b33b3ede04 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:37.476407 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9605b3-affe-41e4-b0c8-baa294c1f6eb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:37.477075 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9605b3-affe-41e4-b0c8-baa294c1f6eb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:37.477573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9605b3-affe-41e4-b0c8-baa294c1f6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:37.514241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ca9605b3-affe-41e4-b0c8-baa294c1f6eb None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:37.516286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ca9605b3-affe-41e4-b0c8-baa294c1f6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:37.556491 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:37.659049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 55/111] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:07:37.689158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbe646-791a-488b-a591-00b33b3ede04 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:37.744894 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee59f8-b658-4cd0-acf1-a26b97f1766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:37.745777 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee59f8-b658-4cd0-acf1-a26b97f1766b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:37.746246 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee59f8-b658-4cd0-acf1-a26b97f1766b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:37.746664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee59f8-b658-4cd0-acf1-a26b97f1766b None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:37.749090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee59f8-b658-4cd0-acf1-a26b97f1766b None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:37.750751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee59f8-b658-4cd0-acf1-a26b97f1766b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:37.752633 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 57/112] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:37 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:37.759555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9605b3-affe-41e4-b0c8-baa294c1f6eb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:37.851108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eccf6-b79e-40bd-9939-27bb8fb97927 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:37.851772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eccf6-b79e-40bd-9939-27bb8fb97927 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:37.852269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eccf6-b79e-40bd-9939-27bb8fb97927 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:37.858623 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 58/113] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:37.865108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e065bb4-a961-4dcb-9a49-18dc7140ad3f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:37.865721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e065bb4-a961-4dcb-9a49-18dc7140ad3f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:37.866206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e065bb4-a961-4dcb-9a49-18dc7140ad3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:37.899151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9e065bb4-a961-4dcb-9a49-18dc7140ad3f None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:37.907938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9e065bb4-a961-4dcb-9a49-18dc7140ad3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:37.955847 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9605b3-affe-41e4-b0c8-baa294c1f6eb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:38.017981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:38.034010 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab019ba6-30ea-4627-b41e-7d2e691972e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:38.035034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab019ba6-30ea-4627-b41e-7d2e691972e7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:38.035546 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab019ba6-30ea-4627-b41e-7d2e691972e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:38.036037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab019ba6-30ea-4627-b41e-7d2e691972e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:38.037424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab019ba6-30ea-4627-b41e-7d2e691972e7 None admin] RBAC: Adding query filter params (role.id=fa4637a31390472a99f691c8c7f995e8, scope.project.id=0f6eedc7ec584320b4fdd810045aef8f, user.id=cbaf5a1d211147f8832ee30a1f8bfba5) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:38.038198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab019ba6-30ea-4627-b41e-7d2e691972e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:38.041626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab019ba6-30ea-4627-b41e-7d2e691972e7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:38.053484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 56/114] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:07:37 2022] GET /identity/v3/role_assignments?user.id=cbaf5a1d211147f8832ee30a1f8bfba5&scope.project.id=0f6eedc7ec584320b4fdd810045aef8f&role.id=fa4637a31390472a99f691c8c7f995e8 => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:38.095315 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 59/115] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:07:38.145611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524944a-ee4d-4344-b4e2-bcfc31a89482 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:38.146170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524944a-ee4d-4344-b4e2-bcfc31a89482 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:38.146639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524944a-ee4d-4344-b4e2-bcfc31a89482 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:38.149477 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 57/116] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:38.157239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e065bb4-a961-4dcb-9a49-18dc7140ad3f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:38.159821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e6586-1d05-4ead-b09c-f493f6b3bc92 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:38.160310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e6586-1d05-4ead-b09c-f493f6b3bc92 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:38.160964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e6586-1d05-4ead-b09c-f493f6b3bc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:38.214667 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ce4e6586-1d05-4ead-b09c-f493f6b3bc92 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:38.220996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ce4e6586-1d05-4ead-b09c-f493f6b3bc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:38.252545 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:38.464523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 58/117] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:38.465841 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e6586-1d05-4ead-b09c-f493f6b3bc92 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:38.500252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e065bb4-a961-4dcb-9a49-18dc7140ad3f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:38.576401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e6586-1d05-4ead-b09c-f493f6b3bc92 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:38.589318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:38.615904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfd910-bf89-4ede-8e3e-14bcc884cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:38.616141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa6cd5-a18e-4f0c-86bf-96e209f6b730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:38.616573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfd910-bf89-4ede-8e3e-14bcc884cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:38.616865 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfd910-bf89-4ede-8e3e-14bcc884cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:38.617135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfd910-bf89-4ede-8e3e-14bcc884cdd4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:38.618068 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa6cd5-a18e-4f0c-86bf-96e209f6b730 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:38.618797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa6cd5-a18e-4f0c-86bf-96e209f6b730 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:38.619342 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa6cd5-a18e-4f0c-86bf-96e209f6b730 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:38.632194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa6cd5-a18e-4f0c-86bf-96e209f6b730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a8aa6cd5-a18e-4f0c-86bf-96e209f6b730 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:38.637973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:38.638855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:38.639622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:38.639622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:38.639622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:38.639622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:38.639622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:38.639622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:38.639622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:38.639622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:38.639622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:38.639622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:38.639622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:07:38.639622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:07:38.642793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 59/118] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:38.644066 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa6cd5-a18e-4f0c-86bf-96e209f6b730 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:38.665425 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfd910-bf89-4ede-8e3e-14bcc884cdd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-53bfd910-bf89-4ede-8e3e-14bcc884cdd4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:38.671163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:38.672124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:38.673542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:38.673542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:38.673542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:38.673542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:38.673542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:38.673542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:38.673542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:38.673542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:38.673542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:38.673542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:38.673542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:07:38.673542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:07:38.673542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 60/119] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:07:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 516 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:38.681766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfd910-bf89-4ede-8e3e-14bcc884cdd4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:38.834506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa6cd5-a18e-4f0c-86bf-96e209f6b730 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:38.891043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:38.907851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6020259-8bcd-4d13-b0fd-e79c9314bfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:38.909371 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6020259-8bcd-4d13-b0fd-e79c9314bfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:38.910090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6020259-8bcd-4d13-b0fd-e79c9314bfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:38.910249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfd910-bf89-4ede-8e3e-14bcc884cdd4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:38.911637 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6020259-8bcd-4d13-b0fd-e79c9314bfa4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:38.933567 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6020259-8bcd-4d13-b0fd-e79c9314bfa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d6020259-8bcd-4d13-b0fd-e79c9314bfa4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:38.943449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:38.945209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:38.946732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:38.946732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:38.946732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:38.946732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:38.946732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:38.946732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:38.946732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:38.946732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:38.946732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:38.946732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:38.946732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:07:38.946732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:07:38.950503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 60/120] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:38.959524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6020259-8bcd-4d13-b0fd-e79c9314bfa4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:38.980485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04187d-9c45-4b1d-9536-d02831ed13a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:38.981958 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04187d-9c45-4b1d-9536-d02831ed13a5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:38.982684 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04187d-9c45-4b1d-9536-d02831ed13a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:38.983393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04187d-9c45-4b1d-9536-d02831ed13a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:38.985034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04187d-9c45-4b1d-9536-d02831ed13a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:38.985693 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04187d-9c45-4b1d-9536-d02831ed13a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:38.988197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04187d-9c45-4b1d-9536-d02831ed13a5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:39.008919 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 61/121] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:07:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:39.014496 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04187d-9c45-4b1d-9536-d02831ed13a5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:39.037088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:39.188633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6020259-8bcd-4d13-b0fd-e79c9314bfa4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:39.205077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04187d-9c45-4b1d-9536-d02831ed13a5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:39.270403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a2185-760b-4a09-b495-bd9aa631cc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:39.271980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a2185-760b-4a09-b495-bd9aa631cc6f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:39.272799 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a2185-760b-4a09-b495-bd9aa631cc6f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:39.273748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a2185-760b-4a09-b495-bd9aa631cc6f None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:39.275539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a2185-760b-4a09-b495-bd9aa631cc6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:39.277057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a2185-760b-4a09-b495-bd9aa631cc6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:39.278753 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b67f4-0077-428c-82b2-dc779c66bdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:39.279810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b67f4-0077-428c-82b2-dc779c66bdd9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:39.280308 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b67f4-0077-428c-82b2-dc779c66bdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:39.280836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b67f4-0077-428c-82b2-dc779c66bdd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:39.281189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a2185-760b-4a09-b495-bd9aa631cc6f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:39.299047 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 61/122] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:07:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:39.301099 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a2185-760b-4a09-b495-bd9aa631cc6f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:39.304058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b67f4-0077-428c-82b2-dc779c66bdd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-7e6b67f4-0077-428c-82b2-dc779c66bdd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:39.316451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:39.318071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:39.319524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:39.319524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:39.319524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:39.319524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:39.319524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:39.319524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:39.319524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:39.319524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:39.319524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:39.319524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:39.319524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:39.319524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:07:39.328796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 62/123] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:07:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:39.330836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b67f4-0077-428c-82b2-dc779c66bdd9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:39.366316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:39.522026 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:39.541342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b67f4-0077-428c-82b2-dc779c66bdd9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:39.542829 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a2185-760b-4a09-b495-bd9aa631cc6f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:39.608426 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094d22d-c3e9-44b1-b2f8-0cf3adfbf7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:39.610153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094d22d-c3e9-44b1-b2f8-0cf3adfbf7ba None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:39.610911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094d22d-c3e9-44b1-b2f8-0cf3adfbf7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:39.611775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094d22d-c3e9-44b1-b2f8-0cf3adfbf7ba None admin] PATH_INFO: `/v3/users/de5b926665fc4538a717ef556ffe0d72` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:39.614324 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094d22d-c3e9-44b1-b2f8-0cf3adfbf7ba None admin] RBAC: Authorizing `identity:get_user(user_id=de5b926665fc4538a717ef556ffe0d72)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:39.616305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634d1e6-7618-4cf2-bdda-c8911c59c79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:39.617386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634d1e6-7618-4cf2-bdda-c8911c59c79b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:39.617872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634d1e6-7618-4cf2-bdda-c8911c59c79b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:39.618345 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634d1e6-7618-4cf2-bdda-c8911c59c79b None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:39.619083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094d22d-c3e9-44b1-b2f8-0cf3adfbf7ba None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:39.620053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634d1e6-7618-4cf2-bdda-c8911c59c79b None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:39.620589 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634d1e6-7618-4cf2-bdda-c8911c59c79b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:39.622934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634d1e6-7618-4cf2-bdda-c8911c59c79b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:39.624252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 63/124] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:39 2022] GET /identity/v3/users/de5b926665fc4538a717ef556ffe0d72 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:39.626059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094d22d-c3e9-44b1-b2f8-0cf3adfbf7ba None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:39.655862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 62/125] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:07:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:39.655862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634d1e6-7618-4cf2-bdda-c8911c59c79b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:39.810763 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:39.853053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094d22d-c3e9-44b1-b2f8-0cf3adfbf7ba None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:39.880281 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634d1e6-7618-4cf2-bdda-c8911c59c79b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:39.929228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858abdb0-721b-4da3-b46d-f1df416c4778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:39.930310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858abdb0-721b-4da3-b46d-f1df416c4778 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:39.930793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858abdb0-721b-4da3-b46d-f1df416c4778 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:39.931270 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858abdb0-721b-4da3-b46d-f1df416c4778 None admin] PATH_INFO: `/v3/users/de5b926665fc4538a717ef556ffe0d72` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:39.933390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858abdb0-721b-4da3-b46d-f1df416c4778 None admin] RBAC: Authorizing `identity:get_user(user_id=de5b926665fc4538a717ef556ffe0d72)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:39.936027 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858abdb0-721b-4da3-b46d-f1df416c4778 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:39.940765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 64/126] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:39 2022] GET /identity/v3/users/de5b926665fc4538a717ef556ffe0d72 => generated 275 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:39.940765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858abdb0-721b-4da3-b46d-f1df416c4778 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:39.954924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052a66b-f68b-4514-ba8d-d8e668534c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:39.955994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052a66b-f68b-4514-ba8d-d8e668534c52 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:39.956486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052a66b-f68b-4514-ba8d-d8e668534c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:39.957317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052a66b-f68b-4514-ba8d-d8e668534c52 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:39.958323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052a66b-f68b-4514-ba8d-d8e668534c52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:39.959184 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052a66b-f68b-4514-ba8d-d8e668534c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:39.962448 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052a66b-f68b-4514-ba8d-d8e668534c52 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:39.984897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 63/127] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:39.984897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052a66b-f68b-4514-ba8d-d8e668534c52 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:40.016655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:40.120181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858abdb0-721b-4da3-b46d-f1df416c4778 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:40.167921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81865e6d-01c8-4506-ab36-bc28573c4573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:40.168765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81865e6d-01c8-4506-ab36-bc28573c4573 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:40.169192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81865e6d-01c8-4506-ab36-bc28573c4573 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:40.169655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81865e6d-01c8-4506-ab36-bc28573c4573 None admin] PATH_INFO: `/v3/projects/d888fc16a8ba4a7eb5747166a04ff7e9` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:40.171441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81865e6d-01c8-4506-ab36-bc28573c4573 None admin] RBAC: Authorizing `identity:get_project(project_id=d888fc16a8ba4a7eb5747166a04ff7e9)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:40.173403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81865e6d-01c8-4506-ab36-bc28573c4573 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:40.175719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 65/128] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:39 2022] GET /identity/v3/projects/d888fc16a8ba4a7eb5747166a04ff7e9 => generated 312 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:40.175925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052a66b-f68b-4514-ba8d-d8e668534c52 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:40.177546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ded889-a7b4-4359-8b5f-349f6035c4e3 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:40.178030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ded889-a7b4-4359-8b5f-349f6035c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:40.178499 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ded889-a7b4-4359-8b5f-349f6035c4e3 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:40.180898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 66/129] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:40.182450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ded889-a7b4-4359-8b5f-349f6035c4e3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:40.209175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:40.246074 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2243e1-b009-407b-b9bd-bb13342b9ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:40.247122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2243e1-b009-407b-b9bd-bb13342b9ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:40.247549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2243e1-b009-407b-b9bd-bb13342b9ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:40.248005 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2243e1-b009-407b-b9bd-bb13342b9ab9 None admin] PATH_INFO: `/v3/users/de5b926665fc4538a717ef556ffe0d72` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:40.250111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2243e1-b009-407b-b9bd-bb13342b9ab9 None admin] RBAC: Authorizing `identity:get_user(user_id=de5b926665fc4538a717ef556ffe0d72)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:40.252145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2243e1-b009-407b-b9bd-bb13342b9ab9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:40.255285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 64/130] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:39 2022] GET /identity/v3/users/de5b926665fc4538a717ef556ffe0d72 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:40.256422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2243e1-b009-407b-b9bd-bb13342b9ab9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:40.370517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ded889-a7b4-4359-8b5f-349f6035c4e3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:40.394292 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:40.414879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5b434-de96-4f3a-b5ac-8584eb03b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:40.415664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5b434-de96-4f3a-b5ac-8584eb03b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:40.415949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5b434-de96-4f3a-b5ac-8584eb03b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:40.416814 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5b434-de96-4f3a-b5ac-8584eb03b5b2 None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:40.418062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5b434-de96-4f3a-b5ac-8584eb03b5b2 None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:40.419554 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5b434-de96-4f3a-b5ac-8584eb03b5b2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:40.428965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 67/131] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:40 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:40.428965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5b434-de96-4f3a-b5ac-8584eb03b5b2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:40.438612 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2243e1-b009-407b-b9bd-bb13342b9ab9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:40.505578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f0fca-e252-4b60-a7eb-6bb56aaafac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:40.506882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f0fca-e252-4b60-a7eb-6bb56aaafac7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:40.507562 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f0fca-e252-4b60-a7eb-6bb56aaafac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:40.508133 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f0fca-e252-4b60-a7eb-6bb56aaafac7 None admin] PATH_INFO: `/v3/users/40395749310542bc824e993a4d655097` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:40.510178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f0fca-e252-4b60-a7eb-6bb56aaafac7 None admin] RBAC: Authorizing `identity:get_user(user_id=40395749310542bc824e993a4d655097)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:40.512649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f0fca-e252-4b60-a7eb-6bb56aaafac7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:40.524206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 65/132] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:40 2022] GET /identity/v3/users/40395749310542bc824e993a4d655097 => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:40.524206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a60918-6cb8-46ee-a1eb-b5cf9e7a20f2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:40.524206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a60918-6cb8-46ee-a1eb-b5cf9e7a20f2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:40.524206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a60918-6cb8-46ee-a1eb-b5cf9e7a20f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:40.549380 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-82a60918-6cb8-46ee-a1eb-b5cf9e7a20f2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:40.551361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-82a60918-6cb8-46ee-a1eb-b5cf9e7a20f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:40.593535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:40.616793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5b434-de96-4f3a-b5ac-8584eb03b5b2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:40.664003 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaad36c-d1ce-467d-a12b-82bc968015cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:40.665137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaad36c-d1ce-467d-a12b-82bc968015cf None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:40.665508 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaad36c-d1ce-467d-a12b-82bc968015cf None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:40.665876 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaad36c-d1ce-467d-a12b-82bc968015cf None admin] PATH_INFO: `/v3/projects/d888fc16a8ba4a7eb5747166a04ff7e9/users/de5b926665fc4538a717ef556ffe0d72/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:40.667198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 66/133] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:40.668905 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaad36c-d1ce-467d-a12b-82bc968015cf None admin] RBAC: Authorizing `identity:create_grant(project_id=d888fc16a8ba4a7eb5747166a04ff7e9, user_id=de5b926665fc4538a717ef556ffe0d72, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:40.670116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a60918-6cb8-46ee-a1eb-b5cf9e7a20f2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:40.670406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaad36c-d1ce-467d-a12b-82bc968015cf None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:40.696100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 68/134] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:07:40 2022] PUT /identity/v3/projects/d888fc16a8ba4a7eb5747166a04ff7e9/users/de5b926665fc4538a717ef556ffe0d72/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:07:40.697882 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaad36c-d1ce-467d-a12b-82bc968015cf None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:40.862854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:40.903723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a60918-6cb8-46ee-a1eb-b5cf9e7a20f2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:40.916602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaad36c-d1ce-467d-a12b-82bc968015cf None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:40.977931 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cfa5a-e8fd-49f6-80b4-982c98857dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:40.980113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cfa5a-e8fd-49f6-80b4-982c98857dfa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:40.980802 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cfa5a-e8fd-49f6-80b4-982c98857dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:40.981395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cfa5a-e8fd-49f6-80b4-982c98857dfa None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:40.983353 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cfa5a-e8fd-49f6-80b4-982c98857dfa None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:40.985295 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b053a-2ac6-4037-b627-3941d7e5c1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:40.986451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b053a-2ac6-4037-b627-3941d7e5c1df None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:40.986608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cfa5a-e8fd-49f6-80b4-982c98857dfa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:40.986942 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b053a-2ac6-4037-b627-3941d7e5c1df None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:40.987450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b053a-2ac6-4037-b627-3941d7e5c1df None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f/users/de5b926665fc4538a717ef556ffe0d72/roles/fdf188800dba4eee980df53694a7ed69` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:40.989715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 67/135] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:40 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:40.990727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cfa5a-e8fd-49f6-80b4-982c98857dfa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:41.000119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b053a-2ac6-4037-b627-3941d7e5c1df None admin] RBAC: Authorizing `identity:create_grant(project_id=0f6eedc7ec584320b4fdd810045aef8f, user_id=de5b926665fc4538a717ef556ffe0d72, role_id=fdf188800dba4eee980df53694a7ed69)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:41.002231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b053a-2ac6-4037-b627-3941d7e5c1df None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:41.023049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 69/136] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:07:40 2022] PUT /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f/users/de5b926665fc4538a717ef556ffe0d72/roles/fdf188800dba4eee980df53694a7ed69 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:07:41.025155 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5cacc-c6b3-4640-b328-84b65c0d8c7f None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:41.026266 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5cacc-c6b3-4640-b328-84b65c0d8c7f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:41.026760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5cacc-c6b3-4640-b328-84b65c0d8c7f None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:41.029501 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 70/137] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:41.030823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5cacc-c6b3-4640-b328-84b65c0d8c7f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:41.047825 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:41.214498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cfa5a-e8fd-49f6-80b4-982c98857dfa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:41.226187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5cacc-c6b3-4640-b328-84b65c0d8c7f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:41.288018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ed746-f89c-4daa-8695-7c3e084c0a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:41.289244 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66998a-5134-4c4c-90b4-f89fce4f5e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:41.290257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66998a-5134-4c4c-90b4-f89fce4f5e55 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:41.290714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66998a-5134-4c4c-90b4-f89fce4f5e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:41.291189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ed746-f89c-4daa-8695-7c3e084c0a25 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:41.291334 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66998a-5134-4c4c-90b4-f89fce4f5e55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:41.292101 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ed746-f89c-4daa-8695-7c3e084c0a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:41.292891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ed746-f89c-4daa-8695-7c3e084c0a25 None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:41.293194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66998a-5134-4c4c-90b4-f89fce4f5e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:41.295498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ed746-f89c-4daa-8695-7c3e084c0a25 None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:41.295673 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66998a-5134-4c4c-90b4-f89fce4f5e55 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:41.303091 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 71/138] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:07:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:41.303091 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66998a-5134-4c4c-90b4-f89fce4f5e55 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:41.305034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ed746-f89c-4daa-8695-7c3e084c0a25 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:41.311079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 68/139] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:40 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:41.313958 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed8369-b3af-4371-8166-782884ae65f2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:41.314693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed8369-b3af-4371-8166-782884ae65f2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:41.315406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed8369-b3af-4371-8166-782884ae65f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:41.349284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-88ed8369-b3af-4371-8166-782884ae65f2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:41.351957 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-88ed8369-b3af-4371-8166-782884ae65f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:41.382446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:41.446315 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:41.489262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 69/140] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:41.490964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed8369-b3af-4371-8166-782884ae65f2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:41.507033 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66998a-5134-4c4c-90b4-f89fce4f5e55 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:41.592304 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2f5df-ffd7-469a-9127-8086dfcdd1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:41.593931 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2f5df-ffd7-469a-9127-8086dfcdd1f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:41.594414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2f5df-ffd7-469a-9127-8086dfcdd1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:41.594856 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2f5df-ffd7-469a-9127-8086dfcdd1f7 None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f/users/de5b926665fc4538a717ef556ffe0d72/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:41.601604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2f5df-ffd7-469a-9127-8086dfcdd1f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f6eedc7ec584320b4fdd810045aef8f, user_id=de5b926665fc4538a717ef556ffe0d72, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:41.604859 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2f5df-ffd7-469a-9127-8086dfcdd1f7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:41.646650 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 72/141] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:07:41 2022] PUT /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f/users/de5b926665fc4538a717ef556ffe0d72/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:07:41.651879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2f5df-ffd7-469a-9127-8086dfcdd1f7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:41.811946 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed8369-b3af-4371-8166-782884ae65f2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:41.914995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e4ec2-7b9a-4c88-a77d-6358301dc013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:41.915633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e4ec2-7b9a-4c88-a77d-6358301dc013 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:41.915918 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e4ec2-7b9a-4c88-a77d-6358301dc013 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:41.916929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e4ec2-7b9a-4c88-a77d-6358301dc013 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:41.917566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e4ec2-7b9a-4c88-a77d-6358301dc013 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:41.919046 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e4ec2-7b9a-4c88-a77d-6358301dc013 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:41.971291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 70/142] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:07:41 2022] POST /identity/v3/users => generated 283 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:07:41.995829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2f5df-ffd7-469a-9127-8086dfcdd1f7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:42.060418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446a15e-479b-4871-af3d-4bdf84ba7e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:42.061099 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446a15e-479b-4871-af3d-4bdf84ba7e04 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:42.061383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446a15e-479b-4871-af3d-4bdf84ba7e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:42.061661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446a15e-479b-4871-af3d-4bdf84ba7e04 None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f/users/40395749310542bc824e993a4d655097/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:42.063837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446a15e-479b-4871-af3d-4bdf84ba7e04 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f6eedc7ec584320b4fdd810045aef8f, user_id=40395749310542bc824e993a4d655097, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:42.065407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446a15e-479b-4871-af3d-4bdf84ba7e04 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:42.068125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:42.088120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 73/143] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:07:41 2022] PUT /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f/users/40395749310542bc824e993a4d655097/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:07:42.250672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e4ec2-7b9a-4c88-a77d-6358301dc013 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:42.255208 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:42.383531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e4ec2-7b9a-4c88-a77d-6358301dc013 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:42.425210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7376d4-1422-416b-8319-4f7174640ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:42.425971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7376d4-1422-416b-8319-4f7174640ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:42.426326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7376d4-1422-416b-8319-4f7174640ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:42.426671 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7376d4-1422-416b-8319-4f7174640ae3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:42.439388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7376d4-1422-416b-8319-4f7174640ae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0b7376d4-1422-416b-8319-4f7174640ae3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:42.444744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:42.446241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:42.448269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:42.448269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:42.448269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:42.448269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:42.448269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:42.448269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:42.448269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:42.448269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:42.448269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:42.448269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:42.448269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:07:42.448269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:07:42.448269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 71/144] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:42.456129 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446a15e-479b-4871-af3d-4bdf84ba7e04 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:42.649712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446a15e-479b-4871-af3d-4bdf84ba7e04 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:42.715173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71773d71-9081-4ade-8e1c-b7f8f54de604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:42.716215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773d71-9081-4ade-8e1c-b7f8f54de604 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:42.716737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773d71-9081-4ade-8e1c-b7f8f54de604 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:42.717243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773d71-9081-4ade-8e1c-b7f8f54de604 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:42.718457 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71773d71-9081-4ade-8e1c-b7f8f54de604 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:42.719008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71773d71-9081-4ade-8e1c-b7f8f54de604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:42.721715 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71773d71-9081-4ade-8e1c-b7f8f54de604 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:42.739057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 74/145] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:07:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:42.748414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7376d4-1422-416b-8319-4f7174640ae3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:42.875268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:42.960337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7376d4-1422-416b-8319-4f7174640ae3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:43.031643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c92dd-56c7-43ff-be09-792892d62878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:43.032715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c92dd-56c7-43ff-be09-792892d62878 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:43.033195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c92dd-56c7-43ff-be09-792892d62878 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:43.033676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c92dd-56c7-43ff-be09-792892d62878 None admin] PATH_INFO: `/v3/users/cbaf5a1d211147f8832ee30a1f8bfba5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:43.035737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c92dd-56c7-43ff-be09-792892d62878 None admin] RBAC: Authorizing `identity:get_user(user_id=cbaf5a1d211147f8832ee30a1f8bfba5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:43.038441 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c92dd-56c7-43ff-be09-792892d62878 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:43.042554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 72/146] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:42 2022] GET /identity/v3/users/cbaf5a1d211147f8832ee30a1f8bfba5 => generated 289 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:43.050654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71773d71-9081-4ade-8e1c-b7f8f54de604 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:43.190096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:43.280635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71773d71-9081-4ade-8e1c-b7f8f54de604 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:43.346557 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd149c1b-6c75-453e-bf9c-5e904162b103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:43.347605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd149c1b-6c75-453e-bf9c-5e904162b103 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:43.348069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd149c1b-6c75-453e-bf9c-5e904162b103 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:43.348550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd149c1b-6c75-453e-bf9c-5e904162b103 None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:43.350605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd149c1b-6c75-453e-bf9c-5e904162b103 None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:43.353368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd149c1b-6c75-453e-bf9c-5e904162b103 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:43.357488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 75/147] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:43 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:43.366991 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c92dd-56c7-43ff-be09-792892d62878 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:43.624555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c92dd-56c7-43ff-be09-792892d62878 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:43.689465 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:43.703934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe534b6-ad11-443c-b750-b20696a57cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:43.705421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe534b6-ad11-443c-b750-b20696a57cf2 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:43.705907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe534b6-ad11-443c-b750-b20696a57cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:43.706384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe534b6-ad11-443c-b750-b20696a57cf2 None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f/users/cbaf5a1d211147f8832ee30a1f8bfba5/roles/fa4637a31390472a99f691c8c7f995e8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:43.710181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe534b6-ad11-443c-b750-b20696a57cf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f6eedc7ec584320b4fdd810045aef8f, user_id=cbaf5a1d211147f8832ee30a1f8bfba5, role_id=fa4637a31390472a99f691c8c7f995e8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:43.713325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe534b6-ad11-443c-b750-b20696a57cf2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:43.748119 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 73/148] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:07:43 2022] PUT /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f/users/cbaf5a1d211147f8832ee30a1f8bfba5/roles/fa4637a31390472a99f691c8c7f995e8 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:07:45.115835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db97bd-1683-434f-bb1e-e3d917d86ff0 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:45.117381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db97bd-1683-434f-bb1e-e3d917d86ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:45.118152 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db97bd-1683-434f-bb1e-e3d917d86ff0 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:45.121567 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 76/149] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:45.128382 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03336-2e53-4d5a-9300-70b710f877b0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:45.129406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03336-2e53-4d5a-9300-70b710f877b0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:45.130172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03336-2e53-4d5a-9300-70b710f877b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:45.171171 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4da03336-2e53-4d5a-9300-70b710f877b0 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:45.173573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4da03336-2e53-4d5a-9300-70b710f877b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:45.326983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 74/150] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:45.927555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db97bd-1683-434f-bb1e-e3d917d86ff0 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:46.090059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfec32-d7e8-4295-a099-1195d59ca99a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:46.090548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfec32-d7e8-4295-a099-1195d59ca99a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:46.090894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfec32-d7e8-4295-a099-1195d59ca99a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:46.093158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 75/151] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:46.102479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb807f1-9e33-4e34-90f3-6cc8c0138c16 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:46.102905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb807f1-9e33-4e34-90f3-6cc8c0138c16 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:46.103315 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb807f1-9e33-4e34-90f3-6cc8c0138c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:46.161068 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-feb807f1-9e33-4e34-90f3-6cc8c0138c16 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:46.171318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-feb807f1-9e33-4e34-90f3-6cc8c0138c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:46.227656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db97bd-1683-434f-bb1e-e3d917d86ff0 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:46.279818 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:46.318320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be199c-128b-45ad-8c80-9b7ec4e0d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:46.319698 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be199c-128b-45ad-8c80-9b7ec4e0d231 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:46.320414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be199c-128b-45ad-8c80-9b7ec4e0d231 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:46.321164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be199c-128b-45ad-8c80-9b7ec4e0d231 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:46.352199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be199c-128b-45ad-8c80-9b7ec4e0d231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-42be199c-128b-45ad-8c80-9b7ec4e0d231 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:46.367585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:46.373467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:46.375283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:46.375283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:46.375283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:46.375283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:46.375283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:46.375283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:46.375283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:46.375283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:46.375283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:46.375283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:46.375283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:07:46.375283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:07:46.377318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 76/152] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:07:46.379822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 77/153] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 453 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:46.390128 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb807f1-9e33-4e34-90f3-6cc8c0138c16 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:46.553963 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:46.643030 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb807f1-9e33-4e34-90f3-6cc8c0138c16 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:46.717143 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99017524-4a3a-4b44-998f-0ef19abed8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:46.718140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99017524-4a3a-4b44-998f-0ef19abed8fa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:46.718623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99017524-4a3a-4b44-998f-0ef19abed8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:46.719086 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99017524-4a3a-4b44-998f-0ef19abed8fa None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:46.720273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99017524-4a3a-4b44-998f-0ef19abed8fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:46.720850 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99017524-4a3a-4b44-998f-0ef19abed8fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:46.723457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99017524-4a3a-4b44-998f-0ef19abed8fa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:46.741693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 77/154] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:07:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:46.750556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be199c-128b-45ad-8c80-9b7ec4e0d231 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:46.920370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be199c-128b-45ad-8c80-9b7ec4e0d231 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:46.958148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970d8c8-fd1a-4c71-8408-9c44d30fb781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:46.959172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d8c8-fd1a-4c71-8408-9c44d30fb781 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:46.959674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d8c8-fd1a-4c71-8408-9c44d30fb781 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:46.960139 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d8c8-fd1a-4c71-8408-9c44d30fb781 None admin] PATH_INFO: `/v3/users/de5b926665fc4538a717ef556ffe0d72` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:46.961561 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970d8c8-fd1a-4c71-8408-9c44d30fb781 None admin] RBAC: Authorizing `identity:get_user(user_id=de5b926665fc4538a717ef556ffe0d72)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:46.964030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970d8c8-fd1a-4c71-8408-9c44d30fb781 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:46.966251 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 78/155] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:46 2022] GET /identity/v3/users/de5b926665fc4538a717ef556ffe0d72 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:46.974086 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99017524-4a3a-4b44-998f-0ef19abed8fa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:47.010146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63391b1b-5c34-4942-acb1-8e8d4b8f82b7 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:47.010794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63391b1b-5c34-4942-acb1-8e8d4b8f82b7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:47.011273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63391b1b-5c34-4942-acb1-8e8d4b8f82b7 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:47.013126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 79/156] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:07:47.021494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b868a54-8040-4b42-a8fc-11cb9b4fdd53 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:47.022109 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b868a54-8040-4b42-a8fc-11cb9b4fdd53 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:47.022577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b868a54-8040-4b42-a8fc-11cb9b4fdd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:47.048129 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1b868a54-8040-4b42-a8fc-11cb9b4fdd53 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:47.049732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1b868a54-8040-4b42-a8fc-11cb9b4fdd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:47.165176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:47.188789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99017524-4a3a-4b44-998f-0ef19abed8fa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:47.213853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 80/157] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:07:47.215762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:47.254241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921d113-cad5-41e2-8170-344520b5685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:47.254926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921d113-cad5-41e2-8170-344520b5685e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:47.255205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921d113-cad5-41e2-8170-344520b5685e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:47.255469 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921d113-cad5-41e2-8170-344520b5685e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:47.352111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921d113-cad5-41e2-8170-344520b5685e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:47.354243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921d113-cad5-41e2-8170-344520b5685e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:47.491925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 78/158] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:07:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:07:47.498746 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b868a54-8040-4b42-a8fc-11cb9b4fdd53 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:47.557507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921d113-cad5-41e2-8170-344520b5685e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:47.597913 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:47.715908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b868a54-8040-4b42-a8fc-11cb9b4fdd53 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:47.759232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921d113-cad5-41e2-8170-344520b5685e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:47.783913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2912a-b900-491c-b7ba-b65df046f6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:47.789124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2912a-b900-491c-b7ba-b65df046f6eb None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:47.789750 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2912a-b900-491c-b7ba-b65df046f6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:47.790223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2912a-b900-491c-b7ba-b65df046f6eb None admin] PATH_INFO: `/v3/projects/d888fc16a8ba4a7eb5747166a04ff7e9` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:47.791826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2912a-b900-491c-b7ba-b65df046f6eb None admin] RBAC: Authorizing `identity:get_project(project_id=d888fc16a8ba4a7eb5747166a04ff7e9)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:47.793728 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2912a-b900-491c-b7ba-b65df046f6eb None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:47.796014 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 81/159] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:47 2022] GET /identity/v3/projects/d888fc16a8ba4a7eb5747166a04ff7e9 => generated 312 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:47.801622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a100a-3a7e-47d7-9264-e1b7d4d2f2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:47.802290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a100a-3a7e-47d7-9264-e1b7d4d2f2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:47.802567 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a100a-3a7e-47d7-9264-e1b7d4d2f2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:47.802831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a100a-3a7e-47d7-9264-e1b7d4d2f2a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:47.805480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2912a-b900-491c-b7ba-b65df046f6eb None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:47.817703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a100a-3a7e-47d7-9264-e1b7d4d2f2a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-854a100a-3a7e-47d7-9264-e1b7d4d2f2a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:47.830216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:47.831185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:47.831983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:47.831983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:47.831983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:47.831983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:47.831983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:47.831983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:47.831983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:47.831983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:47.831983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:47.831983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:47.831983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:07:47.831983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:07:47.831983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 79/160] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:07:47.844812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a100a-3a7e-47d7-9264-e1b7d4d2f2a8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:47.913094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:47.999608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2912a-b900-491c-b7ba-b65df046f6eb None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:48.060306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6cdea-4594-4769-8483-776f03103c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:48.061182 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6cdea-4594-4769-8483-776f03103c55 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:48.061464 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6cdea-4594-4769-8483-776f03103c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:48.061733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6cdea-4594-4769-8483-776f03103c55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:48.062820 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6cdea-4594-4769-8483-776f03103c55 None admin] RBAC: Adding query filter params (role.id=e43d5cbe01fb477f98fbe79db2fd2e5c, scope.project.id=d888fc16a8ba4a7eb5747166a04ff7e9, user.id=de5b926665fc4538a717ef556ffe0d72) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:48.063127 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6cdea-4594-4769-8483-776f03103c55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:48.064803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6cdea-4594-4769-8483-776f03103c55 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:48.075828 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 82/161] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:07:47 2022] GET /identity/v3/role_assignments?user.id=de5b926665fc4538a717ef556ffe0d72&scope.project.id=d888fc16a8ba4a7eb5747166a04ff7e9&role.id=e43d5cbe01fb477f98fbe79db2fd2e5c => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:48.076719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6cdea-4594-4769-8483-776f03103c55 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:48.083217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:48.179603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a100a-3a7e-47d7-9264-e1b7d4d2f2a8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:48.258861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6cdea-4594-4769-8483-776f03103c55 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:48.277636 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8c62e-6dac-42af-85e7-fafde5d3e809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:48.278316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8c62e-6dac-42af-85e7-fafde5d3e809 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:48.278538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8c62e-6dac-42af-85e7-fafde5d3e809 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:48.278804 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8c62e-6dac-42af-85e7-fafde5d3e809 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:48.279493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8c62e-6dac-42af-85e7-fafde5d3e809 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:48.279796 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8c62e-6dac-42af-85e7-fafde5d3e809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:48.281268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8c62e-6dac-42af-85e7-fafde5d3e809 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:48.297075 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:48.297586 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 80/162] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:07:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:48.305595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8c62e-6dac-42af-85e7-fafde5d3e809 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:48.360153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f8b52-953e-4371-8a09-7e1acbf837dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:48.361220 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f8b52-953e-4371-8a09-7e1acbf837dd None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:48.361505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f8b52-953e-4371-8a09-7e1acbf837dd None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:48.361776 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f8b52-953e-4371-8a09-7e1acbf837dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:48.389835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f8b52-953e-4371-8a09-7e1acbf837dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-0c5f8b52-953e-4371-8a09-7e1acbf837dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:48.396381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:48.397656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:48.398788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:48.398788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:48.398788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:48.398788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:48.398788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:48.398788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:48.398788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:48.398788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:48.398788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:48.398788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:48.398788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:07:48.398788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:07:48.398788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 83/163] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:07:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:48.406957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f8b52-953e-4371-8a09-7e1acbf837dd None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:48.571508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8c62e-6dac-42af-85e7-fafde5d3e809 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:48.580775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f8b52-953e-4371-8a09-7e1acbf837dd None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:48.681315 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90596c2a-4fcf-4ccc-9e7d-bf738353148e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:48.682585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90596c2a-4fcf-4ccc-9e7d-bf738353148e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:48.682864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90596c2a-4fcf-4ccc-9e7d-bf738353148e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:48.683247 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90596c2a-4fcf-4ccc-9e7d-bf738353148e None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:48.684317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90596c2a-4fcf-4ccc-9e7d-bf738353148e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:48.684844 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90596c2a-4fcf-4ccc-9e7d-bf738353148e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:48.687582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90596c2a-4fcf-4ccc-9e7d-bf738353148e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:48.690675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0c99f-d079-42e1-b29c-c875ff29cd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:48.691624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0c99f-d079-42e1-b29c-c875ff29cd54 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:48.692106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0c99f-d079-42e1-b29c-c875ff29cd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:48.692604 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0c99f-d079-42e1-b29c-c875ff29cd54 None admin] PATH_INFO: `/v3/users/de5b926665fc4538a717ef556ffe0d72` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:48.697765 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0c99f-d079-42e1-b29c-c875ff29cd54 None admin] RBAC: Authorizing `identity:get_user(user_id=de5b926665fc4538a717ef556ffe0d72)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:48.699751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0c99f-d079-42e1-b29c-c875ff29cd54 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:48.701719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 81/164] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:48 2022] GET /identity/v3/users/de5b926665fc4538a717ef556ffe0d72 => generated 275 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:48.703559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74632ac5-5685-482b-8de8-7e26f35d86c7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:48.704083 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74632ac5-5685-482b-8de8-7e26f35d86c7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:48.704564 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74632ac5-5685-482b-8de8-7e26f35d86c7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:48.706368 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 82/165] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:48.709319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 84/166] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:07:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:48.711015 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74632ac5-5685-482b-8de8-7e26f35d86c7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:48.711510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f5ace-e7ea-4bc8-b880-0edca97d0be6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:48.711816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f5ace-e7ea-4bc8-b880-0edca97d0be6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:48.712173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f5ace-e7ea-4bc8-b880-0edca97d0be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:48.721597 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:48.743043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-467f5ace-e7ea-4bc8-b880-0edca97d0be6 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:48.746730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-467f5ace-e7ea-4bc8-b880-0edca97d0be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:48.799674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:48.883295 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 85/167] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:07:48.884581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f5ace-e7ea-4bc8-b880-0edca97d0be6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:48.931345 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74632ac5-5685-482b-8de8-7e26f35d86c7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:49.009005 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9da50-3b53-4f7a-a2c6-2973168d5990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:49.012612 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9da50-3b53-4f7a-a2c6-2973168d5990 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:49.012933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9da50-3b53-4f7a-a2c6-2973168d5990 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:49.013194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9da50-3b53-4f7a-a2c6-2973168d5990 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:49.132073 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f5ace-e7ea-4bc8-b880-0edca97d0be6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:49.203874 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9da50-3b53-4f7a-a2c6-2973168d5990 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:49.210481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9da50-3b53-4f7a-a2c6-2973168d5990 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:49.220866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:49.232544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef59d0b-85b9-4c09-844f-20e4b85f3f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:49.233234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef59d0b-85b9-4c09-844f-20e4b85f3f8e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:49.233515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef59d0b-85b9-4c09-844f-20e4b85f3f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:49.233785 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef59d0b-85b9-4c09-844f-20e4b85f3f8e None admin] PATH_INFO: `/v3/users/de5b926665fc4538a717ef556ffe0d72` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:49.235108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef59d0b-85b9-4c09-844f-20e4b85f3f8e None admin] RBAC: Authorizing `identity:get_user(user_id=de5b926665fc4538a717ef556ffe0d72)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:49.236588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef59d0b-85b9-4c09-844f-20e4b85f3f8e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:49.240055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 86/168] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:48 2022] GET /identity/v3/users/de5b926665fc4538a717ef556ffe0d72 => generated 275 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:49.246542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a4f60-4d2d-4bd2-bf6d-08156bfbe6e9 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:49.246871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a4f60-4d2d-4bd2-bf6d-08156bfbe6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:49.247099 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a4f60-4d2d-4bd2-bf6d-08156bfbe6e9 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:49.248505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 87/169] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:49.254579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a4f60-4d2d-4bd2-bf6d-08156bfbe6e9 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:49.351294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:49.435946 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 83/170] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:07:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:07:49.437853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b372d1-5bc0-44dc-8dbf-ad13636db814 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:49.438269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b372d1-5bc0-44dc-8dbf-ad13636db814 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:49.438732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b372d1-5bc0-44dc-8dbf-ad13636db814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:49.458044 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a4f60-4d2d-4bd2-bf6d-08156bfbe6e9 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:49.469532 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-71b372d1-5bc0-44dc-8dbf-ad13636db814 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:49.471603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-71b372d1-5bc0-44dc-8dbf-ad13636db814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:49.506498 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65470e3-2cd4-46fb-a8de-c4360f2403b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:49.507131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65470e3-2cd4-46fb-a8de-c4360f2403b6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:49.507409 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65470e3-2cd4-46fb-a8de-c4360f2403b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:49.507678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65470e3-2cd4-46fb-a8de-c4360f2403b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:49.590326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 84/171] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:49.592548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c7961-87a5-425e-81b2-64ed715dc5b6 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:49.593072 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c7961-87a5-425e-81b2-64ed715dc5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:49.593517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c7961-87a5-425e-81b2-64ed715dc5b6 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:49.596887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 85/172] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:49.599033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa124a-ad30-4e56-896d-19aa3eab7296 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:49.599533 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa124a-ad30-4e56-896d-19aa3eab7296 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:49.600018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa124a-ad30-4e56-896d-19aa3eab7296 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:49.605975 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 86/173] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:49.607557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa124a-ad30-4e56-896d-19aa3eab7296 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:49.613651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65470e3-2cd4-46fb-a8de-c4360f2403b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:49.616819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65470e3-2cd4-46fb-a8de-c4360f2403b6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:49.678458 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:49.679362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:49.824539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa124a-ad30-4e56-896d-19aa3eab7296 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:49.851239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 88/174] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:07:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:07:49.852938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65470e3-2cd4-46fb-a8de-c4360f2403b6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:49.893145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47597ae-ca52-499a-9bd5-b6e4a863f008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:49.894155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47597ae-ca52-499a-9bd5-b6e4a863f008 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:49.894614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47597ae-ca52-499a-9bd5-b6e4a863f008 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:49.895081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47597ae-ca52-499a-9bd5-b6e4a863f008 None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:49.897168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47597ae-ca52-499a-9bd5-b6e4a863f008 None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:49.899840 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47597ae-ca52-499a-9bd5-b6e4a863f008 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:49.903572 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 87/175] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:49 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:49.905767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9c4bd-ed6c-4cc4-8437-f6f47de1a505 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:49.906283 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9c4bd-ed6c-4cc4-8437-f6f47de1a505 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:49.906749 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9c4bd-ed6c-4cc4-8437-f6f47de1a505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:49.937031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-afa9c4bd-ed6c-4cc4-8437-f6f47de1a505 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:49.939106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-afa9c4bd-ed6c-4cc4-8437-f6f47de1a505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:49.981619 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65470e3-2cd4-46fb-a8de-c4360f2403b6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:50.022141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678655f-7d69-44b4-a8ca-1d2ccc3debf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:50.022791 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678655f-7d69-44b4-a8ca-1d2ccc3debf8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:50.023067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678655f-7d69-44b4-a8ca-1d2ccc3debf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:50.023343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678655f-7d69-44b4-a8ca-1d2ccc3debf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:50.026132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:50.036409 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678655f-7d69-44b4-a8ca-1d2ccc3debf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-f678655f-7d69-44b4-a8ca-1d2ccc3debf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:50.041594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:50.042530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:50.043343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:50.043343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:50.043343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:50.043343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:50.043343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:50.043343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:50.043343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:50.043343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:50.043343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:50.043343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:50.043343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:50.043343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:07:50.043343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 89/176] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:07:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:50.044031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb19006-c87d-4e5f-8a76-34950ebb68df None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:50.045355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb19006-c87d-4e5f-8a76-34950ebb68df None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:50.045355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb19006-c87d-4e5f-8a76-34950ebb68df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:50.055381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 88/177] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:50.057240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530d926-f171-4b2a-8f81-c7e43210d794 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:50.057503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530d926-f171-4b2a-8f81-c7e43210d794 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:50.057778 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530d926-f171-4b2a-8f81-c7e43210d794 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:50.059111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 89/178] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:50.064211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530d926-f171-4b2a-8f81-c7e43210d794 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:50.074515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-6cb19006-c87d-4e5f-8a76-34950ebb68df None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:50.076611 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6cb19006-c87d-4e5f-8a76-34950ebb68df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:50.105689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:50.213179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 90/179] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:50.214831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb19006-c87d-4e5f-8a76-34950ebb68df None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:50.224785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530d926-f171-4b2a-8f81-c7e43210d794 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:50.317029 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3ef92-e197-4ac9-91f9-dd62b2d1e20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:50.318587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3ef92-e197-4ac9-91f9-dd62b2d1e20a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:50.320412 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3ef92-e197-4ac9-91f9-dd62b2d1e20a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:50.321356 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3ef92-e197-4ac9-91f9-dd62b2d1e20a None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:50.323874 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3ef92-e197-4ac9-91f9-dd62b2d1e20a None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:50.328899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3ef92-e197-4ac9-91f9-dd62b2d1e20a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:50.332900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 90/180] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:50 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:50.334318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3ef92-e197-4ac9-91f9-dd62b2d1e20a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:50.358809 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb19006-c87d-4e5f-8a76-34950ebb68df None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:50.388550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:50.402218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc61d16-559c-481c-9956-38c0e5c2dd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:50.402883 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61d16-559c-481c-9956-38c0e5c2dd08 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:50.403162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61d16-559c-481c-9956-38c0e5c2dd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:50.403430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61d16-559c-481c-9956-38c0e5c2dd08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:50.415981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc61d16-559c-481c-9956-38c0e5c2dd08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-9bc61d16-559c-481c-9956-38c0e5c2dd08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:50.421114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:50.422725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:50.424387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:50.424387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:50.424387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:50.424387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:50.424387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:50.424387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:50.424387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:50.424387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:50.424387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:50.424387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:50.424387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:50.424387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:07:50.424387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 91/181] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:07:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:50.424387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc61d16-559c-481c-9956-38c0e5c2dd08 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:50.501781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:50.504974 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3ef92-e197-4ac9-91f9-dd62b2d1e20a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:50.560071 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1ff1e-9210-4740-b65c-eaef7426804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:50.561043 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1ff1e-9210-4740-b65c-eaef7426804e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:50.561317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1ff1e-9210-4740-b65c-eaef7426804e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:50.561579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1ff1e-9210-4740-b65c-eaef7426804e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:50.562322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1ff1e-9210-4740-b65c-eaef7426804e None admin] RBAC: Adding query filter params (role.id=e43d5cbe01fb477f98fbe79db2fd2e5c, scope.project.id=0f6eedc7ec584320b4fdd810045aef8f, user.id=de5b926665fc4538a717ef556ffe0d72) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:50.562627 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1ff1e-9210-4740-b65c-eaef7426804e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:50.564419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1ff1e-9210-4740-b65c-eaef7426804e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:50.576840 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 91/182] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:07:50 2022] GET /identity/v3/role_assignments?user.id=de5b926665fc4538a717ef556ffe0d72&scope.project.id=0f6eedc7ec584320b4fdd810045aef8f&role.id=e43d5cbe01fb477f98fbe79db2fd2e5c => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:50.576840 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8591d-65df-4aaf-9cb5-618427037dac None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:50.576840 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8591d-65df-4aaf-9cb5-618427037dac None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:50.577203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc61d16-559c-481c-9956-38c0e5c2dd08 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:50.577325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8591d-65df-4aaf-9cb5-618427037dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:50.609384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f3d8591d-65df-4aaf-9cb5-618427037dac None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:50.611981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3d8591d-65df-4aaf-9cb5-618427037dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:50.625934 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5364b03-cc27-4b2b-8458-c4858db5e9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:50.626626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5364b03-cc27-4b2b-8458-c4858db5e9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:50.626842 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5364b03-cc27-4b2b-8458-c4858db5e9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:50.627115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5364b03-cc27-4b2b-8458-c4858db5e9f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:50.627977 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5364b03-cc27-4b2b-8458-c4858db5e9f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:50.628290 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5364b03-cc27-4b2b-8458-c4858db5e9f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:50.629953 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5364b03-cc27-4b2b-8458-c4858db5e9f6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:50.642120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 92/183] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:50.643090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5364b03-cc27-4b2b-8458-c4858db5e9f6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:50.723648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 92/184] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:50.724577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8591d-65df-4aaf-9cb5-618427037dac None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:50.727815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:50.810128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5364b03-cc27-4b2b-8458-c4858db5e9f6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:50.860385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b40fea-f8cc-4520-a198-6b0e085370f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:50.860959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b40fea-f8cc-4520-a198-6b0e085370f4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:50.861317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b40fea-f8cc-4520-a198-6b0e085370f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:50.861592 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b40fea-f8cc-4520-a198-6b0e085370f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:50.873939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b40fea-f8cc-4520-a198-6b0e085370f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-39b40fea-f8cc-4520-a198-6b0e085370f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:50.882392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:50.884037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:50.886215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:50.886215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:50.886215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:50.886215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:50.886215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:50.886215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:50.886215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:50.886215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:50.886215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:50.886215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:50.886215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:07:50.886215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:07:50.886215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 93/185] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:07:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:50.886215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b40fea-f8cc-4520-a198-6b0e085370f4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:50.889209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:50.893923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8591d-65df-4aaf-9cb5-618427037dac None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:50.955806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45efd-3229-448d-b264-8d181efaafdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:50.956478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45efd-3229-448d-b264-8d181efaafdc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:50.956761 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45efd-3229-448d-b264-8d181efaafdc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:50.957033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45efd-3229-448d-b264-8d181efaafdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:50.957759 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd45efd-3229-448d-b264-8d181efaafdc None admin] RBAC: Adding query filter params (role.id=fdf188800dba4eee980df53694a7ed69, scope.project.id=0f6eedc7ec584320b4fdd810045aef8f, user.id=de5b926665fc4538a717ef556ffe0d72) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:50.958067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd45efd-3229-448d-b264-8d181efaafdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:50.959561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd45efd-3229-448d-b264-8d181efaafdc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:50.966288 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 93/186] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:07:50 2022] GET /identity/v3/role_assignments?user.id=de5b926665fc4538a717ef556ffe0d72&scope.project.id=0f6eedc7ec584320b4fdd810045aef8f&role.id=fdf188800dba4eee980df53694a7ed69 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:50.967158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45efd-3229-448d-b264-8d181efaafdc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:51.052186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b40fea-f8cc-4520-a198-6b0e085370f4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:51.067454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:51.100500 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45efd-3229-448d-b264-8d181efaafdc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:51.123123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd152c-0747-4f8d-b21e-e6e51b095ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:51.124445 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd152c-0747-4f8d-b21e-e6e51b095ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:51.124771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd152c-0747-4f8d-b21e-e6e51b095ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:51.125282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd152c-0747-4f8d-b21e-e6e51b095ec5 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:51.126634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd152c-0747-4f8d-b21e-e6e51b095ec5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:51.127201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd152c-0747-4f8d-b21e-e6e51b095ec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:51.130019 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd152c-0747-4f8d-b21e-e6e51b095ec5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:51.141468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb870d4d-6121-404a-b457-a1743d2fafcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:51.142130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb870d4d-6121-404a-b457-a1743d2fafcb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:51.142406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb870d4d-6121-404a-b457-a1743d2fafcb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:51.142674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb870d4d-6121-404a-b457-a1743d2fafcb None admin] PATH_INFO: `/v3/users/40395749310542bc824e993a4d655097` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:51.143901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb870d4d-6121-404a-b457-a1743d2fafcb None admin] RBAC: Authorizing `identity:get_user(user_id=40395749310542bc824e993a4d655097)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:51.145402 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb870d4d-6121-404a-b457-a1743d2fafcb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:51.152737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 94/187] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:51.152919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 94/188] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:50 2022] GET /identity/v3/users/40395749310542bc824e993a4d655097 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:51.152919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb870d4d-6121-404a-b457-a1743d2fafcb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:51.157133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd152c-0747-4f8d-b21e-e6e51b095ec5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:51.188873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:51.290608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd152c-0747-4f8d-b21e-e6e51b095ec5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:51.318736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb870d4d-6121-404a-b457-a1743d2fafcb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:51.329639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262876f-2d7b-4b76-98ae-e3e9fd33e557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:51.330301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262876f-2d7b-4b76-98ae-e3e9fd33e557 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:51.330576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262876f-2d7b-4b76-98ae-e3e9fd33e557 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:51.330839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262876f-2d7b-4b76-98ae-e3e9fd33e557 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:51.331514 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262876f-2d7b-4b76-98ae-e3e9fd33e557 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:51.331815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262876f-2d7b-4b76-98ae-e3e9fd33e557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:51.333285 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262876f-2d7b-4b76-98ae-e3e9fd33e557 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:51.343030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 95/189] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:07:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:51.343919 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262876f-2d7b-4b76-98ae-e3e9fd33e557 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:51.378070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53832b-9312-4e71-9c7c-0547f69a7f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:51.378933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53832b-9312-4e71-9c7c-0547f69a7f75 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:51.379330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53832b-9312-4e71-9c7c-0547f69a7f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:51.379659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53832b-9312-4e71-9c7c-0547f69a7f75 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:51.389079 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:51.392513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53832b-9312-4e71-9c7c-0547f69a7f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8a53832b-9312-4e71-9c7c-0547f69a7f75 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:51.398110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:51.400019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:51.402540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:51.402540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:51.402540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:51.402540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:51.402540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:51.402540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:51.402540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:51.402540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:51.402540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:51.402540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:51.402540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:07:51.402540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:07:51.402540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 95/190] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:51.402540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53832b-9312-4e71-9c7c-0547f69a7f75 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:51.517033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:51.520781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262876f-2d7b-4b76-98ae-e3e9fd33e557 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:51.542870 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53832b-9312-4e71-9c7c-0547f69a7f75 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:51.570265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889edb7-11fe-4b22-b0f9-44cb620749fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:51.571363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889edb7-11fe-4b22-b0f9-44cb620749fc None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:51.572213 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889edb7-11fe-4b22-b0f9-44cb620749fc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:51.572730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889edb7-11fe-4b22-b0f9-44cb620749fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:51.575488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889edb7-11fe-4b22-b0f9-44cb620749fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:51.578422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889edb7-11fe-4b22-b0f9-44cb620749fc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:51.581614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 96/191] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:07:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:51.583050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889edb7-11fe-4b22-b0f9-44cb620749fc None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:51.583858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb77e6-372b-401e-9e10-1b75dbc21c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:51.584678 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb77e6-372b-401e-9e10-1b75dbc21c56 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:51.585162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb77e6-372b-401e-9e10-1b75dbc21c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:51.585529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb77e6-372b-401e-9e10-1b75dbc21c56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:51.684925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb77e6-372b-401e-9e10-1b75dbc21c56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:51.686329 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb77e6-372b-401e-9e10-1b75dbc21c56 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:51.733372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:51.740540 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889edb7-11fe-4b22-b0f9-44cb620749fc None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:51.779012 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:51.800707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481842f0-6896-4d37-923c-3c17bcd8084a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:51.801662 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481842f0-6896-4d37-923c-3c17bcd8084a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:51.802077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481842f0-6896-4d37-923c-3c17bcd8084a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:51.802437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 96/192] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:07:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:07:51.802529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481842f0-6896-4d37-923c-3c17bcd8084a None admin] PATH_INFO: `/v3/users/769be20b1d654226bd2392203e612d36` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:51.803314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb77e6-372b-401e-9e10-1b75dbc21c56 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:51.824141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481842f0-6896-4d37-923c-3c17bcd8084a None admin] RBAC: Authorizing `identity:get_user(user_id=769be20b1d654226bd2392203e612d36)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:51.825664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481842f0-6896-4d37-923c-3c17bcd8084a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:51.827435 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 97/193] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:51 2022] GET /identity/v3/users/769be20b1d654226bd2392203e612d36 => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:51.828281 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481842f0-6896-4d37-923c-3c17bcd8084a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:51.951487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb77e6-372b-401e-9e10-1b75dbc21c56 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:51.962656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481842f0-6896-4d37-923c-3c17bcd8084a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:51.996588 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aabc8c-9ec4-4e5c-8bf4-a3a4f23c1451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:51.997345 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aabc8c-9ec4-4e5c-8bf4-a3a4f23c1451 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:51.997866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aabc8c-9ec4-4e5c-8bf4-a3a4f23c1451 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:51.998215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aabc8c-9ec4-4e5c-8bf4-a3a4f23c1451 None admin] PATH_INFO: `/v3/users/769be20b1d654226bd2392203e612d36` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:51.999499 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aabc8c-9ec4-4e5c-8bf4-a3a4f23c1451 None admin] RBAC: Authorizing `identity:get_user(user_id=769be20b1d654226bd2392203e612d36)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:52.001074 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aabc8c-9ec4-4e5c-8bf4-a3a4f23c1451 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:52.002794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 97/194] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:51 2022] GET /identity/v3/users/769be20b1d654226bd2392203e612d36 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:52.004079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aabc8c-9ec4-4e5c-8bf4-a3a4f23c1451 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:52.028026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271ce1b-aa9e-48de-96fd-147fe75250db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:52.028763 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271ce1b-aa9e-48de-96fd-147fe75250db None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:52.029120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271ce1b-aa9e-48de-96fd-147fe75250db None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:52.029470 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271ce1b-aa9e-48de-96fd-147fe75250db None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:52.030202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271ce1b-aa9e-48de-96fd-147fe75250db None admin] RBAC: Adding query filter params (name=reader) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:52.030605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271ce1b-aa9e-48de-96fd-147fe75250db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:52.032207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271ce1b-aa9e-48de-96fd-147fe75250db None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:52.041494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 98/195] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:07:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:52.042343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271ce1b-aa9e-48de-96fd-147fe75250db None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:52.078308 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:52.096645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:52.152719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aabc8c-9ec4-4e5c-8bf4-a3a4f23c1451 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:52.195709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271ce1b-aa9e-48de-96fd-147fe75250db None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:52.202386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c1760-bfbd-4f28-9d5e-53e922e31fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:52.202990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c1760-bfbd-4f28-9d5e-53e922e31fc9 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:52.203329 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c1760-bfbd-4f28-9d5e-53e922e31fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:52.203665 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c1760-bfbd-4f28-9d5e-53e922e31fc9 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:52.204391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c1760-bfbd-4f28-9d5e-53e922e31fc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:52.206065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c1760-bfbd-4f28-9d5e-53e922e31fc9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:52.233317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 98/196] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:07:52 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:07:52.234334 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c1760-bfbd-4f28-9d5e-53e922e31fc9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:52.253455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d6a3f-7786-42bb-8be0-0422428d2dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:52.254966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6a3f-7786-42bb-8be0-0422428d2dda None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:52.255717 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6a3f-7786-42bb-8be0-0422428d2dda None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:52.256259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6a3f-7786-42bb-8be0-0422428d2dda None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:52.258474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d6a3f-7786-42bb-8be0-0422428d2dda None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:52.261747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d6a3f-7786-42bb-8be0-0422428d2dda None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:52.264752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 99/197] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:52 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:52.266302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d6a3f-7786-42bb-8be0-0422428d2dda None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:52.385890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c1760-bfbd-4f28-9d5e-53e922e31fc9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:52.391620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:52.403239 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:52.415955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d6a3f-7786-42bb-8be0-0422428d2dda None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:52.434486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c3693-c1f5-49b2-8fad-adc31b3d04e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:52.435104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c3693-c1f5-49b2-8fad-adc31b3d04e0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:52.435376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c3693-c1f5-49b2-8fad-adc31b3d04e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:52.435640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c3693-c1f5-49b2-8fad-adc31b3d04e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:52.478281 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19793c5-f157-4a80-b012-961d1b9943b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:52.479651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19793c5-f157-4a80-b012-961d1b9943b3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:52.479996 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19793c5-f157-4a80-b012-961d1b9943b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:52.480341 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19793c5-f157-4a80-b012-961d1b9943b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:52.543955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c3693-c1f5-49b2-8fad-adc31b3d04e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:52.546751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c3693-c1f5-49b2-8fad-adc31b3d04e0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:52.599464 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19793c5-f157-4a80-b012-961d1b9943b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:52.602018 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19793c5-f157-4a80-b012-961d1b9943b3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:52.681747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 99/198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:07:52.683368 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c3693-c1f5-49b2-8fad-adc31b3d04e0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:52.698703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:52.755382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:52.795320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 100/199] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:07:52.801374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19793c5-f157-4a80-b012-961d1b9943b3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:52.819791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c3693-c1f5-49b2-8fad-adc31b3d04e0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:52.883559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151321e2-9933-431f-8596-74a73a699b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:52.884381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151321e2-9933-431f-8596-74a73a699b79 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:52.884830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151321e2-9933-431f-8596-74a73a699b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:52.885205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151321e2-9933-431f-8596-74a73a699b79 None admin] PATH_INFO: `/v3/users/cbaf5a1d211147f8832ee30a1f8bfba5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:52.886817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151321e2-9933-431f-8596-74a73a699b79 None admin] RBAC: Authorizing `identity:get_user(user_id=cbaf5a1d211147f8832ee30a1f8bfba5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:52.889507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151321e2-9933-431f-8596-74a73a699b79 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:52.891780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 100/200] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:52 2022] GET /identity/v3/users/cbaf5a1d211147f8832ee30a1f8bfba5 => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:52.892872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151321e2-9933-431f-8596-74a73a699b79 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:52.996187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19793c5-f157-4a80-b012-961d1b9943b3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:53.017578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:53.046340 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8fa3-1780-47f1-adae-faa92ffbf2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:53.047483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8fa3-1780-47f1-adae-faa92ffbf2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:53.048096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8fa3-1780-47f1-adae-faa92ffbf2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:53.048580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8fa3-1780-47f1-adae-faa92ffbf2a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:53.049882 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e8fa3-1780-47f1-adae-faa92ffbf2a5 None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=0f6eedc7ec584320b4fdd810045aef8f, user.id=40395749310542bc824e993a4d655097) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:53.050454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e8fa3-1780-47f1-adae-faa92ffbf2a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:53.052950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e8fa3-1780-47f1-adae-faa92ffbf2a5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:53.055944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151321e2-9933-431f-8596-74a73a699b79 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:53.061799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 101/201] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:07:52 2022] GET /identity/v3/role_assignments?user.id=40395749310542bc824e993a4d655097&scope.project.id=0f6eedc7ec584320b4fdd810045aef8f&role.id=beec000223e041209205627bfa0dbed1 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:53.063060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8fa3-1780-47f1-adae-faa92ffbf2a5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:53.122901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfad5a-1b89-4ded-a34c-5fd693115ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:53.123819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfad5a-1b89-4ded-a34c-5fd693115ddc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:53.124322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfad5a-1b89-4ded-a34c-5fd693115ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:53.124878 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfad5a-1b89-4ded-a34c-5fd693115ddc None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:53.127012 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfad5a-1b89-4ded-a34c-5fd693115ddc None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:53.129651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfad5a-1b89-4ded-a34c-5fd693115ddc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:53.133085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 101/202] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:52 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:53.134422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfad5a-1b89-4ded-a34c-5fd693115ddc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:53.139732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:53.220645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8fa3-1780-47f1-adae-faa92ffbf2a5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:53.272994 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa16857-7780-4ec1-9a1a-0ee00770829a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:53.274391 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa16857-7780-4ec1-9a1a-0ee00770829a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:53.276221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa16857-7780-4ec1-9a1a-0ee00770829a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:53.276799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa16857-7780-4ec1-9a1a-0ee00770829a None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:53.279580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa16857-7780-4ec1-9a1a-0ee00770829a None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:53.282960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa16857-7780-4ec1-9a1a-0ee00770829a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:53.288031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 102/203] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:53 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:53.290893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa16857-7780-4ec1-9a1a-0ee00770829a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:53.364710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfad5a-1b89-4ded-a34c-5fd693115ddc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:53.421425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b0081-f272-49f5-9e48-a1817463fd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:53.422062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b0081-f272-49f5-9e48-a1817463fd3b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:53.422336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b0081-f272-49f5-9e48-a1817463fd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:53.422600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b0081-f272-49f5-9e48-a1817463fd3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:53.442519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:53.478334 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa16857-7780-4ec1-9a1a-0ee00770829a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:53.504465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:53.526198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b0081-f272-49f5-9e48-a1817463fd3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:53.528045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b0081-f272-49f5-9e48-a1817463fd3b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:53.532846 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47953c45-ae27-48dd-a2a6-0f0ec1c23f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:53.533886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47953c45-ae27-48dd-a2a6-0f0ec1c23f02 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:53.534369 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47953c45-ae27-48dd-a2a6-0f0ec1c23f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:53.534888 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47953c45-ae27-48dd-a2a6-0f0ec1c23f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:53.535867 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47953c45-ae27-48dd-a2a6-0f0ec1c23f02 None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=aa4dda00a89f4cc49309ae81cc931005, user.id=769be20b1d654226bd2392203e612d36) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:53.536389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47953c45-ae27-48dd-a2a6-0f0ec1c23f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:53.538179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47953c45-ae27-48dd-a2a6-0f0ec1c23f02 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:53.545980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 103/204] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:07:53 2022] GET /identity/v3/role_assignments?user.id=769be20b1d654226bd2392203e612d36&scope.project.id=aa4dda00a89f4cc49309ae81cc931005&role.id=beec000223e041209205627bfa0dbed1 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:53.547330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47953c45-ae27-48dd-a2a6-0f0ec1c23f02 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:53.664731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 102/205] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:07:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:07:53.673838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b0081-f272-49f5-9e48-a1817463fd3b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:53.680172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47953c45-ae27-48dd-a2a6-0f0ec1c23f02 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:53.768472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75c5e4-3bb2-4a9d-a6f4-0b3a9f6767cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:53.769545 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75c5e4-3bb2-4a9d-a6f4-0b3a9f6767cd None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:53.769927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75c5e4-3bb2-4a9d-a6f4-0b3a9f6767cd None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:53.770298 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75c5e4-3bb2-4a9d-a6f4-0b3a9f6767cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:53.776813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75c5e4-3bb2-4a9d-a6f4-0b3a9f6767cd None admin] RBAC: Adding query filter params (role.id=fdf188800dba4eee980df53694a7ed69, scope.project.id=aa4dda00a89f4cc49309ae81cc931005, user.id=769be20b1d654226bd2392203e612d36) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:53.776813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75c5e4-3bb2-4a9d-a6f4-0b3a9f6767cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:53.776813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75c5e4-3bb2-4a9d-a6f4-0b3a9f6767cd None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:53.789524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 104/206] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:07:53 2022] GET /identity/v3/role_assignments?user.id=769be20b1d654226bd2392203e612d36&scope.project.id=aa4dda00a89f4cc49309ae81cc931005&role.id=fdf188800dba4eee980df53694a7ed69 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:53.802295 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:53.889365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b0081-f272-49f5-9e48-a1817463fd3b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:53.938724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ce3fc-4e91-442c-bb27-2a89d6993ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:53.939565 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce3fc-4e91-442c-bb27-2a89d6993ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:53.939996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce3fc-4e91-442c-bb27-2a89d6993ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:53.940368 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce3fc-4e91-442c-bb27-2a89d6993ac5 None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:53.941899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ce3fc-4e91-442c-bb27-2a89d6993ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:53.943579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ce3fc-4e91-442c-bb27-2a89d6993ac5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:53.945919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 103/207] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:53 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:53.954740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75c5e4-3bb2-4a9d-a6f4-0b3a9f6767cd None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:54.071103 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:54.177574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75c5e4-3bb2-4a9d-a6f4-0b3a9f6767cd None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:54.239037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c231a-943f-4d58-945d-1895dc264caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:54.240068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c231a-943f-4d58-945d-1895dc264caa None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:54.240567 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c231a-943f-4d58-945d-1895dc264caa None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:54.241078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c231a-943f-4d58-945d-1895dc264caa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:54.242031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c231a-943f-4d58-945d-1895dc264caa None admin] RBAC: Adding query filter params (role.id=fa4637a31390472a99f691c8c7f995e8, scope.project.id=0f6eedc7ec584320b4fdd810045aef8f, user.id=cbaf5a1d211147f8832ee30a1f8bfba5) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:54.242558 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c231a-943f-4d58-945d-1895dc264caa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:54.244252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c231a-943f-4d58-945d-1895dc264caa None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:54.251660 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 105/208] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:07:53 2022] GET /identity/v3/role_assignments?user.id=cbaf5a1d211147f8832ee30a1f8bfba5&scope.project.id=0f6eedc7ec584320b4fdd810045aef8f&role.id=fa4637a31390472a99f691c8c7f995e8 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:55.609938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2e7a8-2d2e-4a47-9973-f0c5d433adab None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:55.610691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2e7a8-2d2e-4a47-9973-f0c5d433adab None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:55.610691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2e7a8-2d2e-4a47-9973-f0c5d433adab None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:55.612081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 104/209] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:55.621377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c5e43-d082-46e8-b6f9-cb3c03914217 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:55.622940 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c5e43-d082-46e8-b6f9-cb3c03914217 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:55.623699 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c5e43-d082-46e8-b6f9-cb3c03914217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:55.656619 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-225c5e43-d082-46e8-b6f9-cb3c03914217 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:55.659404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-225c5e43-d082-46e8-b6f9-cb3c03914217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:55.757960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 106/210] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:55.847097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc368f-19bc-46f9-b0cd-48d66b4fbf94 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:55.848012 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc368f-19bc-46f9-b0cd-48d66b4fbf94 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:55.848804 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc368f-19bc-46f9-b0cd-48d66b4fbf94 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:55.851728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 105/211] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:55.861407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59f0f2-38e1-4e68-86f6-d9587595cb48 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:55.861820 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59f0f2-38e1-4e68-86f6-d9587595cb48 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:55.861970 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59f0f2-38e1-4e68-86f6-d9587595cb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:55.894394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-da59f0f2-38e1-4e68-86f6-d9587595cb48 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:55.897009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-da59f0f2-38e1-4e68-86f6-d9587595cb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:55.972961 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:56.024987 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 107/212] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:56.082918 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc368f-19bc-46f9-b0cd-48d66b4fbf94 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:56.204365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc368f-19bc-46f9-b0cd-48d66b4fbf94 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:56.221488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:56.246315 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0441f-9a4c-4b77-a942-6a95269f2c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:56.247349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0441f-9a4c-4b77-a942-6a95269f2c8b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:56.247895 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0441f-9a4c-4b77-a942-6a95269f2c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:56.248366 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0441f-9a4c-4b77-a942-6a95269f2c8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:56.261142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0441f-9a4c-4b77-a942-6a95269f2c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-53b0441f-9a4c-4b77-a942-6a95269f2c8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:56.266542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:56.267453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:56.268249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:56.268249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:56.268249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:56.268249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:56.268249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:56.268249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:56.268249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:56.268249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:56.268249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:56.268249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:56.268249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:07:56.268249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:07:56.270747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 106/213] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:56.277071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59f0f2-38e1-4e68-86f6-d9587595cb48 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:56.290467 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037be69-8d5c-40ed-83e9-1d67bd01b99a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:56.290776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037be69-8d5c-40ed-83e9-1d67bd01b99a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:56.292709 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037be69-8d5c-40ed-83e9-1d67bd01b99a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:56.295905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 107/214] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:07:56.301869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96034b-4182-4423-8afd-2c011811983b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:56.302189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96034b-4182-4423-8afd-2c011811983b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:56.302411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96034b-4182-4423-8afd-2c011811983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:56.331841 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fa96034b-4182-4423-8afd-2c011811983b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:56.333201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fa96034b-4182-4423-8afd-2c011811983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:56.402289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59f0f2-38e1-4e68-86f6-d9587595cb48 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:56.437206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 108/215] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:07:56.440297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89b498-fa0d-4325-b210-81f54cc9a3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:56.441150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89b498-fa0d-4325-b210-81f54cc9a3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:56.441553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89b498-fa0d-4325-b210-81f54cc9a3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:56.441963 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89b498-fa0d-4325-b210-81f54cc9a3f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:56.442972 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89b498-fa0d-4325-b210-81f54cc9a3f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:56.443473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89b498-fa0d-4325-b210-81f54cc9a3f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:56.445099 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89b498-fa0d-4325-b210-81f54cc9a3f3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:56.455733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 108/216] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:07:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:56.464168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96034b-4182-4423-8afd-2c011811983b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:56.512133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89b498-fa0d-4325-b210-81f54cc9a3f3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:56.566523 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:56.650736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96034b-4182-4423-8afd-2c011811983b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:56.656732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:56.712456 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89b498-fa0d-4325-b210-81f54cc9a3f3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:56.720351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a8901-1919-4b08-a22e-ae4bb77b7928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:56.721823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a8901-1919-4b08-a22e-ae4bb77b7928 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:56.722729 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a8901-1919-4b08-a22e-ae4bb77b7928 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:56.723495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a8901-1919-4b08-a22e-ae4bb77b7928 None admin] PATH_INFO: `/v3/users/4c00bdc2a99444c383fa4074ec0979c0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:56.747682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a8901-1919-4b08-a22e-ae4bb77b7928 None admin] RBAC: Authorizing `identity:get_user(user_id=4c00bdc2a99444c383fa4074ec0979c0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:56.750245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a8901-1919-4b08-a22e-ae4bb77b7928 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:56.753136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 109/217] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:56 2022] GET /identity/v3/users/4c00bdc2a99444c383fa4074ec0979c0 => generated 297 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:56.757536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a8901-1919-4b08-a22e-ae4bb77b7928 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:56.779455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bdfd3-7d2f-4be3-ae14-4d2ab77f2377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:56.780457 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bdfd3-7d2f-4be3-ae14-4d2ab77f2377 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:56.780971 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bdfd3-7d2f-4be3-ae14-4d2ab77f2377 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:56.781387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bdfd3-7d2f-4be3-ae14-4d2ab77f2377 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:56.783181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bdfd3-7d2f-4be3-ae14-4d2ab77f2377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:56.785666 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bdfd3-7d2f-4be3-ae14-4d2ab77f2377 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:56.793260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 109/218] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:07:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:56.793260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bdfd3-7d2f-4be3-ae14-4d2ab77f2377 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:56.907711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a8901-1919-4b08-a22e-ae4bb77b7928 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:56.922779 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:56.927195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bdfd3-7d2f-4be3-ae14-4d2ab77f2377 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:56.953343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455ffc7-c909-4a22-9100-d5a70bad9678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:56.954007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455ffc7-c909-4a22-9100-d5a70bad9678 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:56.954287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455ffc7-c909-4a22-9100-d5a70bad9678 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:56.954561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455ffc7-c909-4a22-9100-d5a70bad9678 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:56.969232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455ffc7-c909-4a22-9100-d5a70bad9678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1455ffc7-c909-4a22-9100-d5a70bad9678 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:56.974339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:56.976147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:56.977743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:56.977743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:56.977743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:56.977743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:56.977743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:56.977743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:56.977743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:56.977743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:56.977743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:56.977743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:56.977743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:07:56.977743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:07:56.977743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 110/219] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:07:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:56.977743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455ffc7-c909-4a22-9100-d5a70bad9678 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:56.987756 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca23e2-b479-4a56-8209-cc87079ca307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:56.988664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca23e2-b479-4a56-8209-cc87079ca307 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:56.989171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca23e2-b479-4a56-8209-cc87079ca307 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:56.989668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca23e2-b479-4a56-8209-cc87079ca307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:57.013441 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:57.101519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca23e2-b479-4a56-8209-cc87079ca307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:57.103002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca23e2-b479-4a56-8209-cc87079ca307 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:57.125455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455ffc7-c909-4a22-9100-d5a70bad9678 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:57.178319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08877af-6d3e-4958-a2df-a487a3c7fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:57.179032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08877af-6d3e-4958-a2df-a487a3c7fa3e None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:57.179309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08877af-6d3e-4958-a2df-a487a3c7fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:57.179576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08877af-6d3e-4958-a2df-a487a3c7fa3e None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:57.180278 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08877af-6d3e-4958-a2df-a487a3c7fa3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:57.182387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08877af-6d3e-4958-a2df-a487a3c7fa3e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:57.207726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 111/220] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:07:56 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:07:57.208374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08877af-6d3e-4958-a2df-a487a3c7fa3e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:57.257950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:57.263383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 110/221] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:07:57.265692 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40982e-52b0-4b21-8cb7-085bcff4f021 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:57.266658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40982e-52b0-4b21-8cb7-085bcff4f021 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:57.267349 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40982e-52b0-4b21-8cb7-085bcff4f021 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:57.272772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 111/222] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:07:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:07:57.272772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40982e-52b0-4b21-8cb7-085bcff4f021 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:57.333660 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:57.368676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08877af-6d3e-4958-a2df-a487a3c7fa3e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:57.425249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe9c6f-5d24-4ce7-933b-3ebc67feeee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:57.425878 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe9c6f-5d24-4ce7-933b-3ebc67feeee0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:57.426151 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe9c6f-5d24-4ce7-933b-3ebc67feeee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:57.426415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe9c6f-5d24-4ce7-933b-3ebc67feeee0 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:57.429488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe9c6f-5d24-4ce7-933b-3ebc67feeee0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:57.429488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe9c6f-5d24-4ce7-933b-3ebc67feeee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:57.429488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe9c6f-5d24-4ce7-933b-3ebc67feeee0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:57.432963 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40982e-52b0-4b21-8cb7-085bcff4f021 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:57.439174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 112/223] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:07:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:57.440438 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983baf07-bf70-4860-bab9-537a44c7b4f1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:57.448470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983baf07-bf70-4860-bab9-537a44c7b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:57.448470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983baf07-bf70-4860-bab9-537a44c7b4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:57.472444 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-983baf07-bf70-4860-bab9-537a44c7b4f1 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:07:57.474190 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-983baf07-bf70-4860-bab9-537a44c7b4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:07:57.492173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daef59-da0a-4b4e-a63c-46b8888296bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:57.492958 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daef59-da0a-4b4e-a63c-46b8888296bb None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:57.493242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daef59-da0a-4b4e-a63c-46b8888296bb None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:57.493542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daef59-da0a-4b4e-a63c-46b8888296bb None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:57.494789 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76daef59-da0a-4b4e-a63c-46b8888296bb None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:57.496249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76daef59-da0a-4b4e-a63c-46b8888296bb None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:57.498506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 112/224] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:57 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:57.498926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daef59-da0a-4b4e-a63c-46b8888296bb None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:57.590644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 113/225] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:07:57.590888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983baf07-bf70-4860-bab9-537a44c7b4f1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:57.641078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:57.708167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daef59-da0a-4b4e-a63c-46b8888296bb None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:57.717184 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:57.780977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983baf07-bf70-4860-bab9-537a44c7b4f1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:57.782496 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681684a4-889b-4a7d-9af0-beedc87590a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:57.783614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681684a4-889b-4a7d-9af0-beedc87590a5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:57.784174 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681684a4-889b-4a7d-9af0-beedc87590a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:57.784766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681684a4-889b-4a7d-9af0-beedc87590a5 None admin] PATH_INFO: `/v3/users/769be20b1d654226bd2392203e612d36` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:57.788236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681684a4-889b-4a7d-9af0-beedc87590a5 None admin] RBAC: Authorizing `identity:get_user(user_id=769be20b1d654226bd2392203e612d36)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:57.790903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681684a4-889b-4a7d-9af0-beedc87590a5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:57.798231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 113/226] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:57 2022] GET /identity/v3/users/769be20b1d654226bd2392203e612d36 => generated 283 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:57.811733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681684a4-889b-4a7d-9af0-beedc87590a5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:57.888651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acacfa-143f-4335-a640-824224fac1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:57.889328 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acacfa-143f-4335-a640-824224fac1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:57.889603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acacfa-143f-4335-a640-824224fac1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:57.889872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acacfa-143f-4335-a640-824224fac1f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:57.890618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acacfa-143f-4335-a640-824224fac1f5 None admin] RBAC: Adding query filter params (role.id=e43d5cbe01fb477f98fbe79db2fd2e5c, scope.project.id=aa4dda00a89f4cc49309ae81cc931005, user.id=4c00bdc2a99444c383fa4074ec0979c0) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:57.890924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acacfa-143f-4335-a640-824224fac1f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:57.892412 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acacfa-143f-4335-a640-824224fac1f5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:57.899587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 114/227] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:07:57 2022] GET /identity/v3/role_assignments?user.id=4c00bdc2a99444c383fa4074ec0979c0&scope.project.id=aa4dda00a89f4cc49309ae81cc931005&role.id=e43d5cbe01fb477f98fbe79db2fd2e5c => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:57.900518 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acacfa-143f-4335-a640-824224fac1f5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:58.077927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681684a4-889b-4a7d-9af0-beedc87590a5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:58.081725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acacfa-143f-4335-a640-824224fac1f5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:58.145449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815e752-fbcf-46c9-bd0f-c37f75cca876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:58.146917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815e752-fbcf-46c9-bd0f-c37f75cca876 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:58.147639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815e752-fbcf-46c9-bd0f-c37f75cca876 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:58.148353 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815e752-fbcf-46c9-bd0f-c37f75cca876 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:58.157212 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:58.162289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b3b01-ffa1-4e9f-b9ff-0b276c433953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:58.163035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b3b01-ffa1-4e9f-b9ff-0b276c433953 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:58.163377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b3b01-ffa1-4e9f-b9ff-0b276c433953 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:58.163705 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b3b01-ffa1-4e9f-b9ff-0b276c433953 None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:58.165020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b3b01-ffa1-4e9f-b9ff-0b276c433953 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:58.168240 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b3b01-ffa1-4e9f-b9ff-0b276c433953 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:58.170001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 114/228] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:57 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:07:58.186271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815e752-fbcf-46c9-bd0f-c37f75cca876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:07:58.190978 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b3b01-ffa1-4e9f-b9ff-0b276c433953 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:58.196355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0815e752-fbcf-46c9-bd0f-c37f75cca876 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:07:58.199070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:07:58.200754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:07:58.202287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:07:58.202287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:07:58.202287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:07:58.202287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:07:58.202287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:07:58.202287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:07:58.202287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:07:58.202287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:07:58.202287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:07:58.202287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:07:58.202287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:07:58.202287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:07:58.206203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 115/229] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:07:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:07:58.214367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815e752-fbcf-46c9-bd0f-c37f75cca876 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:58.449166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815e752-fbcf-46c9-bd0f-c37f75cca876 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:58.495673 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b3b01-ffa1-4e9f-b9ff-0b276c433953 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:58.527120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595382be-a738-49e3-bc23-a36f6ebbd30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:58.528173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595382be-a738-49e3-bc23-a36f6ebbd30b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:58.530386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595382be-a738-49e3-bc23-a36f6ebbd30b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:58.532847 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595382be-a738-49e3-bc23-a36f6ebbd30b None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:58.534095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595382be-a738-49e3-bc23-a36f6ebbd30b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:07:58.534635 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595382be-a738-49e3-bc23-a36f6ebbd30b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:58.537250 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595382be-a738-49e3-bc23-a36f6ebbd30b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:58.564191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 116/230] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:07:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:58.585466 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595382be-a738-49e3-bc23-a36f6ebbd30b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:58.626922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cb5e4-e4be-4142-a2a3-be1bf217e4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:58.628035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb5e4-e4be-4142-a2a3-be1bf217e4ce None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:58.628524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb5e4-e4be-4142-a2a3-be1bf217e4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:58.629039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb5e4-e4be-4142-a2a3-be1bf217e4ce None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005/users/769be20b1d654226bd2392203e612d36/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:58.631268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cb5e4-e4be-4142-a2a3-be1bf217e4ce None admin] RBAC: Authorizing `identity:create_grant(project_id=aa4dda00a89f4cc49309ae81cc931005, user_id=769be20b1d654226bd2392203e612d36, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:58.638023 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cb5e4-e4be-4142-a2a3-be1bf217e4ce None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:58.663069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 115/231] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:07:58 2022] PUT /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005/users/769be20b1d654226bd2392203e612d36/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:07:58.712255 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:58.790747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595382be-a738-49e3-bc23-a36f6ebbd30b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:58.851676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b0c56-cf97-4dae-bd79-741946ccb884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:58.852788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0c56-cf97-4dae-bd79-741946ccb884 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:58.853275 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0c56-cf97-4dae-bd79-741946ccb884 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:58.854310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0c56-cf97-4dae-bd79-741946ccb884 None admin] PATH_INFO: `/v3/users/769be20b1d654226bd2392203e612d36` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:58.861745 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b0c56-cf97-4dae-bd79-741946ccb884 None admin] RBAC: Authorizing `identity:get_user(user_id=769be20b1d654226bd2392203e612d36)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:58.864050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b0c56-cf97-4dae-bd79-741946ccb884 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:58.866917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 117/232] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:07:58 2022] GET /identity/v3/users/769be20b1d654226bd2392203e612d36 => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:58.876438 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cb5e4-e4be-4142-a2a3-be1bf217e4ce None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:58.983309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:59.033120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cb5e4-e4be-4142-a2a3-be1bf217e4ce None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:59.078234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b6bfb-7c06-4d36-beb6-b6e5fda007f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:59.078881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b6bfb-7c06-4d36-beb6-b6e5fda007f0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:59.079190 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b6bfb-7c06-4d36-beb6-b6e5fda007f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:59.079429 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b6bfb-7c06-4d36-beb6-b6e5fda007f0 None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:59.080605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b6bfb-7c06-4d36-beb6-b6e5fda007f0 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:59.082099 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b6bfb-7c06-4d36-beb6-b6e5fda007f0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:59.083758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 116/233] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:07:58 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:07:59.093478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b0c56-cf97-4dae-bd79-741946ccb884 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:07:59.302191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b0c56-cf97-4dae-bd79-741946ccb884 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:07:59.378594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:07:59.399502 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7f28d-6b6f-4611-aac6-6855800e78cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:07:59.401205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f28d-6b6f-4611-aac6-6855800e78cf None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:07:59.401673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f28d-6b6f-4611-aac6-6855800e78cf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:07:59.402132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f28d-6b6f-4611-aac6-6855800e78cf None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005/users/769be20b1d654226bd2392203e612d36/roles/fdf188800dba4eee980df53694a7ed69` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:07:59.406844 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7f28d-6b6f-4611-aac6-6855800e78cf None admin] RBAC: Authorizing `identity:create_grant(project_id=aa4dda00a89f4cc49309ae81cc931005, user_id=769be20b1d654226bd2392203e612d36, role_id=fdf188800dba4eee980df53694a7ed69)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:07:59.409831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7f28d-6b6f-4611-aac6-6855800e78cf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:07:59.435653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 118/234] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:07:59 2022] PUT /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005/users/769be20b1d654226bd2392203e612d36/roles/fdf188800dba4eee980df53694a7ed69 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:08:00.188549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdbcfc-d68f-4011-aa1f-b51d75f29455 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:00.189151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdbcfc-d68f-4011-aa1f-b51d75f29455 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:00.189151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdbcfc-d68f-4011-aa1f-b51d75f29455 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:00.190481 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 117/235] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:00.197372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c268-62b0-446a-9e73-9ce9b951afb3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:00.197866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c268-62b0-446a-9e73-9ce9b951afb3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:00.198330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c268-62b0-446a-9e73-9ce9b951afb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:00.235785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3c09c268-62b0-446a-9e73-9ce9b951afb3 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:00.237945 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3c09c268-62b0-446a-9e73-9ce9b951afb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:00.365818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 119/236] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:00.766473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160bf2e-d8b2-4ea0-bfbf-6ee83034d8df None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:00.767248 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160bf2e-d8b2-4ea0-bfbf-6ee83034d8df None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:00.767734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160bf2e-d8b2-4ea0-bfbf-6ee83034d8df None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:00.769357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 118/237] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:08:00.776592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec53e4-87a1-4b90-aa2c-6bf987876897 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:00.777122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec53e4-87a1-4b90-aa2c-6bf987876897 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:00.777619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec53e4-87a1-4b90-aa2c-6bf987876897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:00.816845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4bec53e4-87a1-4b90-aa2c-6bf987876897 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:00.818855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4bec53e4-87a1-4b90-aa2c-6bf987876897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:00.958052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 120/238] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:00.984858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160bf2e-d8b2-4ea0-bfbf-6ee83034d8df None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:01.143807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160bf2e-d8b2-4ea0-bfbf-6ee83034d8df None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:01.193478 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:01.201875 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecd130-6b8b-4b18-8e95-c5661a5e0e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:01.202446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecd130-6b8b-4b18-8e95-c5661a5e0e17 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:01.203154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecd130-6b8b-4b18-8e95-c5661a5e0e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:01.203423 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecd130-6b8b-4b18-8e95-c5661a5e0e17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:01.220920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecd130-6b8b-4b18-8e95-c5661a5e0e17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-3eecd130-6b8b-4b18-8e95-c5661a5e0e17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:01.226225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:01.227853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:01.230043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:01.230043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:01.230043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:01.230043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:01.230043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:01.230043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:01.230043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:01.230043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:01.230043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:01.230043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:01.230043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:08:01.230043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:01.230043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 119/239] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:01.235126 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec53e4-87a1-4b90-aa2c-6bf987876897 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:01.337126 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:01.408636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecd130-6b8b-4b18-8e95-c5661a5e0e17 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:01.442331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec53e4-87a1-4b90-aa2c-6bf987876897 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:01.531721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3dd47-5743-4f51-8ab8-f09e02673155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:01.532821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3dd47-5743-4f51-8ab8-f09e02673155 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:01.533328 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3dd47-5743-4f51-8ab8-f09e02673155 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:01.533824 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3dd47-5743-4f51-8ab8-f09e02673155 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:01.535162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3dd47-5743-4f51-8ab8-f09e02673155 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:01.535809 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3dd47-5743-4f51-8ab8-f09e02673155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:01.538865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3dd47-5743-4f51-8ab8-f09e02673155 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:01.555736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 121/240] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:01.558427 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afc98c-0f76-4ab5-bc87-e44b9994cd71 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:01.559499 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afc98c-0f76-4ab5-bc87-e44b9994cd71 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:01.560303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afc98c-0f76-4ab5-bc87-e44b9994cd71 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:01.571026 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 122/241] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:01.573592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afc98c-0f76-4ab5-bc87-e44b9994cd71 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:01.672367 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecd130-6b8b-4b18-8e95-c5661a5e0e17 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:01.716058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea38d6-521c-4c54-a2b4-a6a2a25f3a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:01.716739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea38d6-521c-4c54-a2b4-a6a2a25f3a6a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:01.717022 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea38d6-521c-4c54-a2b4-a6a2a25f3a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:01.717269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea38d6-521c-4c54-a2b4-a6a2a25f3a6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:01.718480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea38d6-521c-4c54-a2b4-a6a2a25f3a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:01.719959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea38d6-521c-4c54-a2b4-a6a2a25f3a6a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:01.721917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 120/242] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:01.722913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cccad-e260-41b9-bc0e-b1e01a51ed14 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:01.723215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cccad-e260-41b9-bc0e-b1e01a51ed14 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:01.723456 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cccad-e260-41b9-bc0e-b1e01a51ed14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:01.764024 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-659cccad-e260-41b9-bc0e-b1e01a51ed14 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:01.766523 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-659cccad-e260-41b9-bc0e-b1e01a51ed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:01.776731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afc98c-0f76-4ab5-bc87-e44b9994cd71 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:01.785439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:01.817481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2f393-3384-41ea-a345-e85dfb6968cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:01.818191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2f393-3384-41ea-a345-e85dfb6968cb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:01.818479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2f393-3384-41ea-a345-e85dfb6968cb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:01.818732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2f393-3384-41ea-a345-e85dfb6968cb None admin] PATH_INFO: `/v3/users/df07e97b78b64c0581aa5140d75038b2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:01.837906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2f393-3384-41ea-a345-e85dfb6968cb None admin] RBAC: Authorizing `identity:get_user(user_id=df07e97b78b64c0581aa5140d75038b2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:01.837906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2f393-3384-41ea-a345-e85dfb6968cb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:01.840050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 123/243] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:08:01 2022] GET /identity/v3/users/df07e97b78b64c0581aa5140d75038b2 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:01.840997 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2f393-3384-41ea-a345-e85dfb6968cb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:01.900780 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:01.921125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 121/244] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:01.922698 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cccad-e260-41b9-bc0e-b1e01a51ed14 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:01.988940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2f393-3384-41ea-a345-e85dfb6968cb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:02.052016 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cccad-e260-41b9-bc0e-b1e01a51ed14 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:02.062210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159ffe7-a085-46f4-9403-907dec2b34b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:02.063319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159ffe7-a085-46f4-9403-907dec2b34b8 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:02.063813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159ffe7-a085-46f4-9403-907dec2b34b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:02.064375 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159ffe7-a085-46f4-9403-907dec2b34b8 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:02.065899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159ffe7-a085-46f4-9403-907dec2b34b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:02.068813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159ffe7-a085-46f4-9403-907dec2b34b8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:02.099106 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9e832-014e-49d3-9d73-8625539adfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:02.100366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e832-014e-49d3-9d73-8625539adfd1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:02.100905 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e832-014e-49d3-9d73-8625539adfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:02.101407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e832-014e-49d3-9d73-8625539adfd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:02.111505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 124/245] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:08:01 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:08:02.114186 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001508ce-7475-45e5-921c-77e036072705 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:02.114728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001508ce-7475-45e5-921c-77e036072705 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:02.115188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001508ce-7475-45e5-921c-77e036072705 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:02.123259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 125/246] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:02.126580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6336e7-40e3-44d3-96c0-573d25536ffd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:02.127281 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6336e7-40e3-44d3-96c0-573d25536ffd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:02.127801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6336e7-40e3-44d3-96c0-573d25536ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:02.174885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-de6336e7-40e3-44d3-96c0-573d25536ffd None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:02.176994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-de6336e7-40e3-44d3-96c0-573d25536ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:02.211893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:02.221805 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:02.243563 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9e832-014e-49d3-9d73-8625539adfd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:02.246909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9e832-014e-49d3-9d73-8625539adfd1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:02.344836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 126/247] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:02.408816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 122/248] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:02.414758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6336e7-40e3-44d3-96c0-573d25536ffd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:02.434269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9e832-014e-49d3-9d73-8625539adfd1 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:02.546437 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:02.561873 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9e832-014e-49d3-9d73-8625539adfd1 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:02.612861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5719770-87d5-42fb-9e5a-861d17d0d6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:02.613695 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5719770-87d5-42fb-9e5a-861d17d0d6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:02.614069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5719770-87d5-42fb-9e5a-861d17d0d6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:02.614437 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5719770-87d5-42fb-9e5a-861d17d0d6f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:02.633681 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5719770-87d5-42fb-9e5a-861d17d0d6f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-c5719770-87d5-42fb-9e5a-861d17d0d6f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:02.638483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:02.640305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:02.641787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:02.641787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:02.641787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:02.641787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:02.641787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:02.641787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:02.641787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:02.641787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:02.641787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:02.641787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:02.641787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:02.641787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:02.641787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 123/249] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:08:02.645634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5719770-87d5-42fb-9e5a-861d17d0d6f5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:02.664146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6336e7-40e3-44d3-96c0-573d25536ffd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:02.727672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407f919-fb79-4988-a4f3-b5e05f685c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:02.729346 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407f919-fb79-4988-a4f3-b5e05f685c3a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:02.729848 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407f919-fb79-4988-a4f3-b5e05f685c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:02.731040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407f919-fb79-4988-a4f3-b5e05f685c3a None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:02.734820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407f919-fb79-4988-a4f3-b5e05f685c3a None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:02.737775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407f919-fb79-4988-a4f3-b5e05f685c3a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:02.743572 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 127/250] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:02 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:02.745193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407f919-fb79-4988-a4f3-b5e05f685c3a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:02.781994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:02.817158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5719770-87d5-42fb-9e5a-861d17d0d6f5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:02.890081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407f919-fb79-4988-a4f3-b5e05f685c3a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:02.899902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2ce56-326e-4f8c-b3a4-547fdcfa9c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:02.900997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2ce56-326e-4f8c-b3a4-547fdcfa9c15 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:02.901452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2ce56-326e-4f8c-b3a4-547fdcfa9c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:02.901910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2ce56-326e-4f8c-b3a4-547fdcfa9c15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:02.923665 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2ce56-326e-4f8c-b3a4-547fdcfa9c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-b9f2ce56-326e-4f8c-b3a4-547fdcfa9c15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:02.934553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:02.935734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:02.936758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:02.936758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:02.936758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:02.936758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:02.936758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:02.936758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:02.936758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:02.936758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:02.936758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:02.936758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:02.936758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:08:02.936758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:02.937431 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 124/251] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:08:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:02.944757 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2ce56-326e-4f8c-b3a4-547fdcfa9c15 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:02.950349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89346c-6fb7-4ee0-9820-739c3cbff871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:02.951395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89346c-6fb7-4ee0-9820-739c3cbff871 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:02.951857 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89346c-6fb7-4ee0-9820-739c3cbff871 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:02.952284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89346c-6fb7-4ee0-9820-739c3cbff871 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:02.953154 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89346c-6fb7-4ee0-9820-739c3cbff871 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:02.953633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89346c-6fb7-4ee0-9820-739c3cbff871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:02.955186 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89346c-6fb7-4ee0-9820-739c3cbff871 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:02.966247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 128/252] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:02.967469 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89346c-6fb7-4ee0-9820-739c3cbff871 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:02.976988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:03.160937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:03.213317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89346c-6fb7-4ee0-9820-739c3cbff871 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:03.220400 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2ce56-326e-4f8c-b3a4-547fdcfa9c15 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:03.283356 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698871b6-8144-4c08-946a-f59567e56a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:03.284420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698871b6-8144-4c08-946a-f59567e56a7c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:03.285092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698871b6-8144-4c08-946a-f59567e56a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:03.285577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698871b6-8144-4c08-946a-f59567e56a7c None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:03.287101 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698871b6-8144-4c08-946a-f59567e56a7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:03.287653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698871b6-8144-4c08-946a-f59567e56a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:03.290451 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698871b6-8144-4c08-946a-f59567e56a7c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:03.290812 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2829196-cb7a-40ca-81ab-3a55fe6f697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:03.292640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2829196-cb7a-40ca-81ab-3a55fe6f697e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:03.293447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2829196-cb7a-40ca-81ab-3a55fe6f697e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:03.294150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2829196-cb7a-40ca-81ab-3a55fe6f697e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:03.295717 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2829196-cb7a-40ca-81ab-3a55fe6f697e None admin] RBAC: Adding query filter params (role.id=fa4637a31390472a99f691c8c7f995e8, scope.project.id=aa4dda00a89f4cc49309ae81cc931005, user.id=df07e97b78b64c0581aa5140d75038b2) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:03.296444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2829196-cb7a-40ca-81ab-3a55fe6f697e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:03.299514 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2829196-cb7a-40ca-81ab-3a55fe6f697e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:03.308951 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 129/253] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:03.310625 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698871b6-8144-4c08-946a-f59567e56a7c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:03.312258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 125/254] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:08:02 2022] GET /identity/v3/role_assignments?user.id=df07e97b78b64c0581aa5140d75038b2&scope.project.id=aa4dda00a89f4cc49309ae81cc931005&role.id=fa4637a31390472a99f691c8c7f995e8 => generated 259 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:03.315028 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8149-98a7-4089-869e-1bfb2abae713 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:03.315918 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8149-98a7-4089-869e-1bfb2abae713 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:03.316762 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8149-98a7-4089-869e-1bfb2abae713 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:03.319986 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 126/255] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:03.321997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c8149-98a7-4089-869e-1bfb2abae713 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:03.522885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698871b6-8144-4c08-946a-f59567e56a7c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:03.539469 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:03.585939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6db4c-74e5-4d76-83dd-2fea4d0e68dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:03.587215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6db4c-74e5-4d76-83dd-2fea4d0e68dc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:03.590131 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6db4c-74e5-4d76-83dd-2fea4d0e68dc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:03.590698 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6db4c-74e5-4d76-83dd-2fea4d0e68dc None admin] PATH_INFO: `/v3/users/4c00bdc2a99444c383fa4074ec0979c0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:03.593756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6db4c-74e5-4d76-83dd-2fea4d0e68dc None admin] RBAC: Authorizing `identity:get_user(user_id=4c00bdc2a99444c383fa4074ec0979c0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:03.596013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6db4c-74e5-4d76-83dd-2fea4d0e68dc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:03.601963 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c8149-98a7-4089-869e-1bfb2abae713 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:03.602597 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 130/256] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:08:03 2022] GET /identity/v3/users/4c00bdc2a99444c383fa4074ec0979c0 => generated 297 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:03.606626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc80f12-6602-441f-a754-f28a8911eed2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:03.607204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc80f12-6602-441f-a754-f28a8911eed2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:03.608245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc80f12-6602-441f-a754-f28a8911eed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:03.640172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9bc80f12-6602-441f-a754-f28a8911eed2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:03.644735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9bc80f12-6602-441f-a754-f28a8911eed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:03.648880 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:03.704937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0375b-d002-41f3-8acf-ca395eb47f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:03.706017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0375b-d002-41f3-8acf-ca395eb47f65 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:03.706562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0375b-d002-41f3-8acf-ca395eb47f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:03.706960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0375b-d002-41f3-8acf-ca395eb47f65 None admin] PATH_INFO: `/v3/users/769be20b1d654226bd2392203e612d36` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:03.712386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0375b-d002-41f3-8acf-ca395eb47f65 None admin] RBAC: Authorizing `identity:get_user(user_id=769be20b1d654226bd2392203e612d36)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:03.715879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0375b-d002-41f3-8acf-ca395eb47f65 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:03.717890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 127/257] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:08:03 2022] GET /identity/v3/users/769be20b1d654226bd2392203e612d36 => generated 283 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:03.722312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0375b-d002-41f3-8acf-ca395eb47f65 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:03.832348 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 131/258] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:03.834100 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc80f12-6602-441f-a754-f28a8911eed2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:04.048584 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0375b-d002-41f3-8acf-ca395eb47f65 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:04.142886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cc15b-3c46-4660-85b5-33b0259f3b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:04.143538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cc15b-3c46-4660-85b5-33b0259f3b3b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:04.143824 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cc15b-3c46-4660-85b5-33b0259f3b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:04.144096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cc15b-3c46-4660-85b5-33b0259f3b3b None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:04.149531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cc15b-3c46-4660-85b5-33b0259f3b3b None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:04.151569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cc15b-3c46-4660-85b5-33b0259f3b3b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:04.153364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 128/259] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:03 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:04.162181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cc15b-3c46-4660-85b5-33b0259f3b3b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:04.183786 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:04.194600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc80f12-6602-441f-a754-f28a8911eed2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:04.271521 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69cb13-6eaf-4139-9e3c-ee857ff7da7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:04.272387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69cb13-6eaf-4139-9e3c-ee857ff7da7b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:04.272826 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69cb13-6eaf-4139-9e3c-ee857ff7da7b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:04.273223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69cb13-6eaf-4139-9e3c-ee857ff7da7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:04.294507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:04.368192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cc15b-3c46-4660-85b5-33b0259f3b3b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:04.424990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69cb13-6eaf-4139-9e3c-ee857ff7da7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:04.426472 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69cb13-6eaf-4139-9e3c-ee857ff7da7b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:04.467594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a95112-c058-4819-8281-ce1115b81a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:04.469095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a95112-c058-4819-8281-ce1115b81a05 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:04.469962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a95112-c058-4819-8281-ce1115b81a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:04.470849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a95112-c058-4819-8281-ce1115b81a05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:04.494374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a95112-c058-4819-8281-ce1115b81a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-b8a95112-c058-4819-8281-ce1115b81a05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:04.507374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:04.509111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:04.511575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:04.511575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:04.511575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:04.511575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:04.511575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:04.511575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:04.511575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:04.511575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:04.511575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:04.511575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:04.511575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:04.511575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:04.516401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 129/260] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:08:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:04.519748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a95112-c058-4819-8281-ce1115b81a05 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:04.543893 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 132/261] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:04.549234 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69cb13-6eaf-4139-9e3c-ee857ff7da7b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:04.597261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:04.669753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69cb13-6eaf-4139-9e3c-ee857ff7da7b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:04.714270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ff0dd-8f4e-4048-ba8f-614cd55bcc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:04.714270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff0dd-8f4e-4048-ba8f-614cd55bcc2f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:04.714270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff0dd-8f4e-4048-ba8f-614cd55bcc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:04.714270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff0dd-8f4e-4048-ba8f-614cd55bcc2f None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:04.714937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ff0dd-8f4e-4048-ba8f-614cd55bcc2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:04.714937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ff0dd-8f4e-4048-ba8f-614cd55bcc2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:04.714937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ff0dd-8f4e-4048-ba8f-614cd55bcc2f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:04.723846 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 133/262] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:08:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:04.729382 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ff0dd-8f4e-4048-ba8f-614cd55bcc2f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:04.793337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:04.851033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ff0dd-8f4e-4048-ba8f-614cd55bcc2f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:04.865322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:04.888477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a95112-c058-4819-8281-ce1115b81a05 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:04.894638 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bb2fb-86ad-4abb-a429-f05f9b2c5364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:04.895426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bb2fb-86ad-4abb-a429-f05f9b2c5364 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:04.895768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bb2fb-86ad-4abb-a429-f05f9b2c5364 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:04.896107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bb2fb-86ad-4abb-a429-f05f9b2c5364 None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:04.897531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bb2fb-86ad-4abb-a429-f05f9b2c5364 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:04.904432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bb2fb-86ad-4abb-a429-f05f9b2c5364 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:04.908808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 134/263] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:04 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:04.913651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bb2fb-86ad-4abb-a429-f05f9b2c5364 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:05.015779 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a42af-28c3-49f5-a956-6352206a561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:05.016374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a42af-28c3-49f5-a956-6352206a561c None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:05.016653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a42af-28c3-49f5-a956-6352206a561c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:05.016951 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a42af-28c3-49f5-a956-6352206a561c None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005/users/4c00bdc2a99444c383fa4074ec0979c0/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:05.025097 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a42af-28c3-49f5-a956-6352206a561c None admin] RBAC: Authorizing `identity:create_grant(project_id=aa4dda00a89f4cc49309ae81cc931005, user_id=4c00bdc2a99444c383fa4074ec0979c0, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:05.027235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a42af-28c3-49f5-a956-6352206a561c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:05.052724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 130/264] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:08:04 2022] PUT /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005/users/4c00bdc2a99444c383fa4074ec0979c0/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:08:05.053603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a42af-28c3-49f5-a956-6352206a561c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:05.086225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bb2fb-86ad-4abb-a429-f05f9b2c5364 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:05.165702 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6726d57-2396-4373-b44e-d3abcaa2b10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:05.166392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6726d57-2396-4373-b44e-d3abcaa2b10f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:05.166672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6726d57-2396-4373-b44e-d3abcaa2b10f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:05.166942 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6726d57-2396-4373-b44e-d3abcaa2b10f None admin] PATH_INFO: `/v3/users/769be20b1d654226bd2392203e612d36` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:05.168337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6726d57-2396-4373-b44e-d3abcaa2b10f None admin] RBAC: Authorizing `identity:get_user(user_id=769be20b1d654226bd2392203e612d36)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:05.169845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6726d57-2396-4373-b44e-d3abcaa2b10f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:05.174468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 135/265] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:08:04 2022] GET /identity/v3/users/769be20b1d654226bd2392203e612d36 => generated 283 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:05.182115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6726d57-2396-4373-b44e-d3abcaa2b10f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:05.239903 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:05.312276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6726d57-2396-4373-b44e-d3abcaa2b10f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:05.358727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067fc91-1365-4a20-bdc1-6c3e6b6d3a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:05.359361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067fc91-1365-4a20-bdc1-6c3e6b6d3a0c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:05.359636 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067fc91-1365-4a20-bdc1-6c3e6b6d3a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:05.359912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067fc91-1365-4a20-bdc1-6c3e6b6d3a0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:05.362580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a42af-28c3-49f5-a956-6352206a561c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:05.448620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:05.469516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4458f16-3f8e-437b-9f87-6538aaa521bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:05.470155 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458f16-3f8e-437b-9f87-6538aaa521bf None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:05.470433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458f16-3f8e-437b-9f87-6538aaa521bf None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:05.470696 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458f16-3f8e-437b-9f87-6538aaa521bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:05.471443 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4458f16-3f8e-437b-9f87-6538aaa521bf None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=aa4dda00a89f4cc49309ae81cc931005, user.id=769be20b1d654226bd2392203e612d36) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:05.471753 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4458f16-3f8e-437b-9f87-6538aaa521bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:05.473276 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4458f16-3f8e-437b-9f87-6538aaa521bf None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:05.491140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 131/266] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:08:05 2022] GET /identity/v3/role_assignments?user.id=769be20b1d654226bd2392203e612d36&scope.project.id=aa4dda00a89f4cc49309ae81cc931005&role.id=beec000223e041209205627bfa0dbed1 => generated 608 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:05.587464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067fc91-1365-4a20-bdc1-6c3e6b6d3a0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:05.591083 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067fc91-1365-4a20-bdc1-6c3e6b6d3a0c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:05.692677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:05.814329 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 136/267] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 16:08:05.815810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4458f16-3f8e-437b-9f87-6538aaa521bf None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:05.973539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4458f16-3f8e-437b-9f87-6538aaa521bf None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:06.042379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c9df5-1e51-4d13-afde-a553fae1c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:06.043740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c9df5-1e51-4d13-afde-a553fae1c81b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:06.044425 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c9df5-1e51-4d13-afde-a553fae1c81b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:06.045146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c9df5-1e51-4d13-afde-a553fae1c81b None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:06.047346 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c9df5-1e51-4d13-afde-a553fae1c81b None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:06.050282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c9df5-1e51-4d13-afde-a553fae1c81b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:06.053911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 132/268] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:05 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:06.061195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067fc91-1365-4a20-bdc1-6c3e6b6d3a0c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:06.217599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067fc91-1365-4a20-bdc1-6c3e6b6d3a0c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:06.266397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6ed79-8438-4fb3-8d24-2dc69f2176b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:06.266397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ed79-8438-4fb3-8d24-2dc69f2176b9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:06.266397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ed79-8438-4fb3-8d24-2dc69f2176b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:06.266397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ed79-8438-4fb3-8d24-2dc69f2176b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:06.266866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6ed79-8438-4fb3-8d24-2dc69f2176b9 None admin] RBAC: Adding query filter params (role.id=fdf188800dba4eee980df53694a7ed69, scope.project.id=aa4dda00a89f4cc49309ae81cc931005, user.id=769be20b1d654226bd2392203e612d36) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:06.266866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6ed79-8438-4fb3-8d24-2dc69f2176b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:06.268115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6ed79-8438-4fb3-8d24-2dc69f2176b9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:06.278916 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 137/269] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:08:06 2022] GET /identity/v3/role_assignments?user.id=769be20b1d654226bd2392203e612d36&scope.project.id=aa4dda00a89f4cc49309ae81cc931005&role.id=fdf188800dba4eee980df53694a7ed69 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:06.584348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1775716-d529-44ec-993d-eabf350733e6 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:06.585152 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1775716-d529-44ec-993d-eabf350733e6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:06.585152 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1775716-d529-44ec-993d-eabf350733e6 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:06.586954 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 133/270] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:06.596096 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01287f53-4efc-4357-a43c-2609c4592e2c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:06.597525 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01287f53-4efc-4357-a43c-2609c4592e2c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:06.598216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01287f53-4efc-4357-a43c-2609c4592e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:06.609322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:06.631212 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-01287f53-4efc-4357-a43c-2609c4592e2c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:06.633535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-01287f53-4efc-4357-a43c-2609c4592e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:06.742942 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 138/271] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:06.831890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f34511-a86f-4d55-9f93-5ea5b333339a None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:06.832849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f34511-a86f-4d55-9f93-5ea5b333339a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:06.833694 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f34511-a86f-4d55-9f93-5ea5b333339a None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:06.836570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 134/272] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:06.848650 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2f470-c5e7-42e9-8aea-dee33a9b1615 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:06.849083 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2f470-c5e7-42e9-8aea-dee33a9b1615 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:06.849229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2f470-c5e7-42e9-8aea-dee33a9b1615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:06.872890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f6e2f470-c5e7-42e9-8aea-dee33a9b1615 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:06.874160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f6e2f470-c5e7-42e9-8aea-dee33a9b1615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:06.981853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 139/273] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:07.257054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f34511-a86f-4d55-9f93-5ea5b333339a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:07.367582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:07.380161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf3603-3b0b-4807-9766-e2db82f4ad0c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:07.380575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf3603-3b0b-4807-9766-e2db82f4ad0c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:07.381026 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf3603-3b0b-4807-9766-e2db82f4ad0c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:07.383019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 140/274] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:07.389875 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345f169-c1fa-41b4-9c9f-c1e236913592 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:07.390329 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345f169-c1fa-41b4-9c9f-c1e236913592 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:07.390786 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345f169-c1fa-41b4-9c9f-c1e236913592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:07.420500 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7345f169-c1fa-41b4-9c9f-c1e236913592 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:07.422532 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7345f169-c1fa-41b4-9c9f-c1e236913592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:07.436316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f34511-a86f-4d55-9f93-5ea5b333339a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:07.490376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb13454-1fa8-484f-ab3a-cc7fbf4d445c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:07.491384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb13454-1fa8-484f-ab3a-cc7fbf4d445c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:07.491797 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb13454-1fa8-484f-ab3a-cc7fbf4d445c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:07.492193 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb13454-1fa8-484f-ab3a-cc7fbf4d445c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:07.493840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb13454-1fa8-484f-ab3a-cc7fbf4d445c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:07.495719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb13454-1fa8-484f-ab3a-cc7fbf4d445c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:07.497806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 135/275] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:07.497806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb13454-1fa8-484f-ab3a-cc7fbf4d445c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:07.513009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:07.533394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 141/276] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:07.533394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345f169-c1fa-41b4-9c9f-c1e236913592 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:07.686653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb13454-1fa8-484f-ab3a-cc7fbf4d445c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:07.722692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345f169-c1fa-41b4-9c9f-c1e236913592 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:07.739943 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:07.750928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc6c22-6e39-4559-96ae-1fcebe3c3a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:07.752529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6c22-6e39-4559-96ae-1fcebe3c3a28 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:07.753342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6c22-6e39-4559-96ae-1fcebe3c3a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:07.754049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6c22-6e39-4559-96ae-1fcebe3c3a28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:07.773860 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc6c22-6e39-4559-96ae-1fcebe3c3a28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-56bc6c22-6e39-4559-96ae-1fcebe3c3a28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:07.785283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:07.787172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:07.788813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:07.788813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:07.788813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:07.788813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:07.788813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:07.788813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:07.788813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:07.788813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:07.788813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:07.788813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:07.788813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:07.788813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:07.790009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91cda3-6ca3-4518-bd05-87366bcd720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:07.790009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91cda3-6ca3-4518-bd05-87366bcd720d None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:07.790009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91cda3-6ca3-4518-bd05-87366bcd720d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:07.790009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91cda3-6ca3-4518-bd05-87366bcd720d None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:07.790494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91cda3-6ca3-4518-bd05-87366bcd720d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:07.793001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91cda3-6ca3-4518-bd05-87366bcd720d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:07.794025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 136/277] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:07.800573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc6c22-6e39-4559-96ae-1fcebe3c3a28 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:07.828873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 142/278] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:08:07 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:08:07.830037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91cda3-6ca3-4518-bd05-87366bcd720d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:07.905207 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:07.965709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc6c22-6e39-4559-96ae-1fcebe3c3a28 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:07.978934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91cda3-6ca3-4518-bd05-87366bcd720d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:08.006744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af712b7-fbcb-4b91-91df-6a1db184437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:08.007379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af712b7-fbcb-4b91-91df-6a1db184437d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:08.007658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af712b7-fbcb-4b91-91df-6a1db184437d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:08.007930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af712b7-fbcb-4b91-91df-6a1db184437d None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:08.008625 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af712b7-fbcb-4b91-91df-6a1db184437d None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:08.008963 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af712b7-fbcb-4b91-91df-6a1db184437d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:08.011085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af712b7-fbcb-4b91-91df-6a1db184437d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:08.026381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 137/279] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:08.028300 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af712b7-fbcb-4b91-91df-6a1db184437d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:08.029758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e0afa-d62f-4d5a-934c-8fdc56ccf669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:08.030656 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e0afa-d62f-4d5a-934c-8fdc56ccf669 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:08.031040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e0afa-d62f-4d5a-934c-8fdc56ccf669 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:08.031409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e0afa-d62f-4d5a-934c-8fdc56ccf669 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:08.046039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e0afa-d62f-4d5a-934c-8fdc56ccf669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-513e0afa-d62f-4d5a-934c-8fdc56ccf669 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:08.053530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:08.054717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:08.055658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:08.055658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:08.055658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:08.055658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:08.055658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:08.055658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:08.055658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:08.055658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:08.055658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:08.055658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:08.055658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:08:08.055658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:08.057546 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 143/280] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:08.063818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e0afa-d62f-4d5a-934c-8fdc56ccf669 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:08.112118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:08.193125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af712b7-fbcb-4b91-91df-6a1db184437d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:08.226222 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e0afa-d62f-4d5a-934c-8fdc56ccf669 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:08.237147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64ba1b-2c26-470a-ac7d-55206cd332a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:08.237803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64ba1b-2c26-470a-ac7d-55206cd332a8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:08.238094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64ba1b-2c26-470a-ac7d-55206cd332a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:08.238393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64ba1b-2c26-470a-ac7d-55206cd332a8 None admin] PATH_INFO: `/v3/users/af0a4855c9be441ebd800abcc3446b21` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:08.240053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:08.255358 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64ba1b-2c26-470a-ac7d-55206cd332a8 None admin] RBAC: Authorizing `identity:get_user(user_id=af0a4855c9be441ebd800abcc3446b21)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:08.256928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64ba1b-2c26-470a-ac7d-55206cd332a8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:08.258707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 138/281] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:08:08 2022] GET /identity/v3/users/af0a4855c9be441ebd800abcc3446b21 => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:08.264961 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64ba1b-2c26-470a-ac7d-55206cd332a8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:08.276630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d8162-98f3-406f-a1c3-8ed672ad38c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:08.277672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d8162-98f3-406f-a1c3-8ed672ad38c3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:08.278186 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d8162-98f3-406f-a1c3-8ed672ad38c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:08.279321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d8162-98f3-406f-a1c3-8ed672ad38c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:08.280738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d8162-98f3-406f-a1c3-8ed672ad38c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:08.281415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d8162-98f3-406f-a1c3-8ed672ad38c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:08.283290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d8162-98f3-406f-a1c3-8ed672ad38c3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:08.295266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 144/282] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:08.304114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d8162-98f3-406f-a1c3-8ed672ad38c3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:08.447786 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64ba1b-2c26-470a-ac7d-55206cd332a8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:08.461252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:08.490670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80884eb1-5eef-4a26-9f31-3c2054753dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:08.491281 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884eb1-5eef-4a26-9f31-3c2054753dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:08.491555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884eb1-5eef-4a26-9f31-3c2054753dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:08.491823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884eb1-5eef-4a26-9f31-3c2054753dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:08.492543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80884eb1-5eef-4a26-9f31-3c2054753dc7 None admin] RBAC: Adding query filter params (role.id=e43d5cbe01fb477f98fbe79db2fd2e5c, user.id=af0a4855c9be441ebd800abcc3446b21, scope.system=all) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:08.492881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80884eb1-5eef-4a26-9f31-3c2054753dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:08.494423 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80884eb1-5eef-4a26-9f31-3c2054753dc7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:08.500282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 139/283] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Sep 21 16:08:08 2022] GET /identity/v3/role_assignments?user.id=af0a4855c9be441ebd800abcc3446b21&scope.system=all&role.id=e43d5cbe01fb477f98fbe79db2fd2e5c => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:08.501698 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e23d4-3eba-4948-9610-9e85b4d47987 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:08.501979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e23d4-3eba-4948-9610-9e85b4d47987 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:08.502247 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e23d4-3eba-4948-9610-9e85b4d47987 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:08.503828 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 140/284] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:08.510315 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973298da-38ff-4431-a5b9-d89aa47f0d19 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:08.510610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973298da-38ff-4431-a5b9-d89aa47f0d19 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:08.510926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973298da-38ff-4431-a5b9-d89aa47f0d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:08.511753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d8162-98f3-406f-a1c3-8ed672ad38c3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:08.531991 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-973298da-38ff-4431-a5b9-d89aa47f0d19 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:08.533188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-973298da-38ff-4431-a5b9-d89aa47f0d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:08.589767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f8317-6e62-4443-8a34-5e0a6bb3b303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:08.590410 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f8317-6e62-4443-8a34-5e0a6bb3b303 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:08.590681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f8317-6e62-4443-8a34-5e0a6bb3b303 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:08.590949 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f8317-6e62-4443-8a34-5e0a6bb3b303 None admin] PATH_INFO: `/v3/users/df07e97b78b64c0581aa5140d75038b2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:08.592156 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f8317-6e62-4443-8a34-5e0a6bb3b303 None admin] RBAC: Authorizing `identity:get_user(user_id=df07e97b78b64c0581aa5140d75038b2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:08.593665 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f8317-6e62-4443-8a34-5e0a6bb3b303 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:08.595715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 145/285] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:08:08 2022] GET /identity/v3/users/df07e97b78b64c0581aa5140d75038b2 => generated 297 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:08.609783 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f8317-6e62-4443-8a34-5e0a6bb3b303 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:08.660901 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 141/286] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:08:08.724820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:08.872509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f8317-6e62-4443-8a34-5e0a6bb3b303 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:08.960888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae825f-3761-4a5c-8329-abcc0bedaeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:08.961925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae825f-3761-4a5c-8329-abcc0bedaeb6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:08.962389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae825f-3761-4a5c-8329-abcc0bedaeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:08.963398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae825f-3761-4a5c-8329-abcc0bedaeb6 None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:08.970093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae825f-3761-4a5c-8329-abcc0bedaeb6 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:08.972847 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae825f-3761-4a5c-8329-abcc0bedaeb6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:08.976373 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 146/287] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:08 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:08.986390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973298da-38ff-4431-a5b9-d89aa47f0d19 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:09.187626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973298da-38ff-4431-a5b9-d89aa47f0d19 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:09.192159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:09.215094 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae825f-3761-4a5c-8329-abcc0bedaeb6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:09.258157 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4a1dd-15fb-4741-88c7-eaef2d5c325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:09.259226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4a1dd-15fb-4741-88c7-eaef2d5c325a None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:09.260230 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4a1dd-15fb-4741-88c7-eaef2d5c325a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:09.260721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4a1dd-15fb-4741-88c7-eaef2d5c325a None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005/users/df07e97b78b64c0581aa5140d75038b2/roles/fa4637a31390472a99f691c8c7f995e8` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:09.264430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4a1dd-15fb-4741-88c7-eaef2d5c325a None admin] RBAC: Authorizing `identity:create_grant(project_id=aa4dda00a89f4cc49309ae81cc931005, user_id=df07e97b78b64c0581aa5140d75038b2, role_id=fa4637a31390472a99f691c8c7f995e8)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:09.267861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4a1dd-15fb-4741-88c7-eaef2d5c325a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:09.295674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 142/288] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:08:08 2022] PUT /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005/users/df07e97b78b64c0581aa5140d75038b2/roles/fa4637a31390472a99f691c8c7f995e8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:08:09.467772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae825f-3761-4a5c-8329-abcc0bedaeb6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:09.481312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:09.528292 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12975853-b06f-49b2-a3e3-67223d768369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:09.529450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12975853-b06f-49b2-a3e3-67223d768369 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:09.529970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12975853-b06f-49b2-a3e3-67223d768369 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:09.530492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12975853-b06f-49b2-a3e3-67223d768369 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:09.552293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12975853-b06f-49b2-a3e3-67223d768369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-12975853-b06f-49b2-a3e3-67223d768369 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:09.558031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:09.559033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:09.559928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:09.559928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:09.559928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:09.559928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:09.559928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:09.559928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:09.559928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:09.559928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:09.559928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:09.559928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:09.559928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:09.559928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:09.565802 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 147/289] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:09.577942 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4a1dd-15fb-4741-88c7-eaef2d5c325a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:09.701708 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4a1dd-15fb-4741-88c7-eaef2d5c325a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:09.760905 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27f906-36c6-42ba-991d-3c07975a8877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:09.761822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f906-36c6-42ba-991d-3c07975a8877 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:09.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f906-36c6-42ba-991d-3c07975a8877 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:09.762792 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f906-36c6-42ba-991d-3c07975a8877 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:09.764034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27f906-36c6-42ba-991d-3c07975a8877 None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:09.764588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27f906-36c6-42ba-991d-3c07975a8877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:09.767240 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27f906-36c6-42ba-991d-3c07975a8877 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:09.791188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 143/290] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:09.796943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12975853-b06f-49b2-a3e3-67223d768369 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:10.006157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12975853-b06f-49b2-a3e3-67223d768369 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:10.060502 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569adb95-89ed-4cbc-8d3c-95e221923a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:10.061568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569adb95-89ed-4cbc-8d3c-95e221923a78 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:10.062049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569adb95-89ed-4cbc-8d3c-95e221923a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:10.062548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569adb95-89ed-4cbc-8d3c-95e221923a78 None admin] PATH_INFO: `/v3/users/4c00bdc2a99444c383fa4074ec0979c0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:10.067687 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569adb95-89ed-4cbc-8d3c-95e221923a78 None admin] RBAC: Authorizing `identity:get_user(user_id=4c00bdc2a99444c383fa4074ec0979c0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:10.069437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569adb95-89ed-4cbc-8d3c-95e221923a78 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:10.071302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 148/291] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:08:09 2022] GET /identity/v3/users/4c00bdc2a99444c383fa4074ec0979c0 => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:10.078146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27f906-36c6-42ba-991d-3c07975a8877 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:10.140030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:10.248345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27f906-36c6-42ba-991d-3c07975a8877 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:10.285302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44e38f-a5a1-4c65-9424-38b3b113f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:10.286004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44e38f-a5a1-4c65-9424-38b3b113f684 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:10.286281 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44e38f-a5a1-4c65-9424-38b3b113f684 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:10.286551 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44e38f-a5a1-4c65-9424-38b3b113f684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:10.403173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44e38f-a5a1-4c65-9424-38b3b113f684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:10.405964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44e38f-a5a1-4c65-9424-38b3b113f684 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:10.473870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:10.598731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 144/292] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:10.605383 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569adb95-89ed-4cbc-8d3c-95e221923a78 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:10.674009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:10.788007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569adb95-89ed-4cbc-8d3c-95e221923a78 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:10.842648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dd368-01d9-4f57-a0a2-6b7aaa195615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:10.843444 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dd368-01d9-4f57-a0a2-6b7aaa195615 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:10.843576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dd368-01d9-4f57-a0a2-6b7aaa195615 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:10.843839 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dd368-01d9-4f57-a0a2-6b7aaa195615 None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:10.845081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dd368-01d9-4f57-a0a2-6b7aaa195615 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:10.846539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dd368-01d9-4f57-a0a2-6b7aaa195615 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:10.848415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 149/293] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:10 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:10.855726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44e38f-a5a1-4c65-9424-38b3b113f684 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:11.093772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44e38f-a5a1-4c65-9424-38b3b113f684 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:11.137316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:11.150724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9786c-ac64-4556-af83-a958603aa5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:11.151357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9786c-ac64-4556-af83-a958603aa5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:11.151637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9786c-ac64-4556-af83-a958603aa5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:11.151908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9786c-ac64-4556-af83-a958603aa5f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:11.152653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9786c-ac64-4556-af83-a958603aa5f0 None admin] RBAC: Adding query filter params (role.id=e43d5cbe01fb477f98fbe79db2fd2e5c, scope.project.id=aa4dda00a89f4cc49309ae81cc931005, user.id=4c00bdc2a99444c383fa4074ec0979c0) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:11.153053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9786c-ac64-4556-af83-a958603aa5f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:11.154536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9786c-ac64-4556-af83-a958603aa5f0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:11.161309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 145/294] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:08:10 2022] GET /identity/v3/role_assignments?user.id=4c00bdc2a99444c383fa4074ec0979c0&scope.project.id=aa4dda00a89f4cc49309ae81cc931005&role.id=e43d5cbe01fb477f98fbe79db2fd2e5c => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:11.464864 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eeaff8-a06a-4a9b-9841-54ba3a8f453e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:11.465529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eeaff8-a06a-4a9b-9841-54ba3a8f453e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:11.466011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eeaff8-a06a-4a9b-9841-54ba3a8f453e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:11.467703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 150/295] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:08:11.473971 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c930e3-21c1-4842-81b9-d240a83b150c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:11.474622 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c930e3-21c1-4842-81b9-d240a83b150c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:11.475112 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c930e3-21c1-4842-81b9-d240a83b150c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:11.505472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-98c930e3-21c1-4842-81b9-d240a83b150c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:11.507072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-98c930e3-21c1-4842-81b9-d240a83b150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:11.612410 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece1d3-8102-424e-b532-ccd7ee71f3e1 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:11.613078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece1d3-8102-424e-b532-ccd7ee71f3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:11.613599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece1d3-8102-424e-b532-ccd7ee71f3e1 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:11.615482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 151/296] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:11.622979 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdb028-f98f-4cde-b22e-989ee1f78a18 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:11.623608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdb028-f98f-4cde-b22e-989ee1f78a18 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:11.624094 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdb028-f98f-4cde-b22e-989ee1f78a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:11.628420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 146/297] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:11.670032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e7bdb028-f98f-4cde-b22e-989ee1f78a18 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:11.671258 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e7bdb028-f98f-4cde-b22e-989ee1f78a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:11.792094 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 152/298] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:08:11.935596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c930e3-21c1-4842-81b9-d240a83b150c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:11.949431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16304093-e15b-4e09-a3cc-38d50cc59765 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:11.950811 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16304093-e15b-4e09-a3cc-38d50cc59765 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:11.951864 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16304093-e15b-4e09-a3cc-38d50cc59765 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:11.955552 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 153/299] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:11.965280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8eea6-a0ba-4772-8a2e-d466b101d574 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:11.965784 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8eea6-a0ba-4772-8a2e-d466b101d574 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:11.966282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8eea6-a0ba-4772-8a2e-d466b101d574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:11.996879 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8ac8eea6-a0ba-4772-8a2e-d466b101d574 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:11.998975 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8ac8eea6-a0ba-4772-8a2e-d466b101d574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:12.035904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:12.075422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c930e3-21c1-4842-81b9-d240a83b150c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:12.107561 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:12.128383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464d506-7edf-42e2-8104-44cb0c108a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:12.129052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464d506-7edf-42e2-8104-44cb0c108a4a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:12.129330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464d506-7edf-42e2-8104-44cb0c108a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:12.129634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464d506-7edf-42e2-8104-44cb0c108a4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:12.132272 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 154/300] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:08:12.153772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464d506-7edf-42e2-8104-44cb0c108a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-8464d506-7edf-42e2-8104-44cb0c108a4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:12.164131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:12.166115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:12.167912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:12.167912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:12.167912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:12.167912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:12.167912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:12.167912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:12.167912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:12.167912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:12.167912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:12.167912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:12.167912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:12.167912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:12.171811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 147/301] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:12.179192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8eea6-a0ba-4772-8a2e-d466b101d574 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:12.185061 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464d506-7edf-42e2-8104-44cb0c108a4a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:12.306015 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8eea6-a0ba-4772-8a2e-d466b101d574 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:12.317811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464d506-7edf-42e2-8104-44cb0c108a4a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:12.347906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c923db-082b-4ead-9cdb-983cc5b65bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:12.348508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c923db-082b-4ead-9cdb-983cc5b65bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:12.349095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c923db-082b-4ead-9cdb-983cc5b65bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:12.349378 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c923db-082b-4ead-9cdb-983cc5b65bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:12.350075 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c923db-082b-4ead-9cdb-983cc5b65bf8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:12.350587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c923db-082b-4ead-9cdb-983cc5b65bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:12.352741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c923db-082b-4ead-9cdb-983cc5b65bf8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:12.363946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbec4a-720e-45de-8cc4-910ebac1bb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:12.364700 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 155/302] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:12.368965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbec4a-720e-45de-8cc4-910ebac1bb43 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:12.369838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbec4a-720e-45de-8cc4-910ebac1bb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:12.370172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbec4a-720e-45de-8cc4-910ebac1bb43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:12.371574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c923db-082b-4ead-9cdb-983cc5b65bf8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:12.385459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbec4a-720e-45de-8cc4-910ebac1bb43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-b6cbec4a-720e-45de-8cc4-910ebac1bb43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:12.392100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:12.393123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:12.393921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:12.393921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:12.393921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:12.393921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:12.393921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:12.393921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:12.393921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:12.393921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:12.393921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:12.393921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:12.393921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:08:12.393921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:12.398439 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 148/303] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:08:12.400211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbec4a-720e-45de-8cc4-910ebac1bb43 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:12.407848 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:12.459456 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:12.503965 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c923db-082b-4ead-9cdb-983cc5b65bf8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:12.525940 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbec4a-720e-45de-8cc4-910ebac1bb43 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:12.556413 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c96d27-6e56-411a-acea-7aa7f3c4a8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:12.557280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c96d27-6e56-411a-acea-7aa7f3c4a8eb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:12.557568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c96d27-6e56-411a-acea-7aa7f3c4a8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:12.557842 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c96d27-6e56-411a-acea-7aa7f3c4a8eb None admin] PATH_INFO: `/v3/users/af0a4855c9be441ebd800abcc3446b21` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:12.559149 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c96d27-6e56-411a-acea-7aa7f3c4a8eb None admin] RBAC: Authorizing `identity:get_user(user_id=af0a4855c9be441ebd800abcc3446b21)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:12.560667 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c96d27-6e56-411a-acea-7aa7f3c4a8eb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:12.567291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 156/304] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:08:12 2022] GET /identity/v3/users/af0a4855c9be441ebd800abcc3446b21 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:12.567291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c96d27-6e56-411a-acea-7aa7f3c4a8eb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:12.574979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287d0fd-29b1-4dd1-a209-c213d631bff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:12.575863 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287d0fd-29b1-4dd1-a209-c213d631bff5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:12.576111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287d0fd-29b1-4dd1-a209-c213d631bff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:12.576379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287d0fd-29b1-4dd1-a209-c213d631bff5 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:12.577307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287d0fd-29b1-4dd1-a209-c213d631bff5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:12.577619 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287d0fd-29b1-4dd1-a209-c213d631bff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:12.579695 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287d0fd-29b1-4dd1-a209-c213d631bff5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:12.591977 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 149/305] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:12.592987 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287d0fd-29b1-4dd1-a209-c213d631bff5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:12.686053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:12.699341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c96d27-6e56-411a-acea-7aa7f3c4a8eb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:12.737552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287d0fd-29b1-4dd1-a209-c213d631bff5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:12.739302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:12.747753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399caf6b-9fa0-410f-804f-dcdccbc2bc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:12.749034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399caf6b-9fa0-410f-804f-dcdccbc2bc67 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:12.749322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399caf6b-9fa0-410f-804f-dcdccbc2bc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:12.749798 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399caf6b-9fa0-410f-804f-dcdccbc2bc67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:12.751571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399caf6b-9fa0-410f-804f-dcdccbc2bc67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:12.753541 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399caf6b-9fa0-410f-804f-dcdccbc2bc67 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:12.760592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 157/306] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:12.760592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399caf6b-9fa0-410f-804f-dcdccbc2bc67 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:12.787454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5775bbd-b00c-4f55-a661-09fd3a89ff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:12.788417 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5775bbd-b00c-4f55-a661-09fd3a89ff73 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:12.788717 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5775bbd-b00c-4f55-a661-09fd3a89ff73 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:12.788986 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5775bbd-b00c-4f55-a661-09fd3a89ff73 None admin] PATH_INFO: `/v3/system/users/af0a4855c9be441ebd800abcc3446b21/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:12.791570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5775bbd-b00c-4f55-a661-09fd3a89ff73 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=af0a4855c9be441ebd800abcc3446b21, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:12.793439 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5775bbd-b00c-4f55-a661-09fd3a89ff73 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:12.805915 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 150/307] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Sep 21 16:08:12 2022] PUT /identity/v3/system/users/af0a4855c9be441ebd800abcc3446b21/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:08:12.807422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5775bbd-b00c-4f55-a661-09fd3a89ff73 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:12.906027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399caf6b-9fa0-410f-804f-dcdccbc2bc67 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:12.940771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5775bbd-b00c-4f55-a661-09fd3a89ff73 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:12.948069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd88dd2-929d-42f6-bcae-01e9be4cc9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:12.948747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd88dd2-929d-42f6-bcae-01e9be4cc9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:12.949027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd88dd2-929d-42f6-bcae-01e9be4cc9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:12.949293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd88dd2-929d-42f6-bcae-01e9be4cc9d5 None admin] PATH_INFO: `/v3/users/d6047c919d9d4bb2bbc40c8e455142c4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:12.965538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd88dd2-929d-42f6-bcae-01e9be4cc9d5 None admin] RBAC: Authorizing `identity:get_user(user_id=d6047c919d9d4bb2bbc40c8e455142c4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:12.967074 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd88dd2-929d-42f6-bcae-01e9be4cc9d5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:12.968985 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 158/308] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:08:12 2022] GET /identity/v3/users/d6047c919d9d4bb2bbc40c8e455142c4 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:12.975062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a563d-948f-446e-8a42-0e174cc57207 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:12.975352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a563d-948f-446e-8a42-0e174cc57207 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:12.975618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a563d-948f-446e-8a42-0e174cc57207 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:12.977265 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 159/309] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:12.978089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a563d-948f-446e-8a42-0e174cc57207 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:13.006535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e837ead-a99a-427e-9025-9d26cb668df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:13.006737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:13.007076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837ead-a99a-427e-9025-9d26cb668df1 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:13.007586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837ead-a99a-427e-9025-9d26cb668df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:13.008080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837ead-a99a-427e-9025-9d26cb668df1 None admin] PATH_INFO: `/v3/groups` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:13.009341 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e837ead-a99a-427e-9025-9d26cb668df1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:13.012217 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e837ead-a99a-427e-9025-9d26cb668df1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:13.044734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 151/310] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Sep 21 16:08:12 2022] POST /identity/v3/groups => generated 229 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:08:13.044734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aae302-caa9-4744-8daa-7e7e26ba6d72 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:13.044734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aae302-caa9-4744-8daa-7e7e26ba6d72 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:13.044734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aae302-caa9-4744-8daa-7e7e26ba6d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:13.089741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a9aae302-caa9-4744-8daa-7e7e26ba6d72 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:13.093087 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a9aae302-caa9-4744-8daa-7e7e26ba6d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:13.116908 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a563d-948f-446e-8a42-0e174cc57207 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:13.148390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:13.172988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88021ce-9831-4a26-989d-f9ef1aea08b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:13.174553 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88021ce-9831-4a26-989d-f9ef1aea08b6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:13.175230 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88021ce-9831-4a26-989d-f9ef1aea08b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:13.175841 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88021ce-9831-4a26-989d-f9ef1aea08b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:13.177004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88021ce-9831-4a26-989d-f9ef1aea08b6 None admin] RBAC: Adding query filter params (role.id=fa4637a31390472a99f691c8c7f995e8, user.id=d6047c919d9d4bb2bbc40c8e455142c4, scope.system=all) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:13.177691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88021ce-9831-4a26-989d-f9ef1aea08b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:13.179512 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88021ce-9831-4a26-989d-f9ef1aea08b6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:13.192723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 160/311] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Sep 21 16:08:12 2022] GET /identity/v3/role_assignments?user.id=d6047c919d9d4bb2bbc40c8e455142c4&scope.system=all&role.id=fa4637a31390472a99f691c8c7f995e8 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:13.254473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 152/312] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:13.546908 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88021ce-9831-4a26-989d-f9ef1aea08b6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:13.710754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:13.733003 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88021ce-9831-4a26-989d-f9ef1aea08b6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:13.774792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8468d16-be65-4ae9-8a47-c87cb6dbb119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:13.776119 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8468d16-be65-4ae9-8a47-c87cb6dbb119 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:13.776399 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8468d16-be65-4ae9-8a47-c87cb6dbb119 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:13.776668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8468d16-be65-4ae9-8a47-c87cb6dbb119 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:13.788466 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8468d16-be65-4ae9-8a47-c87cb6dbb119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f8468d16-be65-4ae9-8a47-c87cb6dbb119 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:13.794049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:13.794989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:13.795797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:13.795797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:13.795797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:13.795797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:13.795797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:13.795797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:13.795797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:13.795797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:13.795797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:13.795797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:13.795797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:08:13.795797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:13.795797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 161/313] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:13.802754 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aae302-caa9-4744-8daa-7e7e26ba6d72 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:13.920974 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aae302-caa9-4744-8daa-7e7e26ba6d72 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:13.958932 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad210-d0dc-434d-beb9-63c617c8fac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:13.959565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad210-d0dc-434d-beb9-63c617c8fac3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:13.959843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad210-d0dc-434d-beb9-63c617c8fac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:13.960115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad210-d0dc-434d-beb9-63c617c8fac3 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:13.960882 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ad210-d0dc-434d-beb9-63c617c8fac3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:13.961130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ad210-d0dc-434d-beb9-63c617c8fac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:13.962533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ad210-d0dc-434d-beb9-63c617c8fac3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:13.980860 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 153/314] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:13.985787 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8468d16-be65-4ae9-8a47-c87cb6dbb119 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:14.126896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8468d16-be65-4ae9-8a47-c87cb6dbb119 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:14.193522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7532b-958d-4cf2-adf3-b78d8a160f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:14.195582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7532b-958d-4cf2-adf3-b78d8a160f6c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:14.196105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7532b-958d-4cf2-adf3-b78d8a160f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:14.196529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7532b-958d-4cf2-adf3-b78d8a160f6c None admin] PATH_INFO: `/v3/users/df07e97b78b64c0581aa5140d75038b2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:14.199256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7532b-958d-4cf2-adf3-b78d8a160f6c None admin] RBAC: Authorizing `identity:get_user(user_id=df07e97b78b64c0581aa5140d75038b2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:14.201838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7532b-958d-4cf2-adf3-b78d8a160f6c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:14.205086 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 162/315] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:08:13 2022] GET /identity/v3/users/df07e97b78b64c0581aa5140d75038b2 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:14.210803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad210-d0dc-434d-beb9-63c617c8fac3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:14.233492 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:14.388321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad210-d0dc-434d-beb9-63c617c8fac3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:14.452500 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d164bc2-1157-4aba-b707-7feaa3f109cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:14.453614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164bc2-1157-4aba-b707-7feaa3f109cb None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:14.454095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164bc2-1157-4aba-b707-7feaa3f109cb None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:14.454580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164bc2-1157-4aba-b707-7feaa3f109cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:14.581548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d164bc2-1157-4aba-b707-7feaa3f109cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:14.584334 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d164bc2-1157-4aba-b707-7feaa3f109cb None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:14.617350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:14.776900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 154/316] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:14.786481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7532b-958d-4cf2-adf3-b78d8a160f6c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:14.809114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:14.976672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7532b-958d-4cf2-adf3-b78d8a160f6c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:15.040872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c4fdb-1f70-4056-9a22-ce8626cf60af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:15.041925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4fdb-1f70-4056-9a22-ce8626cf60af None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:15.042415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4fdb-1f70-4056-9a22-ce8626cf60af None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:15.042892 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4fdb-1f70-4056-9a22-ce8626cf60af None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:15.044964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c4fdb-1f70-4056-9a22-ce8626cf60af None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:15.047905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c4fdb-1f70-4056-9a22-ce8626cf60af None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:15.051077 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 163/317] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:14 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:15.061494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d164bc2-1157-4aba-b707-7feaa3f109cb None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:15.091834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea43cb-6662-495c-b076-262eac0845db None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:15.092296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea43cb-6662-495c-b076-262eac0845db None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:15.093500 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea43cb-6662-495c-b076-262eac0845db None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:15.096975 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 164/318] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:15.103923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e663-a827-49a8-ba09-75565b7381e8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:15.104398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e663-a827-49a8-ba09-75565b7381e8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:15.104887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e663-a827-49a8-ba09-75565b7381e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:15.141340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a636e663-a827-49a8-ba09-75565b7381e8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:15.143560 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a636e663-a827-49a8-ba09-75565b7381e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:15.201688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d164bc2-1157-4aba-b707-7feaa3f109cb None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:15.224221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:15.265822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cab38-5129-42f7-a342-10f490b3a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:15.266477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cab38-5129-42f7-a342-10f490b3a3fd None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:15.266719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cab38-5129-42f7-a342-10f490b3a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:15.266948 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cab38-5129-42f7-a342-10f490b3a3fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:15.267721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cab38-5129-42f7-a342-10f490b3a3fd None admin] RBAC: Adding query filter params (role.id=fa4637a31390472a99f691c8c7f995e8, scope.project.id=aa4dda00a89f4cc49309ae81cc931005, user.id=df07e97b78b64c0581aa5140d75038b2) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:15.268023 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cab38-5129-42f7-a342-10f490b3a3fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:15.269537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cab38-5129-42f7-a342-10f490b3a3fd None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:15.277684 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 155/319] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:08:15 2022] GET /identity/v3/role_assignments?user.id=df07e97b78b64c0581aa5140d75038b2&scope.project.id=aa4dda00a89f4cc49309ae81cc931005&role.id=fa4637a31390472a99f691c8c7f995e8 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:15.288432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 165/320] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:08:15.581593 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cab38-5129-42f7-a342-10f490b3a3fd None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:15.706026 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8142d-08d4-4704-939b-f47a0e7c4a4f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:15.706650 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8142d-08d4-4704-939b-f47a0e7c4a4f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:15.707143 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8142d-08d4-4704-939b-f47a0e7c4a4f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:15.708757 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cab38-5129-42f7-a342-10f490b3a3fd None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:15.709090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 166/321] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:15.722653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0fe4b-3b1d-4160-8bc5-c779e3f4f316 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:15.723132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0fe4b-3b1d-4160-8bc5-c779e3f4f316 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:15.723623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0fe4b-3b1d-4160-8bc5-c779e3f4f316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:15.750795 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f1120-00fa-418c-9731-0bc587d95f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:15.751444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f1120-00fa-418c-9731-0bc587d95f53 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:15.751727 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f1120-00fa-418c-9731-0bc587d95f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:15.751999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f1120-00fa-418c-9731-0bc587d95f53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:15.761060 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cdc0fe4b-3b1d-4160-8bc5-c779e3f4f316 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:15.763078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cdc0fe4b-3b1d-4160-8bc5-c779e3f4f316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:15.764530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f1120-00fa-418c-9731-0bc587d95f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:15.766901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-349f1120-00fa-418c-9731-0bc587d95f53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:15.770072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:15.771394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:15.772206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:15.772206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:15.772206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:15.772206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:15.772206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:15.772206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:15.772206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:15.772206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:15.772206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:15.772206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:15.772206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:15.772206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:15.772206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 156/322] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:15.780880 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f1120-00fa-418c-9731-0bc587d95f53 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:15.846507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 167/323] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:08:15.865397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:15.886642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984deac-0506-4564-9e14-b88dd25b9384 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:15.886897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984deac-0506-4564-9e14-b88dd25b9384 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:15.887394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984deac-0506-4564-9e14-b88dd25b9384 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:15.888914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 168/324] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:08:15.895979 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb031c-47d7-4e6e-ad7d-cdc0277fa072 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:15.896473 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb031c-47d7-4e6e-ad7d-cdc0277fa072 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:15.897002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb031c-47d7-4e6e-ad7d-cdc0277fa072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:15.926248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-26bb031c-47d7-4e6e-ad7d-cdc0277fa072 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:15.927438 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-26bb031c-47d7-4e6e-ad7d-cdc0277fa072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:15.962228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f1120-00fa-418c-9731-0bc587d95f53 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:16.019113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 169/325] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:16.022091 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59d739-2a02-4dc4-a6b1-217144cec2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:16.023110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59d739-2a02-4dc4-a6b1-217144cec2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:16.023580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59d739-2a02-4dc4-a6b1-217144cec2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:16.024062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59d739-2a02-4dc4-a6b1-217144cec2a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:16.025330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59d739-2a02-4dc4-a6b1-217144cec2a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:16.025866 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59d739-2a02-4dc4-a6b1-217144cec2a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:16.028397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59d739-2a02-4dc4-a6b1-217144cec2a1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:16.044770 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 157/326] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:16.055038 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb031c-47d7-4e6e-ad7d-cdc0277fa072 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:16.121313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59d739-2a02-4dc4-a6b1-217144cec2a1 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:16.142233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:16.190796 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb031c-47d7-4e6e-ad7d-cdc0277fa072 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:16.236041 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc145648-d4bf-4341-b15b-f3ca8cd65334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:16.236933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc145648-d4bf-4341-b15b-f3ca8cd65334 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:16.237305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc145648-d4bf-4341-b15b-f3ca8cd65334 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:16.237630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc145648-d4bf-4341-b15b-f3ca8cd65334 None admin] PATH_INFO: `/v3/users/af0a4855c9be441ebd800abcc3446b21` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:16.239055 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc145648-d4bf-4341-b15b-f3ca8cd65334 None admin] RBAC: Authorizing `identity:get_user(user_id=af0a4855c9be441ebd800abcc3446b21)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:16.240789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc145648-d4bf-4341-b15b-f3ca8cd65334 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:16.241841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59d739-2a02-4dc4-a6b1-217144cec2a1 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:16.242636 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 170/327] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:08:16 2022] GET /identity/v3/users/af0a4855c9be441ebd800abcc3446b21 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:16.245667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:16.250274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc145648-d4bf-4341-b15b-f3ca8cd65334 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:16.291598 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de8e4d-432c-4bc1-8669-0397a07db723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:16.292343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de8e4d-432c-4bc1-8669-0397a07db723 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:16.292703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de8e4d-432c-4bc1-8669-0397a07db723 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:16.293053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de8e4d-432c-4bc1-8669-0397a07db723 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:16.294564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de8e4d-432c-4bc1-8669-0397a07db723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:16.296822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de8e4d-432c-4bc1-8669-0397a07db723 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:16.298657 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 158/328] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:16.305371 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de8e4d-432c-4bc1-8669-0397a07db723 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:16.391298 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc145648-d4bf-4341-b15b-f3ca8cd65334 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:16.433196 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de8e4d-432c-4bc1-8669-0397a07db723 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:16.442417 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a50ef-5593-4114-88a5-4480699d557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:16.443362 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a50ef-5593-4114-88a5-4480699d557c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:16.448504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a50ef-5593-4114-88a5-4480699d557c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:16.448955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a50ef-5593-4114-88a5-4480699d557c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:16.449591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a50ef-5593-4114-88a5-4480699d557c None admin] RBAC: Adding query filter params (role.id=e43d5cbe01fb477f98fbe79db2fd2e5c, user.id=af0a4855c9be441ebd800abcc3446b21, scope.system=all) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:16.450374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a50ef-5593-4114-88a5-4480699d557c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:16.451381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a50ef-5593-4114-88a5-4480699d557c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:16.454633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:16.484738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 171/329] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Sep 21 16:08:16 2022] GET /identity/v3/role_assignments?user.id=af0a4855c9be441ebd800abcc3446b21&scope.system=all&role.id=e43d5cbe01fb477f98fbe79db2fd2e5c => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:16.495688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33463395-2ac1-45cb-9e46-c85b6c0f586b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:16.496558 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33463395-2ac1-45cb-9e46-c85b6c0f586b None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:16.497053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33463395-2ac1-45cb-9e46-c85b6c0f586b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:16.497511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33463395-2ac1-45cb-9e46-c85b6c0f586b None admin] PATH_INFO: `/v3/groups` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:16.498385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33463395-2ac1-45cb-9e46-c85b6c0f586b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:16.500097 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33463395-2ac1-45cb-9e46-c85b6c0f586b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:16.521897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 159/330] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Sep 21 16:08:16 2022] POST /identity/v3/groups => generated 226 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:08:16.546154 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a50ef-5593-4114-88a5-4480699d557c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:16.733151 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a50ef-5593-4114-88a5-4480699d557c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:16.802215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6cc6f-3529-4c1c-8b2a-21de88de73e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:16.803236 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6cc6f-3529-4c1c-8b2a-21de88de73e0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:16.803689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6cc6f-3529-4c1c-8b2a-21de88de73e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:16.804134 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6cc6f-3529-4c1c-8b2a-21de88de73e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:16.823440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6cc6f-3529-4c1c-8b2a-21de88de73e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9ce6cc6f-3529-4c1c-8b2a-21de88de73e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:16.834262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:16.835859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:16.837080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:16.837080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:16.837080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:16.837080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:16.837080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:16.837080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:16.837080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:16.837080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:16.837080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:16.837080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:16.837080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:08:16.837080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:16.837080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 172/331] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:16.846204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33463395-2ac1-45cb-9e46-c85b6c0f586b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:16.897460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:16.990779 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33463395-2ac1-45cb-9e46-c85b6c0f586b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:17.044466 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1565d-929a-43e3-9191-220392894779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:17.045406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1565d-929a-43e3-9191-220392894779 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:17.045868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1565d-929a-43e3-9191-220392894779 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:17.046324 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1565d-929a-43e3-9191-220392894779 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:17.047271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1565d-929a-43e3-9191-220392894779 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:17.047787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1565d-929a-43e3-9191-220392894779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:17.049971 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1565d-929a-43e3-9191-220392894779 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:17.062544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 160/332] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:17.071737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6cc6f-3529-4c1c-8b2a-21de88de73e0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:17.160512 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:17.245421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6cc6f-3529-4c1c-8b2a-21de88de73e0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:17.320526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4d97d-900a-4c44-80e1-3b17efb1ed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:17.321623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4d97d-900a-4c44-80e1-3b17efb1ed5d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:17.322120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4d97d-900a-4c44-80e1-3b17efb1ed5d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:17.322589 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4d97d-900a-4c44-80e1-3b17efb1ed5d None admin] PATH_INFO: `/v3/users/d6047c919d9d4bb2bbc40c8e455142c4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:17.324778 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4d97d-900a-4c44-80e1-3b17efb1ed5d None admin] RBAC: Authorizing `identity:get_user(user_id=d6047c919d9d4bb2bbc40c8e455142c4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:17.327709 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4d97d-900a-4c44-80e1-3b17efb1ed5d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:17.331473 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 173/333] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:08:17 2022] GET /identity/v3/users/d6047c919d9d4bb2bbc40c8e455142c4 => generated 293 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:17.341699 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1565d-929a-43e3-9191-220392894779 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:17.536660 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:17.551204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1565d-929a-43e3-9191-220392894779 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:17.621450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76f571-d9a3-4fce-ba1c-66888894847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:17.623071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76f571-d9a3-4fce-ba1c-66888894847e None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:17.623785 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76f571-d9a3-4fce-ba1c-66888894847e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:17.624542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76f571-d9a3-4fce-ba1c-66888894847e None admin] PATH_INFO: `/v3/system/users/d6047c919d9d4bb2bbc40c8e455142c4/roles/fa4637a31390472a99f691c8c7f995e8` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:17.627531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76f571-d9a3-4fce-ba1c-66888894847e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d6047c919d9d4bb2bbc40c8e455142c4, role_id=fa4637a31390472a99f691c8c7f995e8)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:17.630297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76f571-d9a3-4fce-ba1c-66888894847e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:17.650116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 161/334] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Sep 21 16:08:17 2022] PUT /identity/v3/system/users/d6047c919d9d4bb2bbc40c8e455142c4/roles/fa4637a31390472a99f691c8c7f995e8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:08:19.725813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827620a-f936-48d5-94e9-a69150162bc1 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:19.726567 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827620a-f936-48d5-94e9-a69150162bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:19.726567 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827620a-f936-48d5-94e9-a69150162bc1 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:19.729496 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 174/335] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:08:19.738562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccfef6-da9e-4f2d-b4c7-cc8b9ec2b78c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:19.739326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccfef6-da9e-4f2d-b4c7-cc8b9ec2b78c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:19.739653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccfef6-da9e-4f2d-b4c7-cc8b9ec2b78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:19.779076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-bbccfef6-da9e-4f2d-b4c7-cc8b9ec2b78c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:19.781266 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bbccfef6-da9e-4f2d-b4c7-cc8b9ec2b78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:19.958631 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 162/336] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:20.741678 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827620a-f936-48d5-94e9-a69150162bc1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:20.906409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827620a-f936-48d5-94e9-a69150162bc1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:20.941052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:20.965298 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83c617-49ec-4b27-8f37-046daf33cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:20.965958 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83c617-49ec-4b27-8f37-046daf33cd92 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:20.966232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83c617-49ec-4b27-8f37-046daf33cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:20.966504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83c617-49ec-4b27-8f37-046daf33cd92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:20.989962 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83c617-49ec-4b27-8f37-046daf33cd92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9c83c617-49ec-4b27-8f37-046daf33cd92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:20.995098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:20.996011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:20.996923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:20.996923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:20.996923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:20.996923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:20.996923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:20.996923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:20.996923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:20.996923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:20.996923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:20.996923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:20.996923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:20.996923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:20.996923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 175/337] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:21.004022 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccfef6-da9e-4f2d-b4c7-cc8b9ec2b78c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:21.163832 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:21.185113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccfef6-da9e-4f2d-b4c7-cc8b9ec2b78c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:21.229146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b7181-7cb5-4cb4-9bd7-c8723fe00ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:21.230196 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b7181-7cb5-4cb4-9bd7-c8723fe00ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:21.230680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b7181-7cb5-4cb4-9bd7-c8723fe00ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:21.231162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b7181-7cb5-4cb4-9bd7-c8723fe00ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:21.232046 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b7181-7cb5-4cb4-9bd7-c8723fe00ce8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:21.232567 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b7181-7cb5-4cb4-9bd7-c8723fe00ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:21.234212 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b7181-7cb5-4cb4-9bd7-c8723fe00ce8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:21.245403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 163/338] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:21.251486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83c617-49ec-4b27-8f37-046daf33cd92 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:21.380435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83c617-49ec-4b27-8f37-046daf33cd92 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:21.422726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db0f74-9d86-4856-b788-ec2898c61140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:21.423745 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db0f74-9d86-4856-b788-ec2898c61140 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:21.424234 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db0f74-9d86-4856-b788-ec2898c61140 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:21.424763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db0f74-9d86-4856-b788-ec2898c61140 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:21.498379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:21.523143 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db0f74-9d86-4856-b788-ec2898c61140 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:21.524769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db0f74-9d86-4856-b788-ec2898c61140 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:21.606375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd314d1e-1ce9-41de-bcb0-d0fa89f68b2e None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:21.606696 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd314d1e-1ce9-41de-bcb0-d0fa89f68b2e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:21.606926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd314d1e-1ce9-41de-bcb0-d0fa89f68b2e None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:21.608421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 164/339] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:08:21.620269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4169a-6772-4dc8-b55c-f9056d301dd8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:21.620842 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4169a-6772-4dc8-b55c-f9056d301dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:21.621319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4169a-6772-4dc8-b55c-f9056d301dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:21.665100 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 176/340] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:21.666793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c3d4169a-6772-4dc8-b55c-f9056d301dd8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:21.668041 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c3d4169a-6772-4dc8-b55c-f9056d301dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:21.674928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db0f74-9d86-4856-b788-ec2898c61140 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:21.789213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:21.807954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db0f74-9d86-4856-b788-ec2898c61140 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:21.851486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ce651-8b1d-4c95-8907-1e7d40c87f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:21.852441 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce651-8b1d-4c95-8907-1e7d40c87f33 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:21.853015 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce651-8b1d-4c95-8907-1e7d40c87f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:21.853538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce651-8b1d-4c95-8907-1e7d40c87f33 None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:21.855086 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ce651-8b1d-4c95-8907-1e7d40c87f33 None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:21.857103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ce651-8b1d-4c95-8907-1e7d40c87f33 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:21.859490 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 177/341] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:21 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:21.865377 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775340d-13a7-4eff-9cd7-5b860299808e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:21.866020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775340d-13a7-4eff-9cd7-5b860299808e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:21.866494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775340d-13a7-4eff-9cd7-5b860299808e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:21.866597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 165/342] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:08:21.868372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 178/343] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:21.870579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4169a-6772-4dc8-b55c-f9056d301dd8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:21.882585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe242b54-4d0d-4644-8daa-89da3e270798 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:21.883214 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe242b54-4d0d-4644-8daa-89da3e270798 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:21.883689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe242b54-4d0d-4644-8daa-89da3e270798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:21.914030 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fe242b54-4d0d-4644-8daa-89da3e270798 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:21.917973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fe242b54-4d0d-4644-8daa-89da3e270798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:22.066082 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:22.076178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 179/344] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:08:22.078102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c0394-5ec7-47d8-8b65-8ac5fb987522 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:22.078648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c0394-5ec7-47d8-8b65-8ac5fb987522 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:22.079153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c0394-5ec7-47d8-8b65-8ac5fb987522 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:22.080801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 180/345] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:22.087592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1631c72-472e-4147-ad5c-c3bf1cc657c0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:22.088828 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1631c72-472e-4147-ad5c-c3bf1cc657c0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:22.089570 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1631c72-472e-4147-ad5c-c3bf1cc657c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:22.105463 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4169a-6772-4dc8-b55c-f9056d301dd8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:22.115617 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f1631c72-472e-4147-ad5c-c3bf1cc657c0 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:22.117249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f1631c72-472e-4147-ad5c-c3bf1cc657c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:22.163419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9c36f-6193-4f8b-afbd-0df59fa26b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:22.164139 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9c36f-6193-4f8b-afbd-0df59fa26b0c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:22.164511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9c36f-6193-4f8b-afbd-0df59fa26b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:22.164884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9c36f-6193-4f8b-afbd-0df59fa26b0c None admin] PATH_INFO: `/v3/groups/a079bbe0f83e4f009a081ad97f9bda48` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:22.179821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9c36f-6193-4f8b-afbd-0df59fa26b0c None admin] RBAC: Authorizing `identity:get_group(group_id=a079bbe0f83e4f009a081ad97f9bda48)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:22.181868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9c36f-6193-4f8b-afbd-0df59fa26b0c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:22.183594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 166/346] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:21 2022] GET /identity/v3/groups/a079bbe0f83e4f009a081ad97f9bda48 => generated 226 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:22.198775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9c36f-6193-4f8b-afbd-0df59fa26b0c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:22.264429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 181/347] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:22.354115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9c36f-6193-4f8b-afbd-0df59fa26b0c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:22.389868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1631c72-472e-4147-ad5c-c3bf1cc657c0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:22.404343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bdaeb-fc95-41c9-b92e-dfb5f6e770cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:22.404993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bdaeb-fc95-41c9-b92e-dfb5f6e770cf None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:22.405271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bdaeb-fc95-41c9-b92e-dfb5f6e770cf None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:22.405541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bdaeb-fc95-41c9-b92e-dfb5f6e770cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:22.408725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bdaeb-fc95-41c9-b92e-dfb5f6e770cf None admin] RBAC: Adding query filter params (group.id=a079bbe0f83e4f009a081ad97f9bda48, role.id=e43d5cbe01fb477f98fbe79db2fd2e5c, scope.project.id=0f6eedc7ec584320b4fdd810045aef8f) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:22.408725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bdaeb-fc95-41c9-b92e-dfb5f6e770cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:22.408725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bdaeb-fc95-41c9-b92e-dfb5f6e770cf None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:22.419273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:22.420555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 167/348] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 21 16:08:22 2022] GET /identity/v3/role_assignments?group.id=a079bbe0f83e4f009a081ad97f9bda48&scope.project.id=0f6eedc7ec584320b4fdd810045aef8f&role.id=e43d5cbe01fb477f98fbe79db2fd2e5c => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:22.539697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9ef11-a539-4a45-b0b4-8e39178fa641 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:22.539974 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9ef11-a539-4a45-b0b4-8e39178fa641 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:22.540490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9ef11-a539-4a45-b0b4-8e39178fa641 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:22.543291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 168/349] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:22.550263 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b8124-0b81-449b-b3ed-f3f113abb8cb None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:22.550881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b8124-0b81-449b-b3ed-f3f113abb8cb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:22.551373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b8124-0b81-449b-b3ed-f3f113abb8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:22.574130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-273b8124-0b81-449b-b3ed-f3f113abb8cb None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:22.576481 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-273b8124-0b81-449b-b3ed-f3f113abb8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:22.581397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:22.608976 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1631c72-472e-4147-ad5c-c3bf1cc657c0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:22.675500 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74867c24-cc2b-42a7-a0df-bbcc2c496e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:22.676159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74867c24-cc2b-42a7-a0df-bbcc2c496e58 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:22.676432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74867c24-cc2b-42a7-a0df-bbcc2c496e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:22.676712 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74867c24-cc2b-42a7-a0df-bbcc2c496e58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:22.701334 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74867c24-cc2b-42a7-a0df-bbcc2c496e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-74867c24-cc2b-42a7-a0df-bbcc2c496e58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:22.713333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:22.714645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:22.715443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:22.715443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:22.715443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:22.715443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:22.715443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:22.715443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:22.715443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:22.715443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:22.715443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:22.715443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:22.715443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:22.715443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:22.715443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 182/350] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:22.723286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74867c24-cc2b-42a7-a0df-bbcc2c496e58 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:22.747009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 169/351] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:08:22.773665 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b8124-0b81-449b-b3ed-f3f113abb8cb None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:22.854370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:22.897496 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74867c24-cc2b-42a7-a0df-bbcc2c496e58 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:22.940367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597b4b8-59b2-4f19-a7f3-eea360c91221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:22.941391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597b4b8-59b2-4f19-a7f3-eea360c91221 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:22.941903 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597b4b8-59b2-4f19-a7f3-eea360c91221 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:22.942504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597b4b8-59b2-4f19-a7f3-eea360c91221 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:22.943466 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597b4b8-59b2-4f19-a7f3-eea360c91221 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:22.943984 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597b4b8-59b2-4f19-a7f3-eea360c91221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:22.945761 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597b4b8-59b2-4f19-a7f3-eea360c91221 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:22.956734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 183/352] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:22.957964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597b4b8-59b2-4f19-a7f3-eea360c91221 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:22.970586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b8124-0b81-449b-b3ed-f3f113abb8cb None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:23.018379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da9692-6d95-44f6-9448-163a6e125b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:23.019544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9692-6d95-44f6-9448-163a6e125b5a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:23.020124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9692-6d95-44f6-9448-163a6e125b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:23.020581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9692-6d95-44f6-9448-163a6e125b5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:23.031164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:23.038613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da9692-6d95-44f6-9448-163a6e125b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-26da9692-6d95-44f6-9448-163a6e125b5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:23.045945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:23.047386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:23.048465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:23.048465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:23.048465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:23.048465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:23.048465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:23.048465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:23.048465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:23.048465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:23.048465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:23.048465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:23.048465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:23.048465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:23.056990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 170/353] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:08:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:08:23.059072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a54dd-0a71-444f-bebf-d9abe61f8430 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:23.059871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a54dd-0a71-444f-bebf-d9abe61f8430 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:23.060468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a54dd-0a71-444f-bebf-d9abe61f8430 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:23.063195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 171/354] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:23.066548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a54dd-0a71-444f-bebf-d9abe61f8430 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:23.078469 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597b4b8-59b2-4f19-a7f3-eea360c91221 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:23.114558 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:23.122583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9fe97-bca4-4f83-8ae3-b758b2dcb997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:23.123641 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9fe97-bca4-4f83-8ae3-b758b2dcb997 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:23.124101 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9fe97-bca4-4f83-8ae3-b758b2dcb997 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:23.124546 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9fe97-bca4-4f83-8ae3-b758b2dcb997 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:23.137329 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9fe97-bca4-4f83-8ae3-b758b2dcb997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2ef9fe97-bca4-4f83-8ae3-b758b2dcb997 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:23.143322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:23.144273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:23.145125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:23.145125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:23.145125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:23.145125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:23.145125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:23.145125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:23.145125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:23.145125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:23.145125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:23.145125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:23.145125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:23.145125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:23.146048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 184/355] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:08:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:23.147743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610f19e-0dd0-4383-9dae-e20b438f9cc8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:23.148865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610f19e-0dd0-4383-9dae-e20b438f9cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:23.149370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610f19e-0dd0-4383-9dae-e20b438f9cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:23.172390 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f610f19e-0dd0-4383-9dae-e20b438f9cc8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:23.174120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f610f19e-0dd0-4383-9dae-e20b438f9cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:23.245351 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a54dd-0a71-444f-bebf-d9abe61f8430 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:23.283518 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 185/356] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:23.285005 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610f19e-0dd0-4383-9dae-e20b438f9cc8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:23.314904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29981a-651c-4d68-ad92-f9b728d18055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:23.314904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29981a-651c-4d68-ad92-f9b728d18055 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:23.315170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29981a-651c-4d68-ad92-f9b728d18055 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:23.315590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29981a-651c-4d68-ad92-f9b728d18055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:23.442865 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:23.451621 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29981a-651c-4d68-ad92-f9b728d18055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:23.454979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29981a-651c-4d68-ad92-f9b728d18055 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:23.522554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610f19e-0dd0-4383-9dae-e20b438f9cc8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:23.598264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:23.605115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ce17d-2b7d-4041-a79d-8bc361e01a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:23.606145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ce17d-2b7d-4041-a79d-8bc361e01a8f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:23.606620 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ce17d-2b7d-4041-a79d-8bc361e01a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:23.607609 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ce17d-2b7d-4041-a79d-8bc361e01a8f None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:23.608385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ce17d-2b7d-4041-a79d-8bc361e01a8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:23.608953 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ce17d-2b7d-4041-a79d-8bc361e01a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:23.611535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ce17d-2b7d-4041-a79d-8bc361e01a8f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:23.632863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 186/357] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:08:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:23.634312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ce17d-2b7d-4041-a79d-8bc361e01a8f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:23.696867 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 172/358] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:23.699602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29981a-651c-4d68-ad92-f9b728d18055 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:23.873375 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ce17d-2b7d-4041-a79d-8bc361e01a8f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:23.930081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:23.937744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29981a-651c-4d68-ad92-f9b728d18055 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:23.956462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223639b-d871-4be8-87a6-388cf2a59375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:23.957049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223639b-d871-4be8-87a6-388cf2a59375 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:23.957345 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223639b-d871-4be8-87a6-388cf2a59375 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:23.957575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223639b-d871-4be8-87a6-388cf2a59375 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:23.972276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223639b-d871-4be8-87a6-388cf2a59375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d223639b-d871-4be8-87a6-388cf2a59375 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:23.978928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:23.980769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:23.982302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:23.982302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:23.982302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:23.982302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:23.982302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:23.982302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:23.982302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:23.982302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:23.982302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:23.982302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:23.982302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 16:08:23.982302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:23.982302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 187/359] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:23.982302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223639b-d871-4be8-87a6-388cf2a59375 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:24.007330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcedfda-98ac-4e66-b1f1-e200d13c2556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:24.008359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcedfda-98ac-4e66-b1f1-e200d13c2556 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:24.008905 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcedfda-98ac-4e66-b1f1-e200d13c2556 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:24.009351 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcedfda-98ac-4e66-b1f1-e200d13c2556 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:24.011050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcedfda-98ac-4e66-b1f1-e200d13c2556 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:24.011562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcedfda-98ac-4e66-b1f1-e200d13c2556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:24.014112 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcedfda-98ac-4e66-b1f1-e200d13c2556 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:24.032047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 173/360] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:08:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:24.033651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcedfda-98ac-4e66-b1f1-e200d13c2556 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:24.047116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:24.127894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223639b-d871-4be8-87a6-388cf2a59375 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:24.192015 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205eeccf-1af6-424f-9d85-8eda4055b4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:24.193042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eeccf-1af6-424f-9d85-8eda4055b4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:24.193555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eeccf-1af6-424f-9d85-8eda4055b4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:24.194019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eeccf-1af6-424f-9d85-8eda4055b4b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:24.248063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcedfda-98ac-4e66-b1f1-e200d13c2556 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:24.310955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb706d65-3191-4876-a3e3-921a73098bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:24.311857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb706d65-3191-4876-a3e3-921a73098bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:24.312304 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb706d65-3191-4876-a3e3-921a73098bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:24.312781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb706d65-3191-4876-a3e3-921a73098bc6 None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:24.314608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb706d65-3191-4876-a3e3-921a73098bc6 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:24.315017 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205eeccf-1af6-424f-9d85-8eda4055b4b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:24.317119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb706d65-3191-4876-a3e3-921a73098bc6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:24.317516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205eeccf-1af6-424f-9d85-8eda4055b4b4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:24.320080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 174/361] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:24 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:24.321226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb706d65-3191-4876-a3e3-921a73098bc6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:24.374632 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:24.389215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:24.469089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 188/362] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:24.473601 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205eeccf-1af6-424f-9d85-8eda4055b4b4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:24.509435 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb706d65-3191-4876-a3e3-921a73098bc6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:24.579187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471ec8d-0899-4007-a3ee-8f703eba7fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:24.580326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471ec8d-0899-4007-a3ee-8f703eba7fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:24.580973 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471ec8d-0899-4007-a3ee-8f703eba7fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:24.581248 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471ec8d-0899-4007-a3ee-8f703eba7fa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:24.592935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205eeccf-1af6-424f-9d85-8eda4055b4b4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:24.597627 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471ec8d-0899-4007-a3ee-8f703eba7fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-7471ec8d-0899-4007-a3ee-8f703eba7fa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:24.604434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:24.605585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:24.609144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:24.609144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:24.609144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:24.609144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:24.609144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:24.609144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:24.609144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:24.609144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:24.609144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:24.609144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:24.609144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:08:24.609144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:24.612998 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 175/363] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:08:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:24.613881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471ec8d-0899-4007-a3ee-8f703eba7fa9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:24.648136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e767a6-0fcd-4536-ba7e-9a86feb91a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:24.648870 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e767a6-0fcd-4536-ba7e-9a86feb91a9d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:24.649160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e767a6-0fcd-4536-ba7e-9a86feb91a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:24.649403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e767a6-0fcd-4536-ba7e-9a86feb91a9d None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:24.650670 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e767a6-0fcd-4536-ba7e-9a86feb91a9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:24.650993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e767a6-0fcd-4536-ba7e-9a86feb91a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:24.652623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e767a6-0fcd-4536-ba7e-9a86feb91a9d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:24.663474 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 189/364] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:24.664459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e767a6-0fcd-4536-ba7e-9a86feb91a9d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:24.675773 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:24.763865 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:24.790243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471ec8d-0899-4007-a3ee-8f703eba7fa9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:24.846128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e1545-fc6a-463c-982f-2e60969f1458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:24.846770 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e1545-fc6a-463c-982f-2e60969f1458 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:24.847043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e1545-fc6a-463c-982f-2e60969f1458 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:24.847358 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e1545-fc6a-463c-982f-2e60969f1458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:24.848748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e767a6-0fcd-4536-ba7e-9a86feb91a9d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:24.926791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53816f37-9782-49df-bccc-7a26dfd7bb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:24.929069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53816f37-9782-49df-bccc-7a26dfd7bb38 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:24.929792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53816f37-9782-49df-bccc-7a26dfd7bb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:24.930640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53816f37-9782-49df-bccc-7a26dfd7bb38 None admin] PATH_INFO: `/v3/groups/a079bbe0f83e4f009a081ad97f9bda48` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:24.933411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53816f37-9782-49df-bccc-7a26dfd7bb38 None admin] RBAC: Authorizing `identity:get_group(group_id=a079bbe0f83e4f009a081ad97f9bda48)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:24.935198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53816f37-9782-49df-bccc-7a26dfd7bb38 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:24.937472 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 190/365] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:24 2022] GET /identity/v3/groups/a079bbe0f83e4f009a081ad97f9bda48 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:24.938399 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53816f37-9782-49df-bccc-7a26dfd7bb38 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:24.973269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e1545-fc6a-463c-982f-2e60969f1458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:24.974962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e1545-fc6a-463c-982f-2e60969f1458 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:25.055878 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:25.094624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53816f37-9782-49df-bccc-7a26dfd7bb38 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:25.137009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:25.156338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877a569-74ee-419c-8b33-e6a78418821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:25.158855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877a569-74ee-419c-8b33-e6a78418821f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:25.159353 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877a569-74ee-419c-8b33-e6a78418821f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:25.159837 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877a569-74ee-419c-8b33-e6a78418821f None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:25.161905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877a569-74ee-419c-8b33-e6a78418821f None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:25.164620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 176/366] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:25.165234 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877a569-74ee-419c-8b33-e6a78418821f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:25.165545 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e1545-fc6a-463c-982f-2e60969f1458 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:25.169540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 191/367] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:24 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:25.176735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877a569-74ee-419c-8b33-e6a78418821f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:25.315546 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877a569-74ee-419c-8b33-e6a78418821f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:25.331110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e1545-fc6a-463c-982f-2e60969f1458 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:25.354057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ccc0f-9473-4b2c-8b85-86fe226547b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:25.355026 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ccc0f-9473-4b2c-8b85-86fe226547b9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:25.355305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ccc0f-9473-4b2c-8b85-86fe226547b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:25.355576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ccc0f-9473-4b2c-8b85-86fe226547b9 None admin] PATH_INFO: `/v3/users/d6047c919d9d4bb2bbc40c8e455142c4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:25.356803 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ccc0f-9473-4b2c-8b85-86fe226547b9 None admin] RBAC: Authorizing `identity:get_user(user_id=d6047c919d9d4bb2bbc40c8e455142c4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:25.359186 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ccc0f-9473-4b2c-8b85-86fe226547b9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:25.361347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 192/368] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:08:25 2022] GET /identity/v3/users/d6047c919d9d4bb2bbc40c8e455142c4 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:25.364528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ccc0f-9473-4b2c-8b85-86fe226547b9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:25.378266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:25.381504 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86bf2d-cd7e-4745-9957-a7d7b33c63d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:25.383192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86bf2d-cd7e-4745-9957-a7d7b33c63d9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:25.383969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86bf2d-cd7e-4745-9957-a7d7b33c63d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:25.384423 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86bf2d-cd7e-4745-9957-a7d7b33c63d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:25.385843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86bf2d-cd7e-4745-9957-a7d7b33c63d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:25.386476 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86bf2d-cd7e-4745-9957-a7d7b33c63d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:25.388518 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86bf2d-cd7e-4745-9957-a7d7b33c63d9 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:25.400292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 177/369] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:25.401676 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86bf2d-cd7e-4745-9957-a7d7b33c63d9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:25.463137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:25.496584 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ccc0f-9473-4b2c-8b85-86fe226547b9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:25.523479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86bf2d-cd7e-4745-9957-a7d7b33c63d9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:25.536052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe3eff-8821-4f21-9bde-af6ea747df3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:25.536736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3eff-8821-4f21-9bde-af6ea747df3e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:25.537059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3eff-8821-4f21-9bde-af6ea747df3e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:25.537424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3eff-8821-4f21-9bde-af6ea747df3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:25.538748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe3eff-8821-4f21-9bde-af6ea747df3e None admin] RBAC: Adding query filter params (group.id=a079bbe0f83e4f009a081ad97f9bda48, role.id=e43d5cbe01fb477f98fbe79db2fd2e5c, scope.project.id=aa4dda00a89f4cc49309ae81cc931005) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:25.538748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe3eff-8821-4f21-9bde-af6ea747df3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:25.540558 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe3eff-8821-4f21-9bde-af6ea747df3e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:25.547271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 193/370] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 21 16:08:25 2022] GET /identity/v3/role_assignments?group.id=a079bbe0f83e4f009a081ad97f9bda48&scope.project.id=aa4dda00a89f4cc49309ae81cc931005&role.id=e43d5cbe01fb477f98fbe79db2fd2e5c => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:25.547916 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe3eff-8821-4f21-9bde-af6ea747df3e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:25.584029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120e84b-1111-44ba-91e6-3fd658dc394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:25.584650 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120e84b-1111-44ba-91e6-3fd658dc394d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:25.584965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120e84b-1111-44ba-91e6-3fd658dc394d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:25.585284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120e84b-1111-44ba-91e6-3fd658dc394d None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:25.587478 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120e84b-1111-44ba-91e6-3fd658dc394d None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:25.590333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120e84b-1111-44ba-91e6-3fd658dc394d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:25.593815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 178/371] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:25 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:25.594798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120e84b-1111-44ba-91e6-3fd658dc394d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:25.675581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:25.711255 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe3eff-8821-4f21-9bde-af6ea747df3e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:25.742097 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120e84b-1111-44ba-91e6-3fd658dc394d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:25.754995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6f573-9d49-4fec-bc43-1926a235ff81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:25.755649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6f573-9d49-4fec-bc43-1926a235ff81 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:25.755998 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6f573-9d49-4fec-bc43-1926a235ff81 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:25.757404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6f573-9d49-4fec-bc43-1926a235ff81 None admin] PATH_INFO: `/v3/groups/a079bbe0f83e4f009a081ad97f9bda48` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:25.758697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6f573-9d49-4fec-bc43-1926a235ff81 None admin] RBAC: Authorizing `identity:get_group(group_id=a079bbe0f83e4f009a081ad97f9bda48)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:25.760730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6f573-9d49-4fec-bc43-1926a235ff81 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:25.763168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 194/372] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:25 2022] GET /identity/v3/groups/a079bbe0f83e4f009a081ad97f9bda48 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:25.763168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6f573-9d49-4fec-bc43-1926a235ff81 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:25.773866 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:25.794274 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dccea-492a-44ce-943b-8125094d8caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:25.794903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dccea-492a-44ce-943b-8125094d8caf None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:25.795183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dccea-492a-44ce-943b-8125094d8caf None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:25.795457 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dccea-492a-44ce-943b-8125094d8caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:25.796206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dccea-492a-44ce-943b-8125094d8caf None admin] RBAC: Adding query filter params (role.id=fa4637a31390472a99f691c8c7f995e8, user.id=d6047c919d9d4bb2bbc40c8e455142c4, scope.system=all) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:25.796517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dccea-492a-44ce-943b-8125094d8caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:25.798082 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dccea-492a-44ce-943b-8125094d8caf None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:25.811110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 179/373] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Sep 21 16:08:25 2022] GET /identity/v3/role_assignments?user.id=d6047c919d9d4bb2bbc40c8e455142c4&scope.system=all&role.id=fa4637a31390472a99f691c8c7f995e8 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:25.811967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dccea-492a-44ce-943b-8125094d8caf None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:25.912768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6f573-9d49-4fec-bc43-1926a235ff81 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:25.976288 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773b4fb-1ffd-42e9-81f5-809384db9669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:25.977036 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b4fb-1ffd-42e9-81f5-809384db9669 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:25.977285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b4fb-1ffd-42e9-81f5-809384db9669 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:25.977489 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b4fb-1ffd-42e9-81f5-809384db9669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:25.996952 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:26.017136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dccea-492a-44ce-943b-8125094d8caf None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:26.061031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c208b5-7c42-437a-9898-82da7d7b8577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:26.061679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c208b5-7c42-437a-9898-82da7d7b8577 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:26.061957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c208b5-7c42-437a-9898-82da7d7b8577 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:26.062230 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c208b5-7c42-437a-9898-82da7d7b8577 None admin] PATH_INFO: `/v3/groups/a079bbe0f83e4f009a081ad97f9bda48` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:26.064669 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c208b5-7c42-437a-9898-82da7d7b8577 None admin] RBAC: Authorizing `identity:get_group(group_id=a079bbe0f83e4f009a081ad97f9bda48)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:26.066183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c208b5-7c42-437a-9898-82da7d7b8577 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:26.067997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 180/374] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:25 2022] GET /identity/v3/groups/a079bbe0f83e4f009a081ad97f9bda48 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:26.068599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c208b5-7c42-437a-9898-82da7d7b8577 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:26.080858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773b4fb-1ffd-42e9-81f5-809384db9669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773b4fb-1ffd-42e9-81f5-809384db9669 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:26.120545 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:26.197782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c208b5-7c42-437a-9898-82da7d7b8577 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:26.225204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 195/375] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:26.226937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd4d36-8048-4266-abaf-6a19b57938cd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:26.227439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd4d36-8048-4266-abaf-6a19b57938cd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:26.227930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd4d36-8048-4266-abaf-6a19b57938cd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:26.230282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 196/376] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:26.231315 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd4d36-8048-4266-abaf-6a19b57938cd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:26.243186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad728182-055e-44be-aa15-797457796b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:26.243865 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728182-055e-44be-aa15-797457796b28 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:26.244144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728182-055e-44be-aa15-797457796b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:26.244417 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728182-055e-44be-aa15-797457796b28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:26.245273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad728182-055e-44be-aa15-797457796b28 None admin] RBAC: Adding query filter params (group.id=a079bbe0f83e4f009a081ad97f9bda48, role.id=fdf188800dba4eee980df53694a7ed69, scope.project.id=aa4dda00a89f4cc49309ae81cc931005) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:26.246628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad728182-055e-44be-aa15-797457796b28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:26.247815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad728182-055e-44be-aa15-797457796b28 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:26.257080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 181/377] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 21 16:08:26 2022] GET /identity/v3/role_assignments?group.id=a079bbe0f83e4f009a081ad97f9bda48&scope.project.id=aa4dda00a89f4cc49309ae81cc931005&role.id=fdf188800dba4eee980df53694a7ed69 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:26.258515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad728182-055e-44be-aa15-797457796b28 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:26.302499 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:26.373499 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd4d36-8048-4266-abaf-6a19b57938cd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:26.401498 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad728182-055e-44be-aa15-797457796b28 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:26.416622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325da4c1-ed3d-4707-bb09-3397c1d49264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:26.417286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325da4c1-ed3d-4707-bb09-3397c1d49264 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:26.417564 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325da4c1-ed3d-4707-bb09-3397c1d49264 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:26.417828 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325da4c1-ed3d-4707-bb09-3397c1d49264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:26.418571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325da4c1-ed3d-4707-bb09-3397c1d49264 None admin] RBAC: Adding query filter params (group.id=a079bbe0f83e4f009a081ad97f9bda48, role.id=fdf188800dba4eee980df53694a7ed69, scope.project.id=0f6eedc7ec584320b4fdd810045aef8f) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:26.418873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325da4c1-ed3d-4707-bb09-3397c1d49264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:26.420340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325da4c1-ed3d-4707-bb09-3397c1d49264 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:26.427824 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 197/378] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 21 16:08:26 2022] GET /identity/v3/role_assignments?group.id=a079bbe0f83e4f009a081ad97f9bda48&scope.project.id=0f6eedc7ec584320b4fdd810045aef8f&role.id=fdf188800dba4eee980df53694a7ed69 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:26.428492 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:26.433720 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94073bd0-75bc-4b30-bf27-6e3cf5c293b3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:26.434041 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94073bd0-75bc-4b30-bf27-6e3cf5c293b3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:26.434269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94073bd0-75bc-4b30-bf27-6e3cf5c293b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:26.466584 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-94073bd0-75bc-4b30-bf27-6e3cf5c293b3 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:26.467650 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-94073bd0-75bc-4b30-bf27-6e3cf5c293b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:26.531605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94221e8-de8e-4567-a3b0-73d5ebc350e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:26.532263 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94221e8-de8e-4567-a3b0-73d5ebc350e3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:26.532541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94221e8-de8e-4567-a3b0-73d5ebc350e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:26.532854 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94221e8-de8e-4567-a3b0-73d5ebc350e3 None admin] PATH_INFO: `/v3/projects/f8aed661a1ae4dc6adb9120d20a01acd` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:26.534062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94221e8-de8e-4567-a3b0-73d5ebc350e3 None admin] RBAC: Authorizing `identity:get_project(project_id=f8aed661a1ae4dc6adb9120d20a01acd)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:26.535575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94221e8-de8e-4567-a3b0-73d5ebc350e3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:26.537638 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 182/379] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:26 2022] GET /identity/v3/projects/f8aed661a1ae4dc6adb9120d20a01acd => generated 344 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:26.543601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94221e8-de8e-4567-a3b0-73d5ebc350e3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:26.567254 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 198/380] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:26.687837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94221e8-de8e-4567-a3b0-73d5ebc350e3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:26.731785 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88f74f-f6aa-4308-ac33-2ca49b79d05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:26.732357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88f74f-f6aa-4308-ac33-2ca49b79d05d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:26.732631 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88f74f-f6aa-4308-ac33-2ca49b79d05d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:26.732934 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88f74f-f6aa-4308-ac33-2ca49b79d05d None admin] PATH_INFO: `/v3/groups/459757b560ad4f7c989fc0f197202c36` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:26.739329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88f74f-f6aa-4308-ac33-2ca49b79d05d None admin] RBAC: Authorizing `identity:get_group(group_id=459757b560ad4f7c989fc0f197202c36)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:26.740864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88f74f-f6aa-4308-ac33-2ca49b79d05d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:26.742889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 183/381] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:26 2022] GET /identity/v3/groups/459757b560ad4f7c989fc0f197202c36 => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:26.749672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94073bd0-75bc-4b30-bf27-6e3cf5c293b3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:26.789375 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:26.862986 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94073bd0-75bc-4b30-bf27-6e3cf5c293b3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:26.904155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e71c6-5133-4930-a7a9-aedc9438825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:26.904862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e71c6-5133-4930-a7a9-aedc9438825b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:26.905151 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e71c6-5133-4930-a7a9-aedc9438825b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:26.905408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e71c6-5133-4930-a7a9-aedc9438825b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:26.907337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e71c6-5133-4930-a7a9-aedc9438825b None admin] RBAC: Adding query filter params (group.id=459757b560ad4f7c989fc0f197202c36, role.id=beec000223e041209205627bfa0dbed1, scope.project.id=f8aed661a1ae4dc6adb9120d20a01acd) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:26.907795 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e71c6-5133-4930-a7a9-aedc9438825b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:26.910252 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e71c6-5133-4930-a7a9-aedc9438825b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:26.921688 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 199/382] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 21 16:08:26 2022] GET /identity/v3/role_assignments?group.id=459757b560ad4f7c989fc0f197202c36&scope.project.id=f8aed661a1ae4dc6adb9120d20a01acd&role.id=beec000223e041209205627bfa0dbed1 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:27.091396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88f74f-f6aa-4308-ac33-2ca49b79d05d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:27.143270 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:27.215403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88f74f-f6aa-4308-ac33-2ca49b79d05d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:27.265758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c349d3-7ce4-4f87-af09-b17f865c4ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:27.266467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c349d3-7ce4-4f87-af09-b17f865c4ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:27.266749 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c349d3-7ce4-4f87-af09-b17f865c4ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:27.267015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c349d3-7ce4-4f87-af09-b17f865c4ad3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:27.282362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c349d3-7ce4-4f87-af09-b17f865c4ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-03c349d3-7ce4-4f87-af09-b17f865c4ad3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:27.287930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:27.288926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:27.289752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:27.289752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:27.289752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:27.289752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:27.289752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:27.289752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:27.289752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:27.289752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:27.289752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:27.289752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:27.289752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:27.289752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:27.289752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 184/383] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:27.296036 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e71c6-5133-4930-a7a9-aedc9438825b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:27.435492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:27.439184 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e71c6-5133-4930-a7a9-aedc9438825b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:27.507051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b2d2b-deae-436b-aa5c-2983aa48992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:27.507757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b2d2b-deae-436b-aa5c-2983aa48992c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:27.508032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b2d2b-deae-436b-aa5c-2983aa48992c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:27.508296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b2d2b-deae-436b-aa5c-2983aa48992c None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:27.509001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b2d2b-deae-436b-aa5c-2983aa48992c None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:27.509300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b2d2b-deae-436b-aa5c-2983aa48992c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:27.510752 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b2d2b-deae-436b-aa5c-2983aa48992c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:27.526116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 200/384] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:27.531878 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c349d3-7ce4-4f87-af09-b17f865c4ad3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:27.678464 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:27.682017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c349d3-7ce4-4f87-af09-b17f865c4ad3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:27.735258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d2a2c-9b1e-46a5-983f-64367d28e7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:27.736244 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d2a2c-9b1e-46a5-983f-64367d28e7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:27.736748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d2a2c-9b1e-46a5-983f-64367d28e7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:27.737278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d2a2c-9b1e-46a5-983f-64367d28e7f0 None admin] PATH_INFO: `/v3/groups/a079bbe0f83e4f009a081ad97f9bda48` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:27.739322 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d2a2c-9b1e-46a5-983f-64367d28e7f0 None admin] RBAC: Authorizing `identity:get_group(group_id=a079bbe0f83e4f009a081ad97f9bda48)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:27.742076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d2a2c-9b1e-46a5-983f-64367d28e7f0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:27.745224 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 185/385] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:27 2022] GET /identity/v3/groups/a079bbe0f83e4f009a081ad97f9bda48 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:27.754726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b2d2b-deae-436b-aa5c-2983aa48992c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:27.959999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b2d2b-deae-436b-aa5c-2983aa48992c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:28.045418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637fa72-5a93-4517-b75d-e6a18224f954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:28.046406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637fa72-5a93-4517-b75d-e6a18224f954 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:28.046875 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637fa72-5a93-4517-b75d-e6a18224f954 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:28.047355 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637fa72-5a93-4517-b75d-e6a18224f954 None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:28.049396 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637fa72-5a93-4517-b75d-e6a18224f954 None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:28.052202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637fa72-5a93-4517-b75d-e6a18224f954 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:28.055719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 201/386] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:27 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:28.065975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d2a2c-9b1e-46a5-983f-64367d28e7f0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:28.252406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d2a2c-9b1e-46a5-983f-64367d28e7f0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:28.320554 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa3b4c-3bdd-4dd2-8780-d6eafb69c76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:28.321651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa3b4c-3bdd-4dd2-8780-d6eafb69c76b None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:28.322175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa3b4c-3bdd-4dd2-8780-d6eafb69c76b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:28.322662 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa3b4c-3bdd-4dd2-8780-d6eafb69c76b None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f/groups/a079bbe0f83e4f009a081ad97f9bda48/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:28.326554 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa3b4c-3bdd-4dd2-8780-d6eafb69c76b None admin] RBAC: Authorizing `identity:create_grant(project_id=0f6eedc7ec584320b4fdd810045aef8f, group_id=a079bbe0f83e4f009a081ad97f9bda48, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:28.329338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa3b4c-3bdd-4dd2-8780-d6eafb69c76b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:28.362979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 186/387] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 21 16:08:28 2022] PUT /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f/groups/a079bbe0f83e4f009a081ad97f9bda48/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:08:29.176778 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3328dcb-c6fa-45d4-89f1-11ebdb829a54 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:29.178472 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3328dcb-c6fa-45d4-89f1-11ebdb829a54 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:29.179239 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3328dcb-c6fa-45d4-89f1-11ebdb829a54 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:29.182571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 202/388] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:29.188900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fc4a1-4a3f-4f74-88a1-626906abfd49 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:29.190292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fc4a1-4a3f-4f74-88a1-626906abfd49 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:29.191033 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fc4a1-4a3f-4f74-88a1-626906abfd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:29.233218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-765fc4a1-4a3f-4f74-88a1-626906abfd49 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:29.234937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-765fc4a1-4a3f-4f74-88a1-626906abfd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:29.293779 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:29.378439 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 187/389] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:29.654115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cfc71-73b0-45a9-bae2-21deff259e2d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:29.655143 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cfc71-73b0-45a9-bae2-21deff259e2d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:29.655901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cfc71-73b0-45a9-bae2-21deff259e2d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:29.659115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 203/390] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:29.664392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784eac1-3d8d-413e-aed6-ab815a19a7d2 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:29.664649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784eac1-3d8d-413e-aed6-ab815a19a7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:29.664947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784eac1-3d8d-413e-aed6-ab815a19a7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:29.696530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5784eac1-3d8d-413e-aed6-ab815a19a7d2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:29.698637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5784eac1-3d8d-413e-aed6-ab815a19a7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:29.734183 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cfc71-73b0-45a9-bae2-21deff259e2d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:29.805121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 188/391] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:29.817360 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:30.014358 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded183ee-8f85-49b8-bba1-518ee7592bb8 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:30.014863 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded183ee-8f85-49b8-bba1-518ee7592bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:30.015282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded183ee-8f85-49b8-bba1-518ee7592bb8 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:30.017405 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 189/392] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:30.020768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cfc71-73b0-45a9-bae2-21deff259e2d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:30.034626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591e2e4-09c6-49e8-bbbc-634798a61f68 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:30.035152 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591e2e4-09c6-49e8-bbbc-634798a61f68 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:30.035574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591e2e4-09c6-49e8-bbbc-634798a61f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:30.068703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7591e2e4-09c6-49e8-bbbc-634798a61f68 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:30.076718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7591e2e4-09c6-49e8-bbbc-634798a61f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:30.086597 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f845b-b939-47e8-b396-2c0a504b0aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:30.091779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f845b-b939-47e8-b396-2c0a504b0aff None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:30.091779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f845b-b939-47e8-b396-2c0a504b0aff None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:30.091779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f845b-b939-47e8-b396-2c0a504b0aff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:30.111066 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f845b-b939-47e8-b396-2c0a504b0aff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-344f845b-b939-47e8-b396-2c0a504b0aff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:30.122780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:30.123794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:30.125195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:30.125195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:30.125195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:30.125195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:30.125195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:30.125195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:30.125195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:30.125195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:30.125195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:30.125195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:30.125195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:30.125195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:30.125880 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 204/393] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:08:30.138265 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f845b-b939-47e8-b396-2c0a504b0aff None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:30.182177 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 190/394] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:30.321031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:30.342288 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f845b-b939-47e8-b396-2c0a504b0aff None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:30.411118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af007395-003e-4c54-95da-011c74b5b14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:30.412506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af007395-003e-4c54-95da-011c74b5b14d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:30.413218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af007395-003e-4c54-95da-011c74b5b14d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:30.413910 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af007395-003e-4c54-95da-011c74b5b14d None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:30.415430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af007395-003e-4c54-95da-011c74b5b14d None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:30.416989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af007395-003e-4c54-95da-011c74b5b14d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:30.419913 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af007395-003e-4c54-95da-011c74b5b14d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:30.438014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 205/395] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:30.450951 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591e2e4-09c6-49e8-bbbc-634798a61f68 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:30.472313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af007395-003e-4c54-95da-011c74b5b14d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:30.501551 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:30.637375 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af007395-003e-4c54-95da-011c74b5b14d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:30.670874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591e2e4-09c6-49e8-bbbc-634798a61f68 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:30.683456 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e01b86-c170-4ef3-aea0-5e5904342bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:30.684416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e01b86-c170-4ef3-aea0-5e5904342bcd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:30.684910 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e01b86-c170-4ef3-aea0-5e5904342bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:30.685348 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e01b86-c170-4ef3-aea0-5e5904342bcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:30.713491 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e01b86-c170-4ef3-aea0-5e5904342bcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-08e01b86-c170-4ef3-aea0-5e5904342bcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:30.727320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:30.728960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:30.729794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:30.729794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:30.729794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:30.729794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:30.729794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:30.729794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:30.729794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:30.729794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:30.729794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:30.729794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:30.729794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:30.729794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:30.730430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50c5a2-3c95-4465-8f50-3234b6d73966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:30.730430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50c5a2-3c95-4465-8f50-3234b6d73966 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:30.730430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50c5a2-3c95-4465-8f50-3234b6d73966 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:30.730651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 206/396] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:08:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:30.732612 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a35530-7dcd-4f7b-8955-49db76ef5619 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:30.733123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a35530-7dcd-4f7b-8955-49db76ef5619 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:30.733600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a35530-7dcd-4f7b-8955-49db76ef5619 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:30.740464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 207/397] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:30.740811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50c5a2-3c95-4465-8f50-3234b6d73966 None admin] PATH_INFO: `/v3/groups/a079bbe0f83e4f009a081ad97f9bda48` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:30.740995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a35530-7dcd-4f7b-8955-49db76ef5619 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:30.741152 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50c5a2-3c95-4465-8f50-3234b6d73966 None admin] RBAC: Authorizing `identity:get_group(group_id=a079bbe0f83e4f009a081ad97f9bda48)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:30.742532 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50c5a2-3c95-4465-8f50-3234b6d73966 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:30.745753 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 191/398] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:30 2022] GET /identity/v3/groups/a079bbe0f83e4f009a081ad97f9bda48 => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:30.750618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598a892-0327-4684-9b98-9b4ceb06d046 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:30.750618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598a892-0327-4684-9b98-9b4ceb06d046 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:30.750618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598a892-0327-4684-9b98-9b4ceb06d046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:30.767086 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:30.773605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0598a892-0327-4684-9b98-9b4ceb06d046 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:30.774822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0598a892-0327-4684-9b98-9b4ceb06d046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:30.892966 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a35530-7dcd-4f7b-8955-49db76ef5619 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:30.908778 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 192/399] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:30.908778 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598a892-0327-4684-9b98-9b4ceb06d046 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:30.958607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dbe7b-679d-4cd6-931b-8229d41fd1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:30.959335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dbe7b-679d-4cd6-931b-8229d41fd1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:30.959623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dbe7b-679d-4cd6-931b-8229d41fd1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:30.959924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dbe7b-679d-4cd6-931b-8229d41fd1f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:30.973050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:30.973487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dbe7b-679d-4cd6-931b-8229d41fd1f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5c1dbe7b-679d-4cd6-931b-8229d41fd1f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:30.979793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:30.980817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:30.981632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:30.981632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:30.981632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:30.981632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:30.981632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:30.981632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:30.981632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:30.981632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:30.981632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:30.981632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:30.981632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:30.981632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:30.984341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 208/400] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:08:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:30.985458 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dbe7b-679d-4cd6-931b-8229d41fd1f9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:31.125994 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598a892-0327-4684-9b98-9b4ceb06d046 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:31.129369 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:31.167035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec3444-ba83-41a3-b5d6-48476a09805e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:31.167953 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec3444-ba83-41a3-b5d6-48476a09805e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:31.168395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec3444-ba83-41a3-b5d6-48476a09805e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:31.168888 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec3444-ba83-41a3-b5d6-48476a09805e None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:31.169764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec3444-ba83-41a3-b5d6-48476a09805e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:31.170264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec3444-ba83-41a3-b5d6-48476a09805e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:31.171948 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec3444-ba83-41a3-b5d6-48476a09805e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:31.186688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 193/401] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:08:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:31.187998 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec3444-ba83-41a3-b5d6-48476a09805e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:31.190947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dbe7b-679d-4cd6-931b-8229d41fd1f9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:31.255317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6498c3-3e04-450e-ab3b-6be87af32ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:31.256383 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6498c3-3e04-450e-ab3b-6be87af32ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:31.256937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6498c3-3e04-450e-ab3b-6be87af32ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:31.257684 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6498c3-3e04-450e-ab3b-6be87af32ff9 None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:31.260168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6498c3-3e04-450e-ab3b-6be87af32ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:31.263286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6498c3-3e04-450e-ab3b-6be87af32ff9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:31.272866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 209/402] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:30 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:31.274917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6498c3-3e04-450e-ab3b-6be87af32ff9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:31.289222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:31.316120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec3444-ba83-41a3-b5d6-48476a09805e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:31.357831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c32a70-3825-4178-9dfd-4aa7806f240b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:31.358702 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c32a70-3825-4178-9dfd-4aa7806f240b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:31.359166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c32a70-3825-4178-9dfd-4aa7806f240b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:31.359585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c32a70-3825-4178-9dfd-4aa7806f240b None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:31.360416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c32a70-3825-4178-9dfd-4aa7806f240b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:31.360911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c32a70-3825-4178-9dfd-4aa7806f240b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:31.362457 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c32a70-3825-4178-9dfd-4aa7806f240b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:31.372443 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 194/403] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:08:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:31.373655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c32a70-3825-4178-9dfd-4aa7806f240b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:31.454362 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6498c3-3e04-450e-ab3b-6be87af32ff9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:31.499549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c32a70-3825-4178-9dfd-4aa7806f240b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:31.517986 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025511e-1862-4201-b48a-a268ff431463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:31.519025 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025511e-1862-4201-b48a-a268ff431463 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:31.519508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025511e-1862-4201-b48a-a268ff431463 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:31.519987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025511e-1862-4201-b48a-a268ff431463 None admin] PATH_INFO: `/v3/groups/a079bbe0f83e4f009a081ad97f9bda48` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:31.522002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025511e-1862-4201-b48a-a268ff431463 None admin] RBAC: Authorizing `identity:get_group(group_id=a079bbe0f83e4f009a081ad97f9bda48)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:31.524765 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025511e-1862-4201-b48a-a268ff431463 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:31.532739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 210/404] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:31 2022] GET /identity/v3/groups/a079bbe0f83e4f009a081ad97f9bda48 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:31.532739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025511e-1862-4201-b48a-a268ff431463 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:31.545849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a23d7d-4838-4fd6-b244-72c3f4fd38e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:31.546576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a23d7d-4838-4fd6-b244-72c3f4fd38e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:31.546977 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a23d7d-4838-4fd6-b244-72c3f4fd38e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:31.547219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a23d7d-4838-4fd6-b244-72c3f4fd38e2 None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005/groups/a079bbe0f83e4f009a081ad97f9bda48/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:31.549409 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a23d7d-4838-4fd6-b244-72c3f4fd38e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa4dda00a89f4cc49309ae81cc931005, group_id=a079bbe0f83e4f009a081ad97f9bda48, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:31.550890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a23d7d-4838-4fd6-b244-72c3f4fd38e2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:31.553372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:31.564235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:31.569790 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 195/405] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 21 16:08:31 2022] PUT /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005/groups/a079bbe0f83e4f009a081ad97f9bda48/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:08:31.571086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a23d7d-4838-4fd6-b244-72c3f4fd38e2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:31.695242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025511e-1862-4201-b48a-a268ff431463 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:31.741464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fa4ae-08ae-4226-9b06-aa28b6d88361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:31.742443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fa4ae-08ae-4226-9b06-aa28b6d88361 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:31.742876 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fa4ae-08ae-4226-9b06-aa28b6d88361 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:31.743356 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fa4ae-08ae-4226-9b06-aa28b6d88361 None admin] PATH_INFO: `/v3/groups/a079bbe0f83e4f009a081ad97f9bda48` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:31.744969 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fa4ae-08ae-4226-9b06-aa28b6d88361 None admin] RBAC: Authorizing `identity:get_group(group_id=a079bbe0f83e4f009a081ad97f9bda48)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:31.746614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fa4ae-08ae-4226-9b06-aa28b6d88361 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:31.749551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 211/406] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:31 2022] GET /identity/v3/groups/a079bbe0f83e4f009a081ad97f9bda48 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:31.750712 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fa4ae-08ae-4226-9b06-aa28b6d88361 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:31.785925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a23d7d-4838-4fd6-b244-72c3f4fd38e2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:31.846223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a471a9-98f7-4545-aebc-d3d9bae29542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:31.847104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a471a9-98f7-4545-aebc-d3d9bae29542 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:31.847488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a471a9-98f7-4545-aebc-d3d9bae29542 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:31.847862 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a471a9-98f7-4545-aebc-d3d9bae29542 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:31.855200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:31.865472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a471a9-98f7-4545-aebc-d3d9bae29542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-51a471a9-98f7-4545-aebc-d3d9bae29542 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:31.872536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:31.874415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:31.875993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:31.875993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:31.875993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:31.875993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:31.875993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:31.875993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:31.875993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:31.875993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:31.875993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:31.875993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:31.875993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:08:31.875993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:31.875993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 196/407] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:08:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:31.875993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a471a9-98f7-4545-aebc-d3d9bae29542 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:31.897739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fa4ae-08ae-4226-9b06-aa28b6d88361 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:31.964554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26753f7-f251-40f9-8678-5e48f8007a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:31.965634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26753f7-f251-40f9-8678-5e48f8007a62 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:31.966132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26753f7-f251-40f9-8678-5e48f8007a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:31.966624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26753f7-f251-40f9-8678-5e48f8007a62 None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:31.968878 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26753f7-f251-40f9-8678-5e48f8007a62 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:31.971486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26753f7-f251-40f9-8678-5e48f8007a62 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:31.983170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 212/408] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:31 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:31.983170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4a86c-1eb3-44f2-888c-3a8607cd3ef1 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:31.983170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4a86c-1eb3-44f2-888c-3a8607cd3ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:31.983170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4a86c-1eb3-44f2-888c-3a8607cd3ef1 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:31.983170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 213/409] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:31.983170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4a86c-1eb3-44f2-888c-3a8607cd3ef1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:31.990319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:32.066586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a471a9-98f7-4545-aebc-d3d9bae29542 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:32.141254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dad7f4-fa7c-4aaa-8f80-a39f8a66160c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:32.142328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dad7f4-fa7c-4aaa-8f80-a39f8a66160c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:32.142800 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dad7f4-fa7c-4aaa-8f80-a39f8a66160c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:32.143347 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dad7f4-fa7c-4aaa-8f80-a39f8a66160c None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:32.145473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dad7f4-fa7c-4aaa-8f80-a39f8a66160c None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:32.148172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dad7f4-fa7c-4aaa-8f80-a39f8a66160c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:32.157181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 197/410] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:31 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:32.158619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4a86c-1eb3-44f2-888c-3a8607cd3ef1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:32.158766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dad7f4-fa7c-4aaa-8f80-a39f8a66160c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:32.216218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e43d8-f1c5-4710-8072-7e220fde52c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:32.217305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e43d8-f1c5-4710-8072-7e220fde52c0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:32.217618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e43d8-f1c5-4710-8072-7e220fde52c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:32.218043 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e43d8-f1c5-4710-8072-7e220fde52c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:32.219112 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e43d8-f1c5-4710-8072-7e220fde52c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:32.219936 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e43d8-f1c5-4710-8072-7e220fde52c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:32.221974 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e43d8-f1c5-4710-8072-7e220fde52c0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:32.244325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 214/411] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:32.244325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98195a27-1e1e-4386-a1aa-7c08ddfad7a2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:32.244325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98195a27-1e1e-4386-a1aa-7c08ddfad7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:32.244325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98195a27-1e1e-4386-a1aa-7c08ddfad7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:32.260388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:32.268369 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-98195a27-1e1e-4386-a1aa-7c08ddfad7a2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:32.271088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-98195a27-1e1e-4386-a1aa-7c08ddfad7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:32.400723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 215/412] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:32.401002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dad7f4-fa7c-4aaa-8f80-a39f8a66160c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:32.401206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98195a27-1e1e-4386-a1aa-7c08ddfad7a2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:32.448405 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:32.470687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b16af-f74d-4baf-b14b-d13bb869cb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:32.471640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b16af-f74d-4baf-b14b-d13bb869cb6d None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:32.472077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b16af-f74d-4baf-b14b-d13bb869cb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:32.472452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b16af-f74d-4baf-b14b-d13bb869cb6d None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005/groups/a079bbe0f83e4f009a081ad97f9bda48/roles/fdf188800dba4eee980df53694a7ed69` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:32.475983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b16af-f74d-4baf-b14b-d13bb869cb6d None admin] RBAC: Authorizing `identity:create_grant(project_id=aa4dda00a89f4cc49309ae81cc931005, group_id=a079bbe0f83e4f009a081ad97f9bda48, role_id=fdf188800dba4eee980df53694a7ed69)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:32.480186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b16af-f74d-4baf-b14b-d13bb869cb6d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:32.512737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 198/413] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 21 16:08:32 2022] PUT /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005/groups/a079bbe0f83e4f009a081ad97f9bda48/roles/fdf188800dba4eee980df53694a7ed69 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:08:32.512737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b16af-f74d-4baf-b14b-d13bb869cb6d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:32.643238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98195a27-1e1e-4386-a1aa-7c08ddfad7a2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:32.699494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56a48e-8712-4e53-a421-6996ff9e28ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:32.700145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56a48e-8712-4e53-a421-6996ff9e28ed None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:32.700408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56a48e-8712-4e53-a421-6996ff9e28ed None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:32.700764 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56a48e-8712-4e53-a421-6996ff9e28ed None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f/groups/a079bbe0f83e4f009a081ad97f9bda48/roles/fdf188800dba4eee980df53694a7ed69` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:32.703793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56a48e-8712-4e53-a421-6996ff9e28ed None admin] RBAC: Authorizing `identity:create_grant(project_id=0f6eedc7ec584320b4fdd810045aef8f, group_id=a079bbe0f83e4f009a081ad97f9bda48, role_id=fdf188800dba4eee980df53694a7ed69)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:32.705304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56a48e-8712-4e53-a421-6996ff9e28ed None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:32.709241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:32.728680 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 216/414] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 21 16:08:32 2022] PUT /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f/groups/a079bbe0f83e4f009a081ad97f9bda48/roles/fdf188800dba4eee980df53694a7ed69 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:08:32.812253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b16af-f74d-4baf-b14b-d13bb869cb6d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:32.889891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56a48e-8712-4e53-a421-6996ff9e28ed None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:32.891291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070dab1-3553-40cf-ae7d-830067126d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:32.892057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070dab1-3553-40cf-ae7d-830067126d58 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:32.892400 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070dab1-3553-40cf-ae7d-830067126d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:32.894090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070dab1-3553-40cf-ae7d-830067126d58 None admin] PATH_INFO: `/v3/groups/459757b560ad4f7c989fc0f197202c36` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:32.898216 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070dab1-3553-40cf-ae7d-830067126d58 None admin] RBAC: Authorizing `identity:get_group(group_id=459757b560ad4f7c989fc0f197202c36)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:32.902059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070dab1-3553-40cf-ae7d-830067126d58 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:32.908054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 199/415] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:32 2022] GET /identity/v3/groups/459757b560ad4f7c989fc0f197202c36 => generated 229 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:32.919018 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070dab1-3553-40cf-ae7d-830067126d58 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:33.086528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:33.157398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56a48e-8712-4e53-a421-6996ff9e28ed None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:33.239976 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070dab1-3553-40cf-ae7d-830067126d58 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:33.278498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bcd54-9c34-4033-8c68-78ed963c0b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:33.279151 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bcd54-9c34-4033-8c68-78ed963c0b2a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:33.279438 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bcd54-9c34-4033-8c68-78ed963c0b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:33.279677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bcd54-9c34-4033-8c68-78ed963c0b2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:33.318307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bcd54-9c34-4033-8c68-78ed963c0b2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:33.327002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add04f7e-2a19-4fb6-a55b-3ffa796372f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:33.328085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add04f7e-2a19-4fb6-a55b-3ffa796372f3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:33.328548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add04f7e-2a19-4fb6-a55b-3ffa796372f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:33.329059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add04f7e-2a19-4fb6-a55b-3ffa796372f3 None admin] PATH_INFO: `/v3/projects/f8aed661a1ae4dc6adb9120d20a01acd` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:33.331136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add04f7e-2a19-4fb6-a55b-3ffa796372f3 None admin] RBAC: Authorizing `identity:get_project(project_id=f8aed661a1ae4dc6adb9120d20a01acd)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:33.333976 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add04f7e-2a19-4fb6-a55b-3ffa796372f3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-583bcd54-9c34-4033-8c68-78ed963c0b2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:33.340268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:33.342069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:33.343719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:33.343719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:33.343719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:33.343719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:33.343719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:33.343719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:33.343719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:33.343719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:33.343719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:33.343719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:33.343719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:33.343719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:33.348722 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 200/416] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:32 2022] GET /identity/v3/projects/f8aed661a1ae4dc6adb9120d20a01acd => generated 344 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:33.349034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 217/417] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 458 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:33.351049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add04f7e-2a19-4fb6-a55b-3ffa796372f3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:33.353307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bcd54-9c34-4033-8c68-78ed963c0b2a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:33.552507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:33.616816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add04f7e-2a19-4fb6-a55b-3ffa796372f3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:33.666483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:33.685600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bcd54-9c34-4033-8c68-78ed963c0b2a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:33.695702 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7166b9-a367-4f36-9681-d69a8ebde7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:33.696622 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7166b9-a367-4f36-9681-d69a8ebde7cb None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:33.705435 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7166b9-a367-4f36-9681-d69a8ebde7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:33.705943 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7166b9-a367-4f36-9681-d69a8ebde7cb None admin] PATH_INFO: `/v3/projects/f8aed661a1ae4dc6adb9120d20a01acd/groups/459757b560ad4f7c989fc0f197202c36/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:33.709793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7166b9-a367-4f36-9681-d69a8ebde7cb None admin] RBAC: Authorizing `identity:create_grant(project_id=f8aed661a1ae4dc6adb9120d20a01acd, group_id=459757b560ad4f7c989fc0f197202c36, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:33.712179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7166b9-a367-4f36-9681-d69a8ebde7cb None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:33.766845 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 201/418] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 21 16:08:33 2022] PUT /identity/v3/projects/f8aed661a1ae4dc6adb9120d20a01acd/groups/459757b560ad4f7c989fc0f197202c36/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:08:33.798999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfecbbb-7e8c-4971-9b3b-790af9e985ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:33.799888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfecbbb-7e8c-4971-9b3b-790af9e985ca None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:33.800280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfecbbb-7e8c-4971-9b3b-790af9e985ca None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:33.800657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfecbbb-7e8c-4971-9b3b-790af9e985ca None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:33.801779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfecbbb-7e8c-4971-9b3b-790af9e985ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:33.802256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfecbbb-7e8c-4971-9b3b-790af9e985ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:33.804519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfecbbb-7e8c-4971-9b3b-790af9e985ca None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:33.826084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 218/419] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:33.836957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7166b9-a367-4f36-9681-d69a8ebde7cb None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:34.112592 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7166b9-a367-4f36-9681-d69a8ebde7cb None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:34.181217 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20921149-9b77-4eb2-98d7-80b28727b22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:34.182671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20921149-9b77-4eb2-98d7-80b28727b22e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:34.183439 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20921149-9b77-4eb2-98d7-80b28727b22e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:34.184179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20921149-9b77-4eb2-98d7-80b28727b22e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:34.296309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:34.340546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20921149-9b77-4eb2-98d7-80b28727b22e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:34.343536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20921149-9b77-4eb2-98d7-80b28727b22e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:34.483408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cd310-da09-4643-b66a-4701d03ede2f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:34.483872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cd310-da09-4643-b66a-4701d03ede2f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:34.484180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cd310-da09-4643-b66a-4701d03ede2f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:34.486707 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 219/420] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:08:34.512608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53894b-3742-4f19-b612-4b5a5299fda2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:34.513017 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53894b-3742-4f19-b612-4b5a5299fda2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:34.513163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53894b-3742-4f19-b612-4b5a5299fda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:34.548020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5f53894b-3742-4f19-b612-4b5a5299fda2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:34.549924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5f53894b-3742-4f19-b612-4b5a5299fda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:34.574333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 202/421] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:34.581864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20921149-9b77-4eb2-98d7-80b28727b22e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:34.690724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 220/422] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:34.836448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:34.879975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20921149-9b77-4eb2-98d7-80b28727b22e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:34.973677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f38f3-ef38-4cd6-bdef-3133618567e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:34.974711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f38f3-ef38-4cd6-bdef-3133618567e7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:34.975179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f38f3-ef38-4cd6-bdef-3133618567e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:34.975646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f38f3-ef38-4cd6-bdef-3133618567e7 None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:34.982027 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f38f3-ef38-4cd6-bdef-3133618567e7 None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:34.984795 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f38f3-ef38-4cd6-bdef-3133618567e7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:34.988246 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 203/423] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:34 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:34.997948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53894b-3742-4f19-b612-4b5a5299fda2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:35.097522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:35.143796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f38f3-ef38-4cd6-bdef-3133618567e7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:35.193488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53894b-3742-4f19-b612-4b5a5299fda2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:35.263238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e48956-225e-4bd8-80c4-7977ad1be8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:35.264309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e48956-225e-4bd8-80c4-7977ad1be8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:35.264831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e48956-225e-4bd8-80c4-7977ad1be8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:35.265325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e48956-225e-4bd8-80c4-7977ad1be8e4 None admin] PATH_INFO: `/v3/groups/a079bbe0f83e4f009a081ad97f9bda48` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:35.267855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e48956-225e-4bd8-80c4-7977ad1be8e4 None admin] RBAC: Authorizing `identity:get_group(group_id=a079bbe0f83e4f009a081ad97f9bda48)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:35.271825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e48956-225e-4bd8-80c4-7977ad1be8e4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:35.273825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 221/424] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:34 2022] GET /identity/v3/groups/a079bbe0f83e4f009a081ad97f9bda48 => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:35.286585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e48956-225e-4bd8-80c4-7977ad1be8e4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:35.457694 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f38f3-ef38-4cd6-bdef-3133618567e7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:35.479290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e48956-225e-4bd8-80c4-7977ad1be8e4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:35.518221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:35.550340 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11695c61-8f4a-4c91-bc29-9accebe1df57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:35.551105 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695c61-8f4a-4c91-bc29-9accebe1df57 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:35.551382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695c61-8f4a-4c91-bc29-9accebe1df57 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:35.551730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695c61-8f4a-4c91-bc29-9accebe1df57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:35.568991 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1b24a-ba31-43f3-aecb-21337a93aa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:35.570354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1b24a-ba31-43f3-aecb-21337a93aa34 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:35.573351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1b24a-ba31-43f3-aecb-21337a93aa34 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:35.573862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1b24a-ba31-43f3-aecb-21337a93aa34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:35.575639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1b24a-ba31-43f3-aecb-21337a93aa34 None admin] RBAC: Adding query filter params (group.id=a079bbe0f83e4f009a081ad97f9bda48, role.id=e43d5cbe01fb477f98fbe79db2fd2e5c, scope.project.id=0f6eedc7ec584320b4fdd810045aef8f) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:35.576145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1b24a-ba31-43f3-aecb-21337a93aa34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:35.578072 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1b24a-ba31-43f3-aecb-21337a93aa34 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:35.585485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11695c61-8f4a-4c91-bc29-9accebe1df57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-11695c61-8f4a-4c91-bc29-9accebe1df57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:35.594253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:35.595968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:35.597394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:35.597394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:35.597394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:35.597394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:35.597394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:35.597394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:35.597394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:35.597394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:35.597394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:35.597394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:35.597394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 16:08:35.597394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:35.602086 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 222/425] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 21 16:08:35 2022] GET /identity/v3/role_assignments?group.id=a079bbe0f83e4f009a081ad97f9bda48&scope.project.id=0f6eedc7ec584320b4fdd810045aef8f&role.id=e43d5cbe01fb477f98fbe79db2fd2e5c => generated 611 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:35.602450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 204/426] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 460 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:35.606478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1b24a-ba31-43f3-aecb-21337a93aa34 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:35.785191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1b24a-ba31-43f3-aecb-21337a93aa34 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:35.839664 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04348-dc50-4442-ad38-3d55f8f26831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:35.840292 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04348-dc50-4442-ad38-3d55f8f26831 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:35.840581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04348-dc50-4442-ad38-3d55f8f26831 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:35.840875 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04348-dc50-4442-ad38-3d55f8f26831 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:35.841564 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f04348-dc50-4442-ad38-3d55f8f26831 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:35.841871 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f04348-dc50-4442-ad38-3d55f8f26831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:35.843266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f04348-dc50-4442-ad38-3d55f8f26831 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:35.857967 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 223/427] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:08:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:35.864338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11695c61-8f4a-4c91-bc29-9accebe1df57 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:35.902467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:36.057992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11695c61-8f4a-4c91-bc29-9accebe1df57 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:36.102249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd8cd6-5017-4744-8242-fd41dc081490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:36.103504 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8cd6-5017-4744-8242-fd41dc081490 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:36.103824 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8cd6-5017-4744-8242-fd41dc081490 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:36.104100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8cd6-5017-4744-8242-fd41dc081490 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:36.142126 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea172c-c2db-4669-8e38-8005518e0940 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:36.142477 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea172c-c2db-4669-8e38-8005518e0940 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:36.142725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea172c-c2db-4669-8e38-8005518e0940 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:36.144413 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 224/428] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:36.150521 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a9031-97f9-4d1a-8048-e7b1b8d2b9fd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:36.150821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a9031-97f9-4d1a-8048-e7b1b8d2b9fd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:36.151065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a9031-97f9-4d1a-8048-e7b1b8d2b9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:36.182695 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ef9a9031-97f9-4d1a-8048-e7b1b8d2b9fd None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:36.184914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ef9a9031-97f9-4d1a-8048-e7b1b8d2b9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:36.185431 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd8cd6-5017-4744-8242-fd41dc081490 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:36.186937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd8cd6-5017-4744-8242-fd41dc081490 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:36.202906 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:36.257118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:36.303130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 205/429] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 16:08:36.304771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 225/430] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:36.309801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd8cd6-5017-4744-8242-fd41dc081490 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:36.404317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76812c67-c018-41bb-9e0d-425c4018eae3 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:36.404844 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76812c67-c018-41bb-9e0d-425c4018eae3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:36.405290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76812c67-c018-41bb-9e0d-425c4018eae3 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:36.407726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 226/431] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:36.414297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69094a-ff28-4980-b215-72a11d9bbf0b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:36.414726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69094a-ff28-4980-b215-72a11d9bbf0b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:36.415118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69094a-ff28-4980-b215-72a11d9bbf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:36.446513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-db69094a-ff28-4980-b215-72a11d9bbf0b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:36.448555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-db69094a-ff28-4980-b215-72a11d9bbf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:36.543041 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd8cd6-5017-4744-8242-fd41dc081490 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:36.577442 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:36.604424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 227/432] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:36.622093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505b0f3-03ee-4f5e-86ae-72a4dbdb8706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:36.622752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505b0f3-03ee-4f5e-86ae-72a4dbdb8706 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:36.623029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505b0f3-03ee-4f5e-86ae-72a4dbdb8706 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:36.623300 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505b0f3-03ee-4f5e-86ae-72a4dbdb8706 None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:36.624520 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505b0f3-03ee-4f5e-86ae-72a4dbdb8706 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:36.626277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505b0f3-03ee-4f5e-86ae-72a4dbdb8706 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:36.628531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 206/433] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:36 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:36.635337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69094a-ff28-4980-b215-72a11d9bbf0b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:36.780375 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69094a-ff28-4980-b215-72a11d9bbf0b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:36.782000 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:36.806583 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505b0f3-03ee-4f5e-86ae-72a4dbdb8706 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:36.833829 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5375d-9cc6-4b09-a3c5-c567ae591583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:36.834741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5375d-9cc6-4b09-a3c5-c567ae591583 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:36.835191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5375d-9cc6-4b09-a3c5-c567ae591583 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:36.835682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5375d-9cc6-4b09-a3c5-c567ae591583 None admin] PATH_INFO: `/v3/groups/a079bbe0f83e4f009a081ad97f9bda48` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:36.838214 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5375d-9cc6-4b09-a3c5-c567ae591583 None admin] RBAC: Authorizing `identity:get_group(group_id=a079bbe0f83e4f009a081ad97f9bda48)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:36.841323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5375d-9cc6-4b09-a3c5-c567ae591583 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:36.844859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 228/434] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:36 2022] GET /identity/v3/groups/a079bbe0f83e4f009a081ad97f9bda48 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:36.853578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5375d-9cc6-4b09-a3c5-c567ae591583 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:37.045255 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5375d-9cc6-4b09-a3c5-c567ae591583 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:37.050435 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505b0f3-03ee-4f5e-86ae-72a4dbdb8706 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:37.094963 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820e9f0-b3f6-47b7-bf35-e5980c34b9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:37.095503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820e9f0-b3f6-47b7-bf35-e5980c34b9ba None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:37.095782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820e9f0-b3f6-47b7-bf35-e5980c34b9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:37.096052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820e9f0-b3f6-47b7-bf35-e5980c34b9ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:37.096866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820e9f0-b3f6-47b7-bf35-e5980c34b9ba None admin] RBAC: Adding query filter params (group.id=a079bbe0f83e4f009a081ad97f9bda48, role.id=e43d5cbe01fb477f98fbe79db2fd2e5c, scope.project.id=aa4dda00a89f4cc49309ae81cc931005) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:37.097190 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820e9f0-b3f6-47b7-bf35-e5980c34b9ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:37.098732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820e9f0-b3f6-47b7-bf35-e5980c34b9ba None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:37.106693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 229/435] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 21 16:08:36 2022] GET /identity/v3/role_assignments?group.id=a079bbe0f83e4f009a081ad97f9bda48&scope.project.id=aa4dda00a89f4cc49309ae81cc931005&role.id=e43d5cbe01fb477f98fbe79db2fd2e5c => generated 611 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:37.107532 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820e9f0-b3f6-47b7-bf35-e5980c34b9ba None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:37.136555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc1cf3-6e3e-4ff0-8436-7eef90fc4b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:37.137761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc1cf3-6e3e-4ff0-8436-7eef90fc4b4c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:37.138465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc1cf3-6e3e-4ff0-8436-7eef90fc4b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:37.138952 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc1cf3-6e3e-4ff0-8436-7eef90fc4b4c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:37.155196 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:37.165280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc1cf3-6e3e-4ff0-8436-7eef90fc4b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-dfdc1cf3-6e3e-4ff0-8436-7eef90fc4b4c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:37.175136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:37.176422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:37.177798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:37.177798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:37.177798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:37.177798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:37.177798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:37.177798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:37.177798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:37.177798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:37.177798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:37.177798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:37.177798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:37.177798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:37.177798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 207/436] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:08:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:08:37.185795 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc1cf3-6e3e-4ff0-8436-7eef90fc4b4c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:37.271661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:37.285371 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820e9f0-b3f6-47b7-bf35-e5980c34b9ba None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:37.358417 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2a379-0f96-4564-b1a5-7009936d0960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:37.358972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2a379-0f96-4564-b1a5-7009936d0960 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:37.359399 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2a379-0f96-4564-b1a5-7009936d0960 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:37.359549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2a379-0f96-4564-b1a5-7009936d0960 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:37.378927 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2a379-0f96-4564-b1a5-7009936d0960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:37.387796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc1cf3-6e3e-4ff0-8436-7eef90fc4b4c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8df2a379-0f96-4564-b1a5-7009936d0960 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:37.388118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:37.389767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:37.390814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:37.390814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:37.390814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:37.390814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:37.390814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:37.390814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:37.390814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:37.390814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:37.390814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:37.390814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:37.390814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:37.390814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:37.390814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 230/437] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:08:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:37.395185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620afc1-4136-4317-93dc-332c543f4e3a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:37.395892 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620afc1-4136-4317-93dc-332c543f4e3a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:37.396377 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620afc1-4136-4317-93dc-332c543f4e3a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:37.398048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 231/438] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:37.398838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620afc1-4136-4317-93dc-332c543f4e3a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:37.441205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf9065-581d-4edd-b0a9-c7e8c24251cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:37.441844 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf9065-581d-4edd-b0a9-c7e8c24251cf None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:37.442125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf9065-581d-4edd-b0a9-c7e8c24251cf None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:37.442375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf9065-581d-4edd-b0a9-c7e8c24251cf None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:37.443148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf9065-581d-4edd-b0a9-c7e8c24251cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:37.443868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf9065-581d-4edd-b0a9-c7e8c24251cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:37.445173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf9065-581d-4edd-b0a9-c7e8c24251cf None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:37.455606 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 208/439] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:08:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:37.456922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df693da0-0c9c-4769-a856-e9f7271904ca None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:37.457098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df693da0-0c9c-4769-a856-e9f7271904ca None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:37.457354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df693da0-0c9c-4769-a856-e9f7271904ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:37.477565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-df693da0-0c9c-4769-a856-e9f7271904ca None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:37.479954 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-df693da0-0c9c-4769-a856-e9f7271904ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:37.531643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:37.539468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620afc1-4136-4317-93dc-332c543f4e3a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:37.554435 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 209/440] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:37.561711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df693da0-0c9c-4769-a856-e9f7271904ca None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:37.578831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac94f2f-3ab7-4458-bf5a-2f4f0808aa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:37.579439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac94f2f-3ab7-4458-bf5a-2f4f0808aa63 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:37.579741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac94f2f-3ab7-4458-bf5a-2f4f0808aa63 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:37.580007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac94f2f-3ab7-4458-bf5a-2f4f0808aa63 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:37.580669 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac94f2f-3ab7-4458-bf5a-2f4f0808aa63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:37.580992 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac94f2f-3ab7-4458-bf5a-2f4f0808aa63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:37.582361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac94f2f-3ab7-4458-bf5a-2f4f0808aa63 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:37.591268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 232/441] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:08:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:37.597277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:37.599007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac94f2f-3ab7-4458-bf5a-2f4f0808aa63 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:37.688118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df693da0-0c9c-4769-a856-e9f7271904ca None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:37.721145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac94f2f-3ab7-4458-bf5a-2f4f0808aa63 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:37.733189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c4793-73fb-4c8f-8f03-438dcf5f2a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:37.733889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c4793-73fb-4c8f-8f03-438dcf5f2a62 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:37.734167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c4793-73fb-4c8f-8f03-438dcf5f2a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:37.734466 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c4793-73fb-4c8f-8f03-438dcf5f2a62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:37.759098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0b230-0e97-4313-8d42-36163717ccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:37.759961 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0b230-0e97-4313-8d42-36163717ccc8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:37.760233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0b230-0e97-4313-8d42-36163717ccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:37.760496 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0b230-0e97-4313-8d42-36163717ccc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:37.794312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:37.830663 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c4793-73fb-4c8f-8f03-438dcf5f2a62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:37.832153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c4793-73fb-4c8f-8f03-438dcf5f2a62 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:37.846361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0b230-0e97-4313-8d42-36163717ccc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:37.847816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0b230-0e97-4313-8d42-36163717ccc8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:37.863359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:37.940762 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 210/442] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:37.942074 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c4793-73fb-4c8f-8f03-438dcf5f2a62 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:37.960166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 233/443] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 16:08:37.961056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0b230-0e97-4313-8d42-36163717ccc8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:38.022008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:38.060308 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c4793-73fb-4c8f-8f03-438dcf5f2a62 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:38.069954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0b230-0e97-4313-8d42-36163717ccc8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:38.093163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:38.099023 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5ff75-1e60-4f06-9eb8-32d1dd9eded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:38.099658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5ff75-1e60-4f06-9eb8-32d1dd9eded4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:38.099934 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5ff75-1e60-4f06-9eb8-32d1dd9eded4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:38.100204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5ff75-1e60-4f06-9eb8-32d1dd9eded4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:38.108058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a57ea-6ce3-4218-b8e8-9dde98269b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:38.108726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a57ea-6ce3-4218-b8e8-9dde98269b3a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:38.109001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a57ea-6ce3-4218-b8e8-9dde98269b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:38.109276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a57ea-6ce3-4218-b8e8-9dde98269b3a None admin] PATH_INFO: `/v3/projects/0f6eedc7ec584320b4fdd810045aef8f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:38.110436 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a57ea-6ce3-4218-b8e8-9dde98269b3a None admin] RBAC: Authorizing `identity:get_project(project_id=0f6eedc7ec584320b4fdd810045aef8f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:38.112164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a57ea-6ce3-4218-b8e8-9dde98269b3a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:38.113862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 234/444] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:37 2022] GET /identity/v3/projects/0f6eedc7ec584320b4fdd810045aef8f => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:38.114645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a57ea-6ce3-4218-b8e8-9dde98269b3a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:38.116048 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5ff75-1e60-4f06-9eb8-32d1dd9eded4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-c3b5ff75-1e60-4f06-9eb8-32d1dd9eded4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:38.121634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:38.122688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:38.123503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:38.123503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:38.123503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:38.123503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:38.123503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:38.123503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:38.123503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:38.123503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:38.123503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:38.123503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:38.123503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:08:38.123503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:38.123503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 211/445] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:08:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:38.124246 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5ff75-1e60-4f06-9eb8-32d1dd9eded4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:38.230688 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a57ea-6ce3-4218-b8e8-9dde98269b3a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:38.234326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5ff75-1e60-4f06-9eb8-32d1dd9eded4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:38.258221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:38.270796 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15b39f-7fa4-4ca9-b46d-c1d577c28786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:38.271549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15b39f-7fa4-4ca9-b46d-c1d577c28786 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:38.271893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14c97a-dacc-422d-9533-bd9f6635a6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:38.272081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15b39f-7fa4-4ca9-b46d-c1d577c28786 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:38.272524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14c97a-dacc-422d-9533-bd9f6635a6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:38.272837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14c97a-dacc-422d-9533-bd9f6635a6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:38.273025 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15b39f-7fa4-4ca9-b46d-c1d577c28786 None admin] PATH_INFO: `/v3/projects/aa4dda00a89f4cc49309ae81cc931005` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:38.273164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14c97a-dacc-422d-9533-bd9f6635a6d7 None admin] PATH_INFO: `/v3/groups/a079bbe0f83e4f009a081ad97f9bda48` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:38.274237 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14c97a-dacc-422d-9533-bd9f6635a6d7 None admin] RBAC: Authorizing `identity:get_group(group_id=a079bbe0f83e4f009a081ad97f9bda48)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:38.274697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15b39f-7fa4-4ca9-b46d-c1d577c28786 None admin] RBAC: Authorizing `identity:get_project(project_id=aa4dda00a89f4cc49309ae81cc931005)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:38.281964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14c97a-dacc-422d-9533-bd9f6635a6d7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:38.283954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15b39f-7fa4-4ca9-b46d-c1d577c28786 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:38.284064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 212/446] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:38 2022] GET /identity/v3/groups/a079bbe0f83e4f009a081ad97f9bda48 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:38.284064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14c97a-dacc-422d-9533-bd9f6635a6d7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:38.284192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 235/447] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:38 2022] GET /identity/v3/projects/aa4dda00a89f4cc49309ae81cc931005 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:38.284192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15b39f-7fa4-4ca9-b46d-c1d577c28786 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:38.349043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:38.391419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15b39f-7fa4-4ca9-b46d-c1d577c28786 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:38.402630 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14c97a-dacc-422d-9533-bd9f6635a6d7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:38.441181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1348723-66b3-4d39-b6a5-80bfdc331250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:38.441861 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1348723-66b3-4d39-b6a5-80bfdc331250 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:38.442162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1348723-66b3-4d39-b6a5-80bfdc331250 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:38.442402 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1348723-66b3-4d39-b6a5-80bfdc331250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:38.443695 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1348723-66b3-4d39-b6a5-80bfdc331250 None admin] RBAC: Adding query filter params (group.id=a079bbe0f83e4f009a081ad97f9bda48, role.id=fdf188800dba4eee980df53694a7ed69, scope.project.id=0f6eedc7ec584320b4fdd810045aef8f) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:38.444002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1348723-66b3-4d39-b6a5-80bfdc331250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:38.445474 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1348723-66b3-4d39-b6a5-80bfdc331250 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:38.458547 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 236/448] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 21 16:08:38 2022] GET /identity/v3/role_assignments?group.id=a079bbe0f83e4f009a081ad97f9bda48&scope.project.id=0f6eedc7ec584320b4fdd810045aef8f&role.id=fdf188800dba4eee980df53694a7ed69 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:38.458547 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1348723-66b3-4d39-b6a5-80bfdc331250 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:38.464292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e16334-3eb5-4ea7-87c4-3453ef11ec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:38.465737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e16334-3eb5-4ea7-87c4-3453ef11ec08 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:38.466307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e16334-3eb5-4ea7-87c4-3453ef11ec08 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:38.466734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e16334-3eb5-4ea7-87c4-3453ef11ec08 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:38.467606 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e16334-3eb5-4ea7-87c4-3453ef11ec08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:38.468061 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e16334-3eb5-4ea7-87c4-3453ef11ec08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:38.469822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e16334-3eb5-4ea7-87c4-3453ef11ec08 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:38.480071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 213/449] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:38.486969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e16334-3eb5-4ea7-87c4-3453ef11ec08 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:38.555756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:38.619689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1348723-66b3-4d39-b6a5-80bfdc331250 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:38.656144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e16334-3eb5-4ea7-87c4-3453ef11ec08 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:38.666346 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b37d2-d571-4e9f-908d-75502a07643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:38.666994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b37d2-d571-4e9f-908d-75502a07643b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:38.668450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b37d2-d571-4e9f-908d-75502a07643b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:38.668450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b37d2-d571-4e9f-908d-75502a07643b None admin] PATH_INFO: `/v3/groups/a079bbe0f83e4f009a081ad97f9bda48` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:38.668749 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b37d2-d571-4e9f-908d-75502a07643b None admin] RBAC: Authorizing `identity:get_group(group_id=a079bbe0f83e4f009a081ad97f9bda48)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:38.670179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b37d2-d571-4e9f-908d-75502a07643b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:38.672210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 237/450] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:38 2022] GET /identity/v3/groups/a079bbe0f83e4f009a081ad97f9bda48 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:38.677919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b37d2-d571-4e9f-908d-75502a07643b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:38.704492 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:38.722869 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a64be-88fc-4852-a084-eb41ca4d71e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:38.723633 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a64be-88fc-4852-a084-eb41ca4d71e2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:38.723910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a64be-88fc-4852-a084-eb41ca4d71e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:38.724187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a64be-88fc-4852-a084-eb41ca4d71e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:38.828202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a64be-88fc-4852-a084-eb41ca4d71e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:38.830326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a64be-88fc-4852-a084-eb41ca4d71e2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:38.834669 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b37d2-d571-4e9f-908d-75502a07643b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:38.875657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:38.903019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a53c9-0403-4f27-b3dd-01acad59531f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:38.903647 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a53c9-0403-4f27-b3dd-01acad59531f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:38.903947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a53c9-0403-4f27-b3dd-01acad59531f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:38.904195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a53c9-0403-4f27-b3dd-01acad59531f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:38.904990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a53c9-0403-4f27-b3dd-01acad59531f None admin] RBAC: Adding query filter params (group.id=a079bbe0f83e4f009a081ad97f9bda48, role.id=fdf188800dba4eee980df53694a7ed69, scope.project.id=aa4dda00a89f4cc49309ae81cc931005) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:38.905303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a53c9-0403-4f27-b3dd-01acad59531f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:38.906897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a53c9-0403-4f27-b3dd-01acad59531f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:38.914835 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 238/451] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 21 16:08:38 2022] GET /identity/v3/role_assignments?group.id=a079bbe0f83e4f009a081ad97f9bda48&scope.project.id=aa4dda00a89f4cc49309ae81cc931005&role.id=fdf188800dba4eee980df53694a7ed69 => generated 611 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:39.007745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 214/452] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 16:08:39.015248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a53c9-0403-4f27-b3dd-01acad59531f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:39.189824 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a53c9-0403-4f27-b3dd-01acad59531f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:39.228790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3f774-a1c0-4897-bd83-82c457399cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:39.229430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3f774-a1c0-4897-bd83-82c457399cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:39.229703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3f774-a1c0-4897-bd83-82c457399cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:39.229977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3f774-a1c0-4897-bd83-82c457399cf1 None admin] PATH_INFO: `/v3/projects/f8aed661a1ae4dc6adb9120d20a01acd` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:39.231396 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3f774-a1c0-4897-bd83-82c457399cf1 None admin] RBAC: Authorizing `identity:get_project(project_id=f8aed661a1ae4dc6adb9120d20a01acd)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:39.232890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3f774-a1c0-4897-bd83-82c457399cf1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:39.234588 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 239/453] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:08:39 2022] GET /identity/v3/projects/f8aed661a1ae4dc6adb9120d20a01acd => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:39.240364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a64be-88fc-4852-a084-eb41ca4d71e2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:39.273422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:39.385080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a64be-88fc-4852-a084-eb41ca4d71e2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:39.427889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6da653-5452-4ace-b746-9ec960ff4877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:39.428587 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da653-5452-4ace-b746-9ec960ff4877 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:39.428931 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da653-5452-4ace-b746-9ec960ff4877 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:39.429241 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da653-5452-4ace-b746-9ec960ff4877 None admin] PATH_INFO: `/v3/groups/459757b560ad4f7c989fc0f197202c36` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:39.430448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6da653-5452-4ace-b746-9ec960ff4877 None admin] RBAC: Authorizing `identity:get_group(group_id=459757b560ad4f7c989fc0f197202c36)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:39.433784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6da653-5452-4ace-b746-9ec960ff4877 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:39.435602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 215/454] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 21 16:08:39 2022] GET /identity/v3/groups/459757b560ad4f7c989fc0f197202c36 => generated 229 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:39.442873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3f774-a1c0-4897-bd83-82c457399cf1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:39.533624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:39.580373 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3f774-a1c0-4897-bd83-82c457399cf1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:39.614900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d479744-1b2a-485d-9f09-c42e710df36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:39.615502 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d479744-1b2a-485d-9f09-c42e710df36b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:39.615777 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d479744-1b2a-485d-9f09-c42e710df36b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:39.616042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d479744-1b2a-485d-9f09-c42e710df36b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:39.616791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d479744-1b2a-485d-9f09-c42e710df36b None admin] RBAC: Adding query filter params (group.id=459757b560ad4f7c989fc0f197202c36, role.id=beec000223e041209205627bfa0dbed1, scope.project.id=f8aed661a1ae4dc6adb9120d20a01acd) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:39.617112 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d479744-1b2a-485d-9f09-c42e710df36b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:39.619031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d479744-1b2a-485d-9f09-c42e710df36b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:39.625478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 240/455] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 21 16:08:39 2022] GET /identity/v3/role_assignments?group.id=459757b560ad4f7c989fc0f197202c36&scope.project.id=f8aed661a1ae4dc6adb9120d20a01acd&role.id=beec000223e041209205627bfa0dbed1 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:42.438719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164e249-492b-4935-9e9a-f354d2dba623 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:42.439478 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164e249-492b-4935-9e9a-f354d2dba623 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:42.439478 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164e249-492b-4935-9e9a-f354d2dba623 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:42.440991 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 216/456] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:42.447001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3124a-8cc0-4c05-be7c-e4859aa43d86 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:42.447813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3124a-8cc0-4c05-be7c-e4859aa43d86 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:42.447813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3124a-8cc0-4c05-be7c-e4859aa43d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:42.467820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-26b3124a-8cc0-4c05-be7c-e4859aa43d86 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:42.469102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-26b3124a-8cc0-4c05-be7c-e4859aa43d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:42.567593 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 241/457] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:08:43.027854 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164e249-492b-4935-9e9a-f354d2dba623 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:43.249010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:43.275587 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164e249-492b-4935-9e9a-f354d2dba623 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:43.366811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4743ef-7325-4797-8374-2e9b1dafe80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:43.367814 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4743ef-7325-4797-8374-2e9b1dafe80a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:43.368386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4743ef-7325-4797-8374-2e9b1dafe80a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:43.369466 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4743ef-7325-4797-8374-2e9b1dafe80a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:43.390946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4743ef-7325-4797-8374-2e9b1dafe80a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:43.392444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4743ef-7325-4797-8374-2e9b1dafe80a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-5f4743ef-7325-4797-8374-2e9b1dafe80a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:43.419093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:43.420871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:43.422536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:43.422536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:43.422536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:43.422536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 217/458] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:43.429265 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3124a-8cc0-4c05-be7c-e4859aa43d86 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:43.505392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:43.589974 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3124a-8cc0-4c05-be7c-e4859aa43d86 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:43.638121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcd444-9405-416e-8bc7-eb5f0d717a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:43.638762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcd444-9405-416e-8bc7-eb5f0d717a4e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:43.639045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcd444-9405-416e-8bc7-eb5f0d717a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:43.639323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcd444-9405-416e-8bc7-eb5f0d717a4e None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:43.639992 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcd444-9405-416e-8bc7-eb5f0d717a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:43.640298 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcd444-9405-416e-8bc7-eb5f0d717a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:43.641739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcd444-9405-416e-8bc7-eb5f0d717a4e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:43.655411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 242/459] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:43.663291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4743ef-7325-4797-8374-2e9b1dafe80a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:43.911235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4743ef-7325-4797-8374-2e9b1dafe80a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:43.997927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be82e5c-e534-4ef1-b8bc-0252551b5246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:43.998909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be82e5c-e534-4ef1-b8bc-0252551b5246 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:43.999372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be82e5c-e534-4ef1-b8bc-0252551b5246 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:43.999834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be82e5c-e534-4ef1-b8bc-0252551b5246 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:44.001032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be82e5c-e534-4ef1-b8bc-0252551b5246 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:44.003639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be82e5c-e534-4ef1-b8bc-0252551b5246 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:44.042633 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:44.049333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 218/460] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:08:43 2022] POST /identity/v3/users => generated 248 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:08:44.062949 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c89768-4c6e-47c0-8dda-914d471d5caf None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:44.063381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c89768-4c6e-47c0-8dda-914d471d5caf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:44.063760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c89768-4c6e-47c0-8dda-914d471d5caf None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:44.065574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 243/461] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:44.071710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0b14b-b76e-4a88-a194-e288ddd4ba8b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:44.072118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0b14b-b76e-4a88-a194-e288ddd4ba8b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:44.072362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0b14b-b76e-4a88-a194-e288ddd4ba8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:44.081429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15177dc8-9941-4ede-b6af-0c739a1c277d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:44.081708 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15177dc8-9941-4ede-b6af-0c739a1c277d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:44.082033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15177dc8-9941-4ede-b6af-0c739a1c277d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:44.083696 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 244/462] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:44.098773 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a3c0b14b-b76e-4a88-a194-e288ddd4ba8b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:44.100484 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a3c0b14b-b76e-4a88-a194-e288ddd4ba8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:44.120732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a426e-a584-4f90-b54b-1502403e925b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:44.121029 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a426e-a584-4f90-b54b-1502403e925b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:44.121365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a426e-a584-4f90-b54b-1502403e925b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:44.146717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d84a426e-a584-4f90-b54b-1502403e925b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:44.148007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d84a426e-a584-4f90-b54b-1502403e925b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:44.297569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 245/463] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:44.300289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 219/464] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:44.326980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1441a-e1bd-4530-80aa-7b5de1501105 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:44.327478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1441a-e1bd-4530-80aa-7b5de1501105 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:44.327964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1441a-e1bd-4530-80aa-7b5de1501105 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:44.330979 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 246/465] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:44.340042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8fd8b-dc1c-45ce-a08f-1fa7ed9a7a4d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:44.340314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8fd8b-dc1c-45ce-a08f-1fa7ed9a7a4d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:44.340574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8fd8b-dc1c-45ce-a08f-1fa7ed9a7a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:44.370523 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1ea8fd8b-dc1c-45ce-a08f-1fa7ed9a7a4d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:44.371762 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1ea8fd8b-dc1c-45ce-a08f-1fa7ed9a7a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:44.475300 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 220/466] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:44.709585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1441a-e1bd-4530-80aa-7b5de1501105 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:44.814381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:44.830170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8fd8b-dc1c-45ce-a08f-1fa7ed9a7a4d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:44.950490 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1441a-e1bd-4530-80aa-7b5de1501105 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:44.985996 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:45.061478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b3025-aee0-402d-bfff-8d7953ecb0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:45.062129 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b3025-aee0-402d-bfff-8d7953ecb0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:45.062400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b3025-aee0-402d-bfff-8d7953ecb0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:45.062665 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b3025-aee0-402d-bfff-8d7953ecb0c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:45.081078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8fd8b-dc1c-45ce-a08f-1fa7ed9a7a4d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:45.089813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b3025-aee0-402d-bfff-8d7953ecb0c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:45.091284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b3025-aee0-402d-bfff-8d7953ecb0c3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e36b3025-aee0-402d-bfff-8d7953ecb0c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:45.116173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:45.117215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:45.118103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:45.118103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:45.118103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:45.118103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 247/467] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:45.133624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b3025-aee0-402d-bfff-8d7953ecb0c3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:45.168915 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e591d61-e22d-408d-95eb-999c197c8ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:45.170003 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e591d61-e22d-408d-95eb-999c197c8ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:45.170497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e591d61-e22d-408d-95eb-999c197c8ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:45.170983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e591d61-e22d-408d-95eb-999c197c8ae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:45.193153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e591d61-e22d-408d-95eb-999c197c8ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:45.196988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e591d61-e22d-408d-95eb-999c197c8ae4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-9e591d61-e22d-408d-95eb-999c197c8ae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:45.228710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:45.230927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:45.232849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:45.232849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:45.232849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:45.232849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 221/468] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:45.233307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e591d61-e22d-408d-95eb-999c197c8ae4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:45.315942 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:45.334215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b3025-aee0-402d-bfff-8d7953ecb0c3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:45.399015 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afec29-af9e-4227-93f4-a7c7e94bc847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:45.400178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afec29-af9e-4227-93f4-a7c7e94bc847 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:45.400450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afec29-af9e-4227-93f4-a7c7e94bc847 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:45.401177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afec29-af9e-4227-93f4-a7c7e94bc847 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:45.401428 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afec29-af9e-4227-93f4-a7c7e94bc847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:45.401693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afec29-af9e-4227-93f4-a7c7e94bc847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:45.403051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afec29-af9e-4227-93f4-a7c7e94bc847 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:45.424064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 248/469] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:45.424064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afec29-af9e-4227-93f4-a7c7e94bc847 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:45.449526 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e591d61-e22d-408d-95eb-999c197c8ae4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:45.475441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:45.508898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3711ae-5719-46d7-b809-b91627d1932f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:45.509753 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3711ae-5719-46d7-b809-b91627d1932f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:45.510223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3711ae-5719-46d7-b809-b91627d1932f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:45.510689 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3711ae-5719-46d7-b809-b91627d1932f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:45.526032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3711ae-5719-46d7-b809-b91627d1932f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:45.527848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3711ae-5719-46d7-b809-b91627d1932f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-5b3711ae-5719-46d7-b809-b91627d1932f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:45.547137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:45.548995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:45.550687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:45.550687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:45.550687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:45.550687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 222/470] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:45.550687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3711ae-5719-46d7-b809-b91627d1932f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:45.560756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afec29-af9e-4227-93f4-a7c7e94bc847 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:45.601602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983269e-d3c3-4ea1-ab2f-d16932c26b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:45.602515 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983269e-d3c3-4ea1-ab2f-d16932c26b4c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:45.603351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983269e-d3c3-4ea1-ab2f-d16932c26b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:45.603624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983269e-d3c3-4ea1-ab2f-d16932c26b4c None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:45.604419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983269e-d3c3-4ea1-ab2f-d16932c26b4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:45.604728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983269e-d3c3-4ea1-ab2f-d16932c26b4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:45.606113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983269e-d3c3-4ea1-ab2f-d16932c26b4c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:45.619209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 249/471] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:45.622847 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3dddb-01f3-4887-8072-23f5a58ae04e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:45.624312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3dddb-01f3-4887-8072-23f5a58ae04e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:45.624863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3dddb-01f3-4887-8072-23f5a58ae04e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:45.628510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 250/472] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:45.631428 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3dddb-01f3-4887-8072-23f5a58ae04e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:45.664333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:45.747124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3711ae-5719-46d7-b809-b91627d1932f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:45.772140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3dddb-01f3-4887-8072-23f5a58ae04e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:45.810336 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4e7cf-a68b-49d4-95fc-25123a37c88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:45.811086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4e7cf-a68b-49d4-95fc-25123a37c88e None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:45.811360 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4e7cf-a68b-49d4-95fc-25123a37c88e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:45.811620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4e7cf-a68b-49d4-95fc-25123a37c88e None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:45.812431 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4e7cf-a68b-49d4-95fc-25123a37c88e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:45.814961 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4e7cf-a68b-49d4-95fc-25123a37c88e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:45.828788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0e9f7-0daa-4fc7-b0c1-02741e67cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:45.829758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0e9f7-0daa-4fc7-b0c1-02741e67cf14 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:45.830203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0e9f7-0daa-4fc7-b0c1-02741e67cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:45.830618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0e9f7-0daa-4fc7-b0c1-02741e67cf14 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:45.831769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0e9f7-0daa-4fc7-b0c1-02741e67cf14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:45.832260 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0e9f7-0daa-4fc7-b0c1-02741e67cf14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:45.834516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0e9f7-0daa-4fc7-b0c1-02741e67cf14 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:45.852147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 251/473] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:45.859116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 223/474] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:08:45 2022] POST /identity/v3/users => generated 248 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:08:45.859116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa9c1c-d3d7-4ffb-a762-a1ea1c1b7fa3 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:45.859116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa9c1c-d3d7-4ffb-a762-a1ea1c1b7fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:45.859116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa9c1c-d3d7-4ffb-a762-a1ea1c1b7fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:45.863766 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0e9f7-0daa-4fc7-b0c1-02741e67cf14 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:45.891684 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-17fa9c1c-d3d7-4ffb-a762-a1ea1c1b7fa3 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:45.893624 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-17fa9c1c-d3d7-4ffb-a762-a1ea1c1b7fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:45.933817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:45.993218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:46.050763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0e9f7-0daa-4fc7-b0c1-02741e67cf14 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:46.066651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 224/475] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:46.069269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa9c1c-d3d7-4ffb-a762-a1ea1c1b7fa3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:46.168726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6170aa-aa6e-4d8e-b463-5e0da4e7130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:46.169872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6170aa-aa6e-4d8e-b463-5e0da4e7130f None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:46.170203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6170aa-aa6e-4d8e-b463-5e0da4e7130f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:46.174227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6170aa-aa6e-4d8e-b463-5e0da4e7130f None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:46.175354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6170aa-aa6e-4d8e-b463-5e0da4e7130f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:46.178125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6170aa-aa6e-4d8e-b463-5e0da4e7130f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:46.226162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 252/476] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:08:45 2022] POST /identity/v3/users => generated 249 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:08:46.295556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa9c1c-d3d7-4ffb-a762-a1ea1c1b7fa3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:46.369086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c90f3-6769-4c5c-85f3-281a56451af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:46.370204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c90f3-6769-4c5c-85f3-281a56451af8 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:46.370675 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c90f3-6769-4c5c-85f3-281a56451af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:46.371161 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c90f3-6769-4c5c-85f3-281a56451af8 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:46.372421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c90f3-6769-4c5c-85f3-281a56451af8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:46.375202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c90f3-6769-4c5c-85f3-281a56451af8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:46.414957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 225/477] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:08:46 2022] POST /identity/v3/users => generated 246 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:08:46.644919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6170aa-aa6e-4d8e-b463-5e0da4e7130f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:46.848831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6170aa-aa6e-4d8e-b463-5e0da4e7130f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:46.912289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:46.924284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcacdd0-3ae3-42fe-91c5-366c0dc847d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:46.925002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcacdd0-3ae3-42fe-91c5-366c0dc847d8 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:46.925578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcacdd0-3ae3-42fe-91c5-366c0dc847d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:46.925882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcacdd0-3ae3-42fe-91c5-366c0dc847d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:46.926576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcacdd0-3ae3-42fe-91c5-366c0dc847d8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:46.927989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcacdd0-3ae3-42fe-91c5-366c0dc847d8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:46.947215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.sql.core [None req-afcacdd0-3ae3-42fe-91c5-366c0dc847d8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 21 16:08:46.947215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 21 16:08:46.947215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [parameters: {'id': '208f193d17494d4c8ec629929a904ba0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 21 16:08:46.947215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81472) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-afcacdd0-3ae3-42fe-91c5-366c0dc847d8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 21 16:08:46.963812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return ref.to_dict() Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 16:08:46.966293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application yield resource Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.rollback() Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.force_reraise() Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise self.value Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application session.commit() Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 21 16:08:46.971414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._prepare_impl() Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.flush() Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._flush(objects) Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application compat.raise_( Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application flush_context.execute() Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rec.execute(self) Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 21 16:08:46.974652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 16:08:46.978088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 16:08:46.985256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [parameters: {'id': '208f193d17494d4c8ec629929a904ba0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:46.988354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 21 16:08:46.991387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:46.997829 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 253/478] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 21 16:08:46 2022] POST /identity/v3/roles => generated 144 bytes in 322 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:46.998056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c90f3-6769-4c5c-85f3-281a56451af8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:46.998056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:47.184191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c90f3-6769-4c5c-85f3-281a56451af8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:47.258063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a79e6-2a24-42f8-9413-8dcce9c13f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:47.259815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a79e6-2a24-42f8-9413-8dcce9c13f5f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:47.260679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a79e6-2a24-42f8-9413-8dcce9c13f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:47.261775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a79e6-2a24-42f8-9413-8dcce9c13f5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:47.289793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a79e6-2a24-42f8-9413-8dcce9c13f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-bc4a79e6-2a24-42f8-9413-8dcce9c13f5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:47.301473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:47.303136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:47.304678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:47.304678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:47.304678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:47.304678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:47.304678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:47.304678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:47.304678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:47.304678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:47.304678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:47.304678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:47.304678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 16:08:47.304678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:47.309336 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 226/479] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:08:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:08:47.317791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcacdd0-3ae3-42fe-91c5-366c0dc847d8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:47.546022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcacdd0-3ae3-42fe-91c5-366c0dc847d8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:47.594774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e85c3-dbad-4d0c-8b3c-c374b566e130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:47.595834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e85c3-dbad-4d0c-8b3c-c374b566e130 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:47.596327 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e85c3-dbad-4d0c-8b3c-c374b566e130 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:47.596828 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e85c3-dbad-4d0c-8b3c-c374b566e130 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:47.597743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e85c3-dbad-4d0c-8b3c-c374b566e130 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:47.598264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e85c3-dbad-4d0c-8b3c-c374b566e130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:47.599950 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e85c3-dbad-4d0c-8b3c-c374b566e130 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:47.610339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 254/480] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:08:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:47.828471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f7f21-ca4a-48fb-ba06-94fb851980bf None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:47.828826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f7f21-ca4a-48fb-ba06-94fb851980bf None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:47.829183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f7f21-ca4a-48fb-ba06-94fb851980bf None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:47.831404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 227/481] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:47.837384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3f4ab-c00b-49cf-81be-3a8e81c1d93b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:47.837881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3f4ab-c00b-49cf-81be-3a8e81c1d93b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:47.838291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3f4ab-c00b-49cf-81be-3a8e81c1d93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:47.861171 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3ac3f4ab-c00b-49cf-81be-3a8e81c1d93b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:47.863141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3ac3f4ab-c00b-49cf-81be-3a8e81c1d93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:47.929347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:47.953889 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 255/482] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:48.233042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f7f21-ca4a-48fb-ba06-94fb851980bf None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:48.338436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:48.401450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f7f21-ca4a-48fb-ba06-94fb851980bf None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:48.439574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c76239-1c66-4b94-a576-f1187684ccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:48.440210 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c76239-1c66-4b94-a576-f1187684ccfe None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:48.440492 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c76239-1c66-4b94-a576-f1187684ccfe None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:48.440796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c76239-1c66-4b94-a576-f1187684ccfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:48.459983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c76239-1c66-4b94-a576-f1187684ccfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-43c76239-1c66-4b94-a576-f1187684ccfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:48.467444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:48.468571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:48.469605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:48.469605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:48.469605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:48.469605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:48.469605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:48.469605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:48.469605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:48.469605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:48.469605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:48.469605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:48.469605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:08:48.469605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:48.471899 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 228/483] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:08:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:48.478493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3f4ab-c00b-49cf-81be-3a8e81c1d93b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:48.655008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3f4ab-c00b-49cf-81be-3a8e81c1d93b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:48.723427 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e432b-1616-4fa2-a3ce-5ffd438d77d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:48.724284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e432b-1616-4fa2-a3ce-5ffd438d77d5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:48.724727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e432b-1616-4fa2-a3ce-5ffd438d77d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:48.725207 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e432b-1616-4fa2-a3ce-5ffd438d77d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:48.726047 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e432b-1616-4fa2-a3ce-5ffd438d77d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:48.726543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e432b-1616-4fa2-a3ce-5ffd438d77d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:48.728651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e432b-1616-4fa2-a3ce-5ffd438d77d5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:48.748348 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 256/484] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:08:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:48.754278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c76239-1c66-4b94-a576-f1187684ccfe None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:48.895655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c76239-1c66-4b94-a576-f1187684ccfe None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:48.934014 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:48.955083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dcbf0-d0b2-4ba0-8fbc-f22a714a07f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:48.955743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dcbf0-d0b2-4ba0-8fbc-f22a714a07f3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:48.956078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dcbf0-d0b2-4ba0-8fbc-f22a714a07f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:48.956354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dcbf0-d0b2-4ba0-8fbc-f22a714a07f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:48.969621 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dcbf0-d0b2-4ba0-8fbc-f22a714a07f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:48.971089 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dcbf0-d0b2-4ba0-8fbc-f22a714a07f3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-aa8dcbf0-d0b2-4ba0-8fbc-f22a714a07f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:48.986709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:48.988387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:48.990054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:48.990054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:48.990054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:48.990054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 229/485] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:48.993981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e432b-1616-4fa2-a3ce-5ffd438d77d5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:49.083185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:49.153061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e432b-1616-4fa2-a3ce-5ffd438d77d5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:49.201853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79834da7-11f9-4a7e-b8d5-5b14a7527cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:49.202834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79834da7-11f9-4a7e-b8d5-5b14a7527cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:49.203417 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79834da7-11f9-4a7e-b8d5-5b14a7527cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:49.203889 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79834da7-11f9-4a7e-b8d5-5b14a7527cf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:49.204899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79834da7-11f9-4a7e-b8d5-5b14a7527cf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:49.205415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79834da7-11f9-4a7e-b8d5-5b14a7527cf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:49.207035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79834da7-11f9-4a7e-b8d5-5b14a7527cf9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:49.225272 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 257/486] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:49.231781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dcbf0-d0b2-4ba0-8fbc-f22a714a07f3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:49.397938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dcbf0-d0b2-4ba0-8fbc-f22a714a07f3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:49.470964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b713919-e882-47e3-95f3-839e2c643823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:49.471618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b713919-e882-47e3-95f3-839e2c643823 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:49.471900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b713919-e882-47e3-95f3-839e2c643823 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:49.472173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b713919-e882-47e3-95f3-839e2c643823 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:49.483755 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b713919-e882-47e3-95f3-839e2c643823 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:49.485278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b713919-e882-47e3-95f3-839e2c643823 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-4b713919-e882-47e3-95f3-839e2c643823 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:08:49.502535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:49.503539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:49.504477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:49.504477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:49.504477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:08:49.504477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:08:49.504477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:08:49.504477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:08:49.504477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:08:49.504477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:08:49.504477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 16:08:49.504477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:49.504477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 230/487] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:49.512458 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79834da7-11f9-4a7e-b8d5-5b14a7527cf9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:49.643992 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79834da7-11f9-4a7e-b8d5-5b14a7527cf9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:49.653981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:49.685880 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e16280-3d8a-47f8-bc4c-9b580b502706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:49.686911 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e16280-3d8a-47f8-bc4c-9b580b502706 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:49.687396 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e16280-3d8a-47f8-bc4c-9b580b502706 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:49.687881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e16280-3d8a-47f8-bc4c-9b580b502706 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:49.688869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e16280-3d8a-47f8-bc4c-9b580b502706 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:49.689457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e16280-3d8a-47f8-bc4c-9b580b502706 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:49.691122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e16280-3d8a-47f8-bc4c-9b580b502706 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:49.732005 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 258/488] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 21 16:08:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:49.738038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b713919-e882-47e3-95f3-839e2c643823 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:49.830917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:49.865594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b351f-2212-445e-887c-093e8154e931 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:49.865899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b351f-2212-445e-887c-093e8154e931 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:49.866232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b351f-2212-445e-887c-093e8154e931 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:49.867905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 259/489] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:49.874271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1318c-49b3-45da-be29-baa27c58d857 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:49.874687 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1318c-49b3-45da-be29-baa27c58d857 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:49.874835 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1318c-49b3-45da-be29-baa27c58d857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:49.909225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dcf1318c-49b3-45da-be29-baa27c58d857 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:49.911204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dcf1318c-49b3-45da-be29-baa27c58d857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:50.015937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b713919-e882-47e3-95f3-839e2c643823 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:50.049503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 260/490] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:50.051917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5906ac-4506-47ce-94fa-12da1124e761 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:50.052484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5906ac-4506-47ce-94fa-12da1124e761 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:50.052977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5906ac-4506-47ce-94fa-12da1124e761 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:50.055697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 261/491] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:50.067613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713955-f836-4c06-af8f-bd4618fa7120 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:50.068418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713955-f836-4c06-af8f-bd4618fa7120 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:50.068964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713955-f836-4c06-af8f-bd4618fa7120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:50.073422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4787c-2773-46cc-bb21-21e77fd6ee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:50.074053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4787c-2773-46cc-bb21-21e77fd6ee60 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:50.074335 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4787c-2773-46cc-bb21-21e77fd6ee60 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:50.074605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4787c-2773-46cc-bb21-21e77fd6ee60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:50.106858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a6713955-f836-4c06-af8f-bd4618fa7120 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:50.108880 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a6713955-f836-4c06-af8f-bd4618fa7120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:50.170958 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4787c-2773-46cc-bb21-21e77fd6ee60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:50.172460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4787c-2773-46cc-bb21-21e77fd6ee60 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:50.253239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:50.267613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 262/492] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:08:50.331261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 231/493] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:50.337463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6713955-f836-4c06-af8f-bd4618fa7120 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:50.406679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:50.539326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6713955-f836-4c06-af8f-bd4618fa7120 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:50.564775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4787c-2773-46cc-bb21-21e77fd6ee60 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:50.620338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2d71c-54eb-4823-b233-6f253b4545cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:50.621853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2d71c-54eb-4823-b233-6f253b4545cc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:50.622352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2d71c-54eb-4823-b233-6f253b4545cc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:50.623166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2d71c-54eb-4823-b233-6f253b4545cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:50.652847 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2d71c-54eb-4823-b233-6f253b4545cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:50.655386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2d71c-54eb-4823-b233-6f253b4545cc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b6f2d71c-54eb-4823-b233-6f253b4545cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:50.689681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:50.690661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:50.691524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:50.691524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:50.691524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:50.694309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 263/494] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:50.701578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2d71c-54eb-4823-b233-6f253b4545cc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:50.746387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4787c-2773-46cc-bb21-21e77fd6ee60 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:50.802008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9340b-742e-441a-8dcc-668a1af74a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:50.803108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9340b-742e-441a-8dcc-668a1af74a89 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:50.803594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9340b-742e-441a-8dcc-668a1af74a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:50.804060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9340b-742e-441a-8dcc-668a1af74a89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:50.809148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:50.828973 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9340b-742e-441a-8dcc-668a1af74a89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:50.829257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-a6b9340b-742e-441a-8dcc-668a1af74a89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:50.834512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:50.836252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:50.837848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:50.837848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:50.837848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:50.837848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:50.837848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:50.837848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:50.837848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:50.837848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:50.837848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:50.837848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:50.837848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:08:50.837848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:50.837848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 232/495] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:08:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:08:50.837848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9340b-742e-441a-8dcc-668a1af74a89 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:50.890593 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2d71c-54eb-4823-b233-6f253b4545cc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:50.945278 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de2e5d-5b8b-46f1-8a35-9dee613c0da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:50.946007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de2e5d-5b8b-46f1-8a35-9dee613c0da9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:50.946988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de2e5d-5b8b-46f1-8a35-9dee613c0da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:50.947412 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de2e5d-5b8b-46f1-8a35-9dee613c0da9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:50.961561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de2e5d-5b8b-46f1-8a35-9dee613c0da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e7de2e5d-5b8b-46f1-8a35-9dee613c0da9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:50.967336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:50.969506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:50.970331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:50.970331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:50.970331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:50.970331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:50.970331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:50.970331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:50.970331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:50.970331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:50.970331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:50.970331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:50.970331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:08:50.970331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:50.970331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 264/496] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:08:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:50.970331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2c949-b91e-459a-9b6e-600d02cf69f5 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:50.971467 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2c949-b91e-459a-9b6e-600d02cf69f5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:50.971467 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2c949-b91e-459a-9b6e-600d02cf69f5 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:50.976185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 265/497] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:50.977099 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2c949-b91e-459a-9b6e-600d02cf69f5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:50.992098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9340b-742e-441a-8dcc-668a1af74a89 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:51.048001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa066c-f1db-4df6-931b-78c8930baeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:51.048603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa066c-f1db-4df6-931b-78c8930baeba None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:51.048914 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa066c-f1db-4df6-931b-78c8930baeba None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:51.049181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa066c-f1db-4df6-931b-78c8930baeba None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:51.049817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa066c-f1db-4df6-931b-78c8930baeba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:51.050120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa066c-f1db-4df6-931b-78c8930baeba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:51.051536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa066c-f1db-4df6-931b-78c8930baeba None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:51.073546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 233/498] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:51.073546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa066c-f1db-4df6-931b-78c8930baeba None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:51.100993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2c949-b91e-459a-9b6e-600d02cf69f5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:51.141101 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecb775-aa68-4c91-b139-142bd2296678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:51.141824 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecb775-aa68-4c91-b139-142bd2296678 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:51.142105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecb775-aa68-4c91-b139-142bd2296678 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:51.142374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecb775-aa68-4c91-b139-142bd2296678 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:51.143050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecb775-aa68-4c91-b139-142bd2296678 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:51.143348 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecb775-aa68-4c91-b139-142bd2296678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:51.144781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecb775-aa68-4c91-b139-142bd2296678 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:51.147708 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:51.151259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:51.159419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 266/499] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:08:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:51.161681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccd672-a89b-4efd-8bf8-a5b21836589a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:51.162135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccd672-a89b-4efd-8bf8-a5b21836589a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:51.162553 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccd672-a89b-4efd-8bf8-a5b21836589a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:51.187501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4fccd672-a89b-4efd-8bf8-a5b21836589a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:51.189029 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4fccd672-a89b-4efd-8bf8-a5b21836589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:51.209612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa066c-f1db-4df6-931b-78c8930baeba None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:51.264771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd21b1-6e72-4903-b96d-a4ef42452409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:51.265842 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd21b1-6e72-4903-b96d-a4ef42452409 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:51.266323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd21b1-6e72-4903-b96d-a4ef42452409 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:51.266795 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd21b1-6e72-4903-b96d-a4ef42452409 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:51.267954 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd21b1-6e72-4903-b96d-a4ef42452409 None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:51.268451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd21b1-6e72-4903-b96d-a4ef42452409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:51.271017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd21b1-6e72-4903-b96d-a4ef42452409 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:51.279218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 267/500] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:51.280421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccd672-a89b-4efd-8bf8-a5b21836589a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:51.292014 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 234/501] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:08:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:51.292014 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd21b1-6e72-4903-b96d-a4ef42452409 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:51.427864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd21b1-6e72-4903-b96d-a4ef42452409 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:51.447436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:51.466887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccd672-a89b-4efd-8bf8-a5b21836589a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:51.480526 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d695-bb1c-407a-a117-68aff1198e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:51.481440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d695-bb1c-407a-a117-68aff1198e5f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:51.481721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d695-bb1c-407a-a117-68aff1198e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:51.482152 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d695-bb1c-407a-a117-68aff1198e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:51.496984 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:51.497287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231d695-bb1c-407a-a117-68aff1198e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:51.498807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231d695-bb1c-407a-a117-68aff1198e5f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:51.512622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cadc80-a858-41ff-9f3a-e9f538f8edb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:51.513724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cadc80-a858-41ff-9f3a-e9f538f8edb2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:51.514195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cadc80-a858-41ff-9f3a-e9f538f8edb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:51.514644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cadc80-a858-41ff-9f3a-e9f538f8edb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-c231d695-bb1c-407a-a117-68aff1198e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:51.515542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:51.516394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:51.517366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:51.517366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:51.517366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:51.517366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 235/502] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:51.518050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d695-bb1c-407a-a117-68aff1198e5f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:51.531390 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cadc80-a858-41ff-9f3a-e9f538f8edb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:51.533152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cadc80-a858-41ff-9f3a-e9f538f8edb2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a8cadc80-a858-41ff-9f3a-e9f538f8edb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:08:51.546816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:51.548460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:51.551434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:08:51.551434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:08:51.551434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:08:51.551434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:08:51.551434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:08:51.551434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:08:51.551434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:08:51.551434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:51.551434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 268/503] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:08:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:51.551434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678815c-77be-4ba4-9548-f8ff976fb756 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:51.552476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678815c-77be-4ba4-9548-f8ff976fb756 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:51.552476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678815c-77be-4ba4-9548-f8ff976fb756 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:51.560746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 269/504] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:51.560746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678815c-77be-4ba4-9548-f8ff976fb756 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:51.647892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d695-bb1c-407a-a117-68aff1198e5f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:51.672166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678815c-77be-4ba4-9548-f8ff976fb756 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:51.685291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd2b4b-57f2-4671-8c6b-bf949451ac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:51.685881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd2b4b-57f2-4671-8c6b-bf949451ac7f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:51.686167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd2b4b-57f2-4671-8c6b-bf949451ac7f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:51.686436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd2b4b-57f2-4671-8c6b-bf949451ac7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:51.698871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd2b4b-57f2-4671-8c6b-bf949451ac7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:51.700373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd2b4b-57f2-4671-8c6b-bf949451ac7f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:51.711032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed8543-5db3-4b62-8bdf-b0bb4d8ff072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:51.711742 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed8543-5db3-4b62-8bdf-b0bb4d8ff072 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:51.712102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed8543-5db3-4b62-8bdf-b0bb4d8ff072 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:51.712454 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed8543-5db3-4b62-8bdf-b0bb4d8ff072 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:51.713231 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed8543-5db3-4b62-8bdf-b0bb4d8ff072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:51.713598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed8543-5db3-4b62-8bdf-b0bb4d8ff072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:51.715337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed8543-5db3-4b62-8bdf-b0bb4d8ff072 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-5bbd2b4b-57f2-4671-8c6b-bf949451ac7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:51.715806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:51.716664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:51.717576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:51.717576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:51.717576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:51.717576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 236/505] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:51.718388 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd2b4b-57f2-4671-8c6b-bf949451ac7f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:51.734443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 270/506] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:51.735885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d51a8a-6a03-41f8-924b-9dc4ab757c1f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:51.736166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d51a8a-6a03-41f8-924b-9dc4ab757c1f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:51.736433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d51a8a-6a03-41f8-924b-9dc4ab757c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:51.748670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:51.756105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-64d51a8a-6a03-41f8-924b-9dc4ab757c1f None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:51.757361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-64d51a8a-6a03-41f8-924b-9dc4ab757c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:51.805392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:51.831605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd2b4b-57f2-4671-8c6b-bf949451ac7f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:51.833359 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 271/507] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:51.834697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d51a8a-6a03-41f8-924b-9dc4ab757c1f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:51.871719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a77737-5a33-4c22-9b71-011516253e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:51.873122 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a77737-5a33-4c22-9b71-011516253e05 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:51.873601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a77737-5a33-4c22-9b71-011516253e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:51.874039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a77737-5a33-4c22-9b71-011516253e05 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:51.875260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a77737-5a33-4c22-9b71-011516253e05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:51.875761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a77737-5a33-4c22-9b71-011516253e05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:51.878078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a77737-5a33-4c22-9b71-011516253e05 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:51.909966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 237/508] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:08:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:51.909966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a77737-5a33-4c22-9b71-011516253e05 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:52.010504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d51a8a-6a03-41f8-924b-9dc4ab757c1f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:52.030469 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:52.052728 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a77737-5a33-4c22-9b71-011516253e05 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:52.058141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535cdb4-351a-48f7-9537-219c91475bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:52.058960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535cdb4-351a-48f7-9537-219c91475bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:52.059387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535cdb4-351a-48f7-9537-219c91475bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:52.059792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535cdb4-351a-48f7-9537-219c91475bf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:52.076268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535cdb4-351a-48f7-9537-219c91475bf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e535cdb4-351a-48f7-9537-219c91475bf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:52.082389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:52.083379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:52.084243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:52.084243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:52.084243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:52.084243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:52.084243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:52.084243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:52.084243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:52.084243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:52.084243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:52.084243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:52.084243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:08:52.084243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:52.084243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 272/509] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:08:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:52.087435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535cdb4-351a-48f7-9537-219c91475bf8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:52.103309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ec437-d0d9-4b13-ad36-f78dd5ba26c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:52.103927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ec437-d0d9-4b13-ad36-f78dd5ba26c2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:52.104203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ec437-d0d9-4b13-ad36-f78dd5ba26c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:52.104500 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ec437-d0d9-4b13-ad36-f78dd5ba26c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:52.105180 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ec437-d0d9-4b13-ad36-f78dd5ba26c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:52.105483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ec437-d0d9-4b13-ad36-f78dd5ba26c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:52.106902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ec437-d0d9-4b13-ad36-f78dd5ba26c2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:52.120029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 238/510] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:52.121157 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ec437-d0d9-4b13-ad36-f78dd5ba26c2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:52.142036 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:52.219280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535cdb4-351a-48f7-9537-219c91475bf8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:52.230543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ec437-d0d9-4b13-ad36-f78dd5ba26c2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:52.262571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827ddbd-1a6e-4d3f-a55e-ba9812e4012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:52.263560 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827ddbd-1a6e-4d3f-a55e-ba9812e4012e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:52.264044 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827ddbd-1a6e-4d3f-a55e-ba9812e4012e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:52.264442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827ddbd-1a6e-4d3f-a55e-ba9812e4012e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:52.266842 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98f826-a6c8-4ca0-825c-13c374492ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:52.267615 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98f826-a6c8-4ca0-825c-13c374492ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:52.267967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98f826-a6c8-4ca0-825c-13c374492ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:52.268277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98f826-a6c8-4ca0-825c-13c374492ee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:52.269382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98f826-a6c8-4ca0-825c-13c374492ee2 None admin] RBAC: Adding query filter params (role.id=8e7b3a48a50745adad97c6205aafc562, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=2974669e9d1a417892b1d59dbc9e87ae) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:52.269828 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98f826-a6c8-4ca0-825c-13c374492ee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:52.271343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98f826-a6c8-4ca0-825c-13c374492ee2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:52.274860 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827ddbd-1a6e-4d3f-a55e-ba9812e4012e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:52.276323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827ddbd-1a6e-4d3f-a55e-ba9812e4012e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:52.280913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 239/511] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:08:52 2022] GET /identity/v3/role_assignments?user.id=2974669e9d1a417892b1d59dbc9e87ae&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=8e7b3a48a50745adad97c6205aafc562 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:52.282428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98f826-a6c8-4ca0-825c-13c374492ee2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6827ddbd-1a6e-4d3f-a55e-ba9812e4012e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:08:52.290940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:52.292602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:52.294583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:52.294583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:52.294583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:08:52.294583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:08:52.294583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:08:52.294583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:08:52.294583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:08:52.294583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:08:52.294583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 16:08:52.294583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:52.294583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 273/512] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:08:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:52.294583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827ddbd-1a6e-4d3f-a55e-ba9812e4012e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:52.304778 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:52.454676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:52.460486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827ddbd-1a6e-4d3f-a55e-ba9812e4012e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:52.461008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98f826-a6c8-4ca0-825c-13c374492ee2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:52.514222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407936a-8541-4082-a140-5c9acee79401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:52.514758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407936a-8541-4082-a140-5c9acee79401 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:52.515037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407936a-8541-4082-a140-5c9acee79401 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:52.515307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407936a-8541-4082-a140-5c9acee79401 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:52.515975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407936a-8541-4082-a140-5c9acee79401 None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:52.516307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407936a-8541-4082-a140-5c9acee79401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:52.517873 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407936a-8541-4082-a140-5c9acee79401 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:52.519403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac4db-b736-4550-8293-664b3aee5392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:52.520460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac4db-b736-4550-8293-664b3aee5392 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:52.520989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac4db-b736-4550-8293-664b3aee5392 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:52.521495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac4db-b736-4550-8293-664b3aee5392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:52.534787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 240/513] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:08:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:52.534787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407936a-8541-4082-a140-5c9acee79401 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:52.541146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbac4db-b736-4550-8293-664b3aee5392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:52.542730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbac4db-b736-4550-8293-664b3aee5392 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-bbbac4db-b736-4550-8293-664b3aee5392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:52.563291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:52.564311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:52.565209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:52.565209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:52.565209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:52.565209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 274/514] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:52.565701 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac4db-b736-4550-8293-664b3aee5392 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:52.635332 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:52.688413 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac4db-b736-4550-8293-664b3aee5392 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:52.701644 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407936a-8541-4082-a140-5c9acee79401 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:52.731544 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc99d9-d435-4dc5-88cf-2eac06db1d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:52.732165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc99d9-d435-4dc5-88cf-2eac06db1d37 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:52.732457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc99d9-d435-4dc5-88cf-2eac06db1d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:52.732780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc99d9-d435-4dc5-88cf-2eac06db1d37 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:52.733599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc99d9-d435-4dc5-88cf-2eac06db1d37 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:52.733900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc99d9-d435-4dc5-88cf-2eac06db1d37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:52.735347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc99d9-d435-4dc5-88cf-2eac06db1d37 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:52.760953 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 275/515] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Sep 21 16:08:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:52.763037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc99d9-d435-4dc5-88cf-2eac06db1d37 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:52.766573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501473a1-a602-435d-8759-ba00fc88085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:52.767543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501473a1-a602-435d-8759-ba00fc88085e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:52.767946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501473a1-a602-435d-8759-ba00fc88085e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:52.768425 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501473a1-a602-435d-8759-ba00fc88085e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:52.782255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501473a1-a602-435d-8759-ba00fc88085e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:52.784261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:52.785461 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501473a1-a602-435d-8759-ba00fc88085e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-501473a1-a602-435d-8759-ba00fc88085e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:08:52.807581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:52.808569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:52.809516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:52.809516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:52.809516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:08:52.809516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:08:52.809516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:08:52.809516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:08:52.809516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:08:52.809516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:08:52.809516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 16:08:52.809516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:52.810046 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 241/516] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:52.811057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501473a1-a602-435d-8759-ba00fc88085e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:52.940428 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc99d9-d435-4dc5-88cf-2eac06db1d37 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:52.983981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501473a1-a602-435d-8759-ba00fc88085e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:53.004575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d5edf-d78e-4dea-bb5c-2dd21e75025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:53.005928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d5edf-d78e-4dea-bb5c-2dd21e75025a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:53.006561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d5edf-d78e-4dea-bb5c-2dd21e75025a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:53.007085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d5edf-d78e-4dea-bb5c-2dd21e75025a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:53.028223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d5edf-d78e-4dea-bb5c-2dd21e75025a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:53.030643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d5edf-d78e-4dea-bb5c-2dd21e75025a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:53.036297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:53.050479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7629473-1c55-4f06-a1aa-6b9c2d2d6941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:53.051096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7629473-1c55-4f06-a1aa-6b9c2d2d6941 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:53.051378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7629473-1c55-4f06-a1aa-6b9c2d2d6941 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:53.051646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7629473-1c55-4f06-a1aa-6b9c2d2d6941 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:53.052312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7629473-1c55-4f06-a1aa-6b9c2d2d6941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:53.052610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7629473-1c55-4f06-a1aa-6b9c2d2d6941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:53.054124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7629473-1c55-4f06-a1aa-6b9c2d2d6941 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d16d5edf-d78e-4dea-bb5c-2dd21e75025a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:53.060244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:53.062319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:53.072482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:53.072482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:53.072482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:53.072482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 276/517] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:53.072482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d5edf-d78e-4dea-bb5c-2dd21e75025a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:53.074150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 242/518] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:53.074150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7629473-1c55-4f06-a1aa-6b9c2d2d6941 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:53.194696 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:53.217665 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7629473-1c55-4f06-a1aa-6b9c2d2d6941 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:53.282135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960c953-2304-4b90-9521-dd5e8092731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:53.283062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960c953-2304-4b90-9521-dd5e8092731f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:53.283528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960c953-2304-4b90-9521-dd5e8092731f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:53.283988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960c953-2304-4b90-9521-dd5e8092731f None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:53.285354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960c953-2304-4b90-9521-dd5e8092731f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:53.285878 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960c953-2304-4b90-9521-dd5e8092731f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:53.286854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d5edf-d78e-4dea-bb5c-2dd21e75025a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:53.288609 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960c953-2304-4b90-9521-dd5e8092731f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:53.353768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaefd9-73cb-4e8f-b2d9-270f9e1be836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:53.355199 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaefd9-73cb-4e8f-b2d9-270f9e1be836 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:53.355914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaefd9-73cb-4e8f-b2d9-270f9e1be836 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:53.356571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaefd9-73cb-4e8f-b2d9-270f9e1be836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:53.359755 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 243/519] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 21 16:08:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:53.361340 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960c953-2304-4b90-9521-dd5e8092731f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:53.443001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:53.490468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaefd9-73cb-4e8f-b2d9-270f9e1be836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:53.491952 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaefd9-73cb-4e8f-b2d9-270f9e1be836 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:53.540678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960c953-2304-4b90-9521-dd5e8092731f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:53.561465 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:53.588987 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d59f6-0e58-44dd-af5a-917c0c7a2a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:53.589865 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d59f6-0e58-44dd-af5a-917c0c7a2a08 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:53.590140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d59f6-0e58-44dd-af5a-917c0c7a2a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:53.590539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d59f6-0e58-44dd-af5a-917c0c7a2a08 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:53.591061 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d59f6-0e58-44dd-af5a-917c0c7a2a08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:53.591885 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d59f6-0e58-44dd-af5a-917c0c7a2a08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:53.592802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d59f6-0e58-44dd-af5a-917c0c7a2a08 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:53.613955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 244/520] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:53.613955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d59f6-0e58-44dd-af5a-917c0c7a2a08 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:53.624659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 277/521] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:53.624659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaefd9-73cb-4e8f-b2d9-270f9e1be836 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:53.748257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d59f6-0e58-44dd-af5a-917c0c7a2a08 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:53.757212 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:53.764769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaefd9-73cb-4e8f-b2d9-270f9e1be836 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:53.791417 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac94447-d9a8-411a-9756-1f9c19007fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:53.791997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac94447-d9a8-411a-9756-1f9c19007fb6 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:53.792329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac94447-d9a8-411a-9756-1f9c19007fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:53.792597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac94447-d9a8-411a-9756-1f9c19007fb6 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:53.793290 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac94447-d9a8-411a-9756-1f9c19007fb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:53.794927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac94447-d9a8-411a-9756-1f9c19007fb6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:53.809505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c289a51-ae0e-4156-9b90-5c7a58e7882f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:53.810636 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c289a51-ae0e-4156-9b90-5c7a58e7882f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:53.811388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c289a51-ae0e-4156-9b90-5c7a58e7882f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:53.811955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c289a51-ae0e-4156-9b90-5c7a58e7882f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:53.832714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 245/522] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:08:53 2022] POST /identity/v3/users => generated 247 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:08:53.832714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac94447-d9a8-411a-9756-1f9c19007fb6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:53.871730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:53.956529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c289a51-ae0e-4156-9b90-5c7a58e7882f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:53.959621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c289a51-ae0e-4156-9b90-5c7a58e7882f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:54.035882 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac94447-d9a8-411a-9756-1f9c19007fb6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:54.088071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8f3e5-9a16-4a36-be0e-c0bfd0315c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:54.089098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8f3e5-9a16-4a36-be0e-c0bfd0315c24 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:54.089724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8f3e5-9a16-4a36-be0e-c0bfd0315c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:54.090148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8f3e5-9a16-4a36-be0e-c0bfd0315c24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:54.106475 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8f3e5-9a16-4a36-be0e-c0bfd0315c24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:54.109990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8f3e5-9a16-4a36-be0e-c0bfd0315c24 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-bec8f3e5-9a16-4a36-be0e-c0bfd0315c24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:08:54.126595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:54.128356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:54.130140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:54.130140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:54.130140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:08:54.130140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:08:54.130140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:08:54.130140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:08:54.130140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:08:54.130140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:08:54.130140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:08:54.130140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:54.130140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 246/523] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 21 16:08:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:54.130140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8f3e5-9a16-4a36-be0e-c0bfd0315c24 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:54.144674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 278/524] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:54.146842 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c289a51-ae0e-4156-9b90-5c7a58e7882f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:54.163945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:54.253702 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:54.282900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8f3e5-9a16-4a36-be0e-c0bfd0315c24 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:54.333873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c289a51-ae0e-4156-9b90-5c7a58e7882f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:54.348116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e90a82-bf6e-4b5e-9e73-c0409e36d7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:54.349761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e90a82-bf6e-4b5e-9e73-c0409e36d7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:54.350534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e90a82-bf6e-4b5e-9e73-c0409e36d7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:54.351240 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e90a82-bf6e-4b5e-9e73-c0409e36d7d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:54.373352 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e90a82-bf6e-4b5e-9e73-c0409e36d7d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:54.376755 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e90a82-bf6e-4b5e-9e73-c0409e36d7d0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:54.402291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e92aa1-091d-4791-983e-f0571bed5ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:54.403261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92aa1-091d-4791-983e-f0571bed5ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:54.403730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92aa1-091d-4791-983e-f0571bed5ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:54.404196 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92aa1-091d-4791-983e-f0571bed5ea3 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:54.405485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e92aa1-091d-4791-983e-f0571bed5ea3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:54.405995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e92aa1-091d-4791-983e-f0571bed5ea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-b9e90a82-bf6e-4b5e-9e73-c0409e36d7d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:54.407734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:54.409736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:54.411378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:54.411378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:54.411378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:54.411689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e92aa1-091d-4791-983e-f0571bed5ea3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:54.414596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 247/525] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:54.416542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e90a82-bf6e-4b5e-9e73-c0409e36d7d0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:54.455339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 279/526] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 21 16:08:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:54.455339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e92aa1-091d-4791-983e-f0571bed5ea3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:54.551781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:54.580914 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e90a82-bf6e-4b5e-9e73-c0409e36d7d0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:54.606487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e92aa1-091d-4791-983e-f0571bed5ea3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:54.620985 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109034-3249-4f3e-8b1e-114fd74fa6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:54.621980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109034-3249-4f3e-8b1e-114fd74fa6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:54.622464 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109034-3249-4f3e-8b1e-114fd74fa6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:54.622937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109034-3249-4f3e-8b1e-114fd74fa6d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:54.634795 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25109034-3249-4f3e-8b1e-114fd74fa6d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:54.636602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25109034-3249-4f3e-8b1e-114fd74fa6d3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:54.637219 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:54.646595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e8fc1-ed64-43f1-9898-ff24740e28b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:54.647528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8fc1-ed64-43f1-9898-ff24740e28b7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:54.647652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8fc1-ed64-43f1-9898-ff24740e28b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:54.647909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8fc1-ed64-43f1-9898-ff24740e28b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:54.648561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e8fc1-ed64-43f1-9898-ff24740e28b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:54.648910 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e8fc1-ed64-43f1-9898-ff24740e28b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:54.650884 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e8fc1-ed64-43f1-9898-ff24740e28b7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-25109034-3249-4f3e-8b1e-114fd74fa6d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:54.655597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:54.656537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:54.657442 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:54.657442 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:54.657442 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:54.663735 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 248/527] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:54.663735 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109034-3249-4f3e-8b1e-114fd74fa6d3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:54.668633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 280/528] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:54.669340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e8fc1-ed64-43f1-9898-ff24740e28b7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:54.783326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109034-3249-4f3e-8b1e-114fd74fa6d3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:54.813220 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:54.824831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4894bd3-2ea3-489a-8d85-337660838f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:54.825511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894bd3-2ea3-489a-8d85-337660838f00 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:54.825880 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894bd3-2ea3-489a-8d85-337660838f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:54.826157 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894bd3-2ea3-489a-8d85-337660838f00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:54.827703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e8fc1-ed64-43f1-9898-ff24740e28b7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:54.880492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3190830-5acb-4b2d-b9ed-1814b5ba8dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:54.881614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3190830-5acb-4b2d-b9ed-1814b5ba8dee None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:54.882007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3190830-5acb-4b2d-b9ed-1814b5ba8dee None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:54.882442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3190830-5acb-4b2d-b9ed-1814b5ba8dee None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:54.883114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3190830-5acb-4b2d-b9ed-1814b5ba8dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:54.883418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3190830-5acb-4b2d-b9ed-1814b5ba8dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:54.885478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3190830-5acb-4b2d-b9ed-1814b5ba8dee None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:54.905047 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 281/529] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:54.905047 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3190830-5acb-4b2d-b9ed-1814b5ba8dee None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:54.913835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4894bd3-2ea3-489a-8d85-337660838f00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:54.915466 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4894bd3-2ea3-489a-8d85-337660838f00 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:54.949462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:55.038955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 249/530] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:08:55.040974 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226c6cd-a0c4-491c-9da4-7193ffbd365f None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:55.041357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226c6cd-a0c4-491c-9da4-7193ffbd365f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:55.041620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226c6cd-a0c4-491c-9da4-7193ffbd365f None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:55.044822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 250/531] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:55.044822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226c6cd-a0c4-491c-9da4-7193ffbd365f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:55.067867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3190830-5acb-4b2d-b9ed-1814b5ba8dee None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:55.078040 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:55.132641 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5d67f-3c31-471b-8d27-d9abc6df97de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:55.134343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5d67f-3c31-471b-8d27-d9abc6df97de None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:55.134789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5d67f-3c31-471b-8d27-d9abc6df97de None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:55.135303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5d67f-3c31-471b-8d27-d9abc6df97de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:55.146757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5d67f-3c31-471b-8d27-d9abc6df97de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:55.149660 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5d67f-3c31-471b-8d27-d9abc6df97de None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fdf5d67f-3c31-471b-8d27-d9abc6df97de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:08:55.170331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:55.172022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:55.173774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:08:55.173774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:08:55.173774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:08:55.173774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:08:55.173774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:08:55.173774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:08:55.173774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:08:55.173774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:55.173774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 282/532] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:55.173774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5d67f-3c31-471b-8d27-d9abc6df97de None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:55.212447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226c6cd-a0c4-491c-9da4-7193ffbd365f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:55.271440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7470f46-c4ad-4b78-8fc4-9ba0698ba0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:55.272067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7470f46-c4ad-4b78-8fc4-9ba0698ba0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:55.272343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7470f46-c4ad-4b78-8fc4-9ba0698ba0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:55.272608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7470f46-c4ad-4b78-8fc4-9ba0698ba0a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:55.280298 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7470f46-c4ad-4b78-8fc4-9ba0698ba0a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:55.281781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7470f46-c4ad-4b78-8fc4-9ba0698ba0a4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-c7470f46-c4ad-4b78-8fc4-9ba0698ba0a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:08:55.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:55.295365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:55.297035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:08:55.297035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:08:55.297035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:08:55.297035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:08:55.297035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:08:55.297035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:08:55.297035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:08:55.297035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:55.297035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 251/533] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:55.297035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97263f-eba5-405c-ae10-a3221ed9207b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:55.297035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97263f-eba5-405c-ae10-a3221ed9207b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:55.298139 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97263f-eba5-405c-ae10-a3221ed9207b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:55.309420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:55.316607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5d67f-3c31-471b-8d27-d9abc6df97de None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:55.321086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-df97263f-eba5-405c-ae10-a3221ed9207b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:55.323058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-df97263f-eba5-405c-ae10-a3221ed9207b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:55.372379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c53519-de2d-4313-8ccb-0ddd3d151593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:55.373384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c53519-de2d-4313-8ccb-0ddd3d151593 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:55.373823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c53519-de2d-4313-8ccb-0ddd3d151593 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:55.374315 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c53519-de2d-4313-8ccb-0ddd3d151593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:55.391176 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c53519-de2d-4313-8ccb-0ddd3d151593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:55.392735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c53519-de2d-4313-8ccb-0ddd3d151593 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d2c53519-de2d-4313-8ccb-0ddd3d151593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:55.409528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:55.411148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:55.412849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:55.412849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:55.412849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:55.412849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 283/534] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:55.412849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c53519-de2d-4313-8ccb-0ddd3d151593 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:55.431945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 252/535] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:55.431945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97263f-eba5-405c-ae10-a3221ed9207b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:55.468429 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:55.543634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c53519-de2d-4313-8ccb-0ddd3d151593 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:55.612352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365ea4b-418b-4402-9206-f2ef6a113c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:55.613745 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365ea4b-418b-4402-9206-f2ef6a113c66 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:55.614219 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365ea4b-418b-4402-9206-f2ef6a113c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:55.614691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365ea4b-418b-4402-9206-f2ef6a113c66 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:55.614844 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97263f-eba5-405c-ae10-a3221ed9207b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:55.615964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365ea4b-418b-4402-9206-f2ef6a113c66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:55.616917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365ea4b-418b-4402-9206-f2ef6a113c66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:55.621120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365ea4b-418b-4402-9206-f2ef6a113c66 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:55.656516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd870d-c91b-49b8-91a7-532794d91e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:55.657088 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd870d-c91b-49b8-91a7-532794d91e14 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:55.657365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd870d-c91b-49b8-91a7-532794d91e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:55.657633 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd870d-c91b-49b8-91a7-532794d91e14 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:55.658338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd870d-c91b-49b8-91a7-532794d91e14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:55.658642 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd870d-c91b-49b8-91a7-532794d91e14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:55.660100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd870d-c91b-49b8-91a7-532794d91e14 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:55.668847 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 284/536] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:55.669793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365ea4b-418b-4402-9206-f2ef6a113c66 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:55.679822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 253/537] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:55.683470 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd870d-c91b-49b8-91a7-532794d91e14 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:55.687109 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:55.819625 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365ea4b-418b-4402-9206-f2ef6a113c66 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:55.842567 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:55.873805 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd870d-c91b-49b8-91a7-532794d91e14 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:55.894577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5031bb-7edf-4b29-a92a-4e5265816d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:55.896021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5031bb-7edf-4b29-a92a-4e5265816d8b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:55.896820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5031bb-7edf-4b29-a92a-4e5265816d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:55.898341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5031bb-7edf-4b29-a92a-4e5265816d8b None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:55.900852 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5031bb-7edf-4b29-a92a-4e5265816d8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:55.902014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5031bb-7edf-4b29-a92a-4e5265816d8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:55.906682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5031bb-7edf-4b29-a92a-4e5265816d8b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:55.915801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ae58d-e7b4-4908-a22c-64aa96b31f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:55.916563 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ae58d-e7b4-4908-a22c-64aa96b31f1f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:55.916991 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ae58d-e7b4-4908-a22c-64aa96b31f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:55.917362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ae58d-e7b4-4908-a22c-64aa96b31f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:55.918205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ae58d-e7b4-4908-a22c-64aa96b31f1f None admin] RBAC: Adding query filter params (role.id=8e7b3a48a50745adad97c6205aafc562, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=0e765e2cc4c94243b00f919e8f8d01a1) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:55.918638 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ae58d-e7b4-4908-a22c-64aa96b31f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:55.920227 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ae58d-e7b4-4908-a22c-64aa96b31f1f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:55.927521 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 254/538] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:08:55 2022] GET /identity/v3/role_assignments?user.id=0e765e2cc4c94243b00f919e8f8d01a1&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=8e7b3a48a50745adad97c6205aafc562 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:55.928597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ae58d-e7b4-4908-a22c-64aa96b31f1f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:55.945615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 285/539] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:55.946882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5031bb-7edf-4b29-a92a-4e5265816d8b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:56.085432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:56.133179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ae58d-e7b4-4908-a22c-64aa96b31f1f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:56.145281 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5031bb-7edf-4b29-a92a-4e5265816d8b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:56.190511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e9b1c-5382-4618-a335-ab53e4f5e47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:56.191792 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e9b1c-5382-4618-a335-ab53e4f5e47f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:56.192437 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e9b1c-5382-4618-a335-ab53e4f5e47f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:56.193178 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e9b1c-5382-4618-a335-ab53e4f5e47f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:56.195150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e9b1c-5382-4618-a335-ab53e4f5e47f None admin] RBAC: Adding query filter params (role.id=8e7b3a48a50745adad97c6205aafc562, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=aa61549530e648a0b774a784b0450162) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:56.196235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e9b1c-5382-4618-a335-ab53e4f5e47f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:56.199603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c715138-6e94-437a-b76a-5bb2c4dae655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:56.200250 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c715138-6e94-437a-b76a-5bb2c4dae655 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:56.200527 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c715138-6e94-437a-b76a-5bb2c4dae655 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:56.200833 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c715138-6e94-437a-b76a-5bb2c4dae655 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:56.201706 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e9b1c-5382-4618-a335-ab53e4f5e47f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:56.213383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 255/540] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:08:55 2022] GET /identity/v3/role_assignments?user.id=aa61549530e648a0b774a784b0450162&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=8e7b3a48a50745adad97c6205aafc562 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:56.214324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c715138-6e94-437a-b76a-5bb2c4dae655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:56.215980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e9b1c-5382-4618-a335-ab53e4f5e47f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3c715138-6e94-437a-b76a-5bb2c4dae655 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:56.220312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:56.222529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:56.224522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:56.224522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:56.224522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:56.224522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:56.224522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:56.224522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:56.224522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:56.224522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:56.224522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:56.224522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:56.224522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:08:56.224522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:56.224522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 286/541] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:08:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:56.234148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:56.234395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c715138-6e94-437a-b76a-5bb2c4dae655 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:56.392751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c715138-6e94-437a-b76a-5bb2c4dae655 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:56.433119 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:56.438158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024e724-2f41-4a80-97de-b3973958e044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:56.439312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024e724-2f41-4a80-97de-b3973958e044 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:56.439707 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024e724-2f41-4a80-97de-b3973958e044 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:56.440087 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024e724-2f41-4a80-97de-b3973958e044 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:56.441079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024e724-2f41-4a80-97de-b3973958e044 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:56.441491 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024e724-2f41-4a80-97de-b3973958e044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:56.443101 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024e724-2f41-4a80-97de-b3973958e044 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:56.455155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 287/542] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:08:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:56.466818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024e724-2f41-4a80-97de-b3973958e044 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:56.613170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e9b1c-5382-4618-a335-ab53e4f5e47f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:56.628285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024e724-2f41-4a80-97de-b3973958e044 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:56.685270 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697cfee-f720-4d76-ae2e-baf02e33db9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:56.686344 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697cfee-f720-4d76-ae2e-baf02e33db9d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:56.687003 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697cfee-f720-4d76-ae2e-baf02e33db9d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:56.688084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697cfee-f720-4d76-ae2e-baf02e33db9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:56.701213 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697cfee-f720-4d76-ae2e-baf02e33db9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:56.703744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697cfee-f720-4d76-ae2e-baf02e33db9d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:56.712204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67e7de-64e7-405d-8067-b08a7cf89b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:56.712885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67e7de-64e7-405d-8067-b08a7cf89b86 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:56.713161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67e7de-64e7-405d-8067-b08a7cf89b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:56.713429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67e7de-64e7-405d-8067-b08a7cf89b86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:56.725788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67e7de-64e7-405d-8067-b08a7cf89b86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:56.727414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67e7de-64e7-405d-8067-b08a7cf89b86 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-c697cfee-f720-4d76-ae2e-baf02e33db9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:08:56.730399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:56.731283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:56.732135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:08:56.732135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:08:56.732135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:08:56.732135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:08:56.732135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:08:56.732135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:08:56.732135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:08:56.732135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:56.733103 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 256/543] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:08:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 518 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:56.734997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6eb66-7ded-480c-acac-df1ae1890e1d None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:56.735472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6eb66-7ded-480c-acac-df1ae1890e1d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:56.735943 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6eb66-7ded-480c-acac-df1ae1890e1d None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:56.744790 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 257/544] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:56.746339 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6eb66-7ded-480c-acac-df1ae1890e1d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-cc67e7de-64e7-405d-8067-b08a7cf89b86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:56.748618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:56.749581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:56.750462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:56.750462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:56.750462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:56.753803 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 288/545] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:56.760054 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8737b1-4a0f-47f9-94e1-0dc445cd17db None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:56.760914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8737b1-4a0f-47f9-94e1-0dc445cd17db None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:56.761403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8737b1-4a0f-47f9-94e1-0dc445cd17db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:56.785243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fd8737b1-4a0f-47f9-94e1-0dc445cd17db None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:56.787408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fd8737b1-4a0f-47f9-94e1-0dc445cd17db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:56.851762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:56.855292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:56.895246 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 289/546] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:56.897384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8737b1-4a0f-47f9-94e1-0dc445cd17db None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:56.912351 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6eb66-7ded-480c-acac-df1ae1890e1d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:56.969301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479691a4-ca43-454e-a462-ac445ae8603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:56.970247 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479691a4-ca43-454e-a462-ac445ae8603c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:56.971632 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479691a4-ca43-454e-a462-ac445ae8603c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:56.972056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479691a4-ca43-454e-a462-ac445ae8603c None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:56.973026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479691a4-ca43-454e-a462-ac445ae8603c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:56.973482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479691a4-ca43-454e-a462-ac445ae8603c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:56.975133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479691a4-ca43-454e-a462-ac445ae8603c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:56.990736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 258/547] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:08:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:56.999946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479691a4-ca43-454e-a462-ac445ae8603c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:57.088618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8737b1-4a0f-47f9-94e1-0dc445cd17db None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:57.186187 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295f89e-349e-49bb-8778-780117a8c5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:57.187259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295f89e-349e-49bb-8778-780117a8c5df None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:57.187755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295f89e-349e-49bb-8778-780117a8c5df None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:57.188277 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295f89e-349e-49bb-8778-780117a8c5df None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:57.189464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295f89e-349e-49bb-8778-780117a8c5df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:57.192756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295f89e-349e-49bb-8778-780117a8c5df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:57.198498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295f89e-349e-49bb-8778-780117a8c5df None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:57.218882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 290/548] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:57.219836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295f89e-349e-49bb-8778-780117a8c5df None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:57.264351 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479691a4-ca43-454e-a462-ac445ae8603c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:57.279865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:57.317233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:57.337662 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e49c20-4104-4bd0-ae2f-abb6b350f307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:57.338931 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e49c20-4104-4bd0-ae2f-abb6b350f307 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:57.339803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e49c20-4104-4bd0-ae2f-abb6b350f307 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:57.340368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e49c20-4104-4bd0-ae2f-abb6b350f307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:57.341340 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e49c20-4104-4bd0-ae2f-abb6b350f307 None admin] RBAC: Adding query filter params (role.id=8e7b3a48a50745adad97c6205aafc562, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=d7ff08c990dc41b4811f97fecb7c4c3a) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:57.341840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e49c20-4104-4bd0-ae2f-abb6b350f307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:57.343491 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e49c20-4104-4bd0-ae2f-abb6b350f307 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:57.351991 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 259/549] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:08:56 2022] GET /identity/v3/role_assignments?user.id=d7ff08c990dc41b4811f97fecb7c4c3a&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=8e7b3a48a50745adad97c6205aafc562 => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:57.353795 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e49c20-4104-4bd0-ae2f-abb6b350f307 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:57.390356 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295f89e-349e-49bb-8778-780117a8c5df None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:57.455909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430417f-16b4-40c0-981a-923a8b670a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:57.457416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430417f-16b4-40c0-981a-923a8b670a1f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:57.457893 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430417f-16b4-40c0-981a-923a8b670a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:57.458384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430417f-16b4-40c0-981a-923a8b670a1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:57.481528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430417f-16b4-40c0-981a-923a8b670a1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c430417f-16b4-40c0-981a-923a8b670a1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:57.488107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:57.489336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:57.490357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:57.490357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:57.490357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:57.490357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:57.490357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:57.490357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:57.490357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:57.490357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:57.490357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:57.490357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:57.490357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:08:57.490357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:57.492896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 291/550] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:08:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:57.498863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430417f-16b4-40c0-981a-923a8b670a1f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:57.556576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e49c20-4104-4bd0-ae2f-abb6b350f307 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:57.640228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b90c31-3499-4e4a-b177-7a0e04d513dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:57.641125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b90c31-3499-4e4a-b177-7a0e04d513dd None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:57.641400 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b90c31-3499-4e4a-b177-7a0e04d513dd None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:57.641667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b90c31-3499-4e4a-b177-7a0e04d513dd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:57.657628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b90c31-3499-4e4a-b177-7a0e04d513dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:57.659113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b90c31-3499-4e4a-b177-7a0e04d513dd None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-d6b90c31-3499-4e4a-b177-7a0e04d513dd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:08:57.683946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:57.685071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:57.685995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:57.685995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:57.685995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:08:57.685995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:08:57.685995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:08:57.685995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:08:57.685995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:08:57.685995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:08:57.685995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 16:08:57.685995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:57.686796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 260/551] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:08:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:57.703280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b90c31-3499-4e4a-b177-7a0e04d513dd None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:57.710583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430417f-16b4-40c0-981a-923a8b670a1f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:57.716446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:57.779605 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a85df8-38ad-4a16-aad2-679ad8ded183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:57.780246 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a85df8-38ad-4a16-aad2-679ad8ded183 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:57.780605 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a85df8-38ad-4a16-aad2-679ad8ded183 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:57.780937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a85df8-38ad-4a16-aad2-679ad8ded183 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:57.781671 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a85df8-38ad-4a16-aad2-679ad8ded183 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:57.781996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a85df8-38ad-4a16-aad2-679ad8ded183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:57.783700 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a85df8-38ad-4a16-aad2-679ad8ded183 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:57.819229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 292/552] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:08:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:57.828495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a85df8-38ad-4a16-aad2-679ad8ded183 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:57.851781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:57.950926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b90c31-3499-4e4a-b177-7a0e04d513dd None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:57.998392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41c824-7463-4ad6-8597-35d1e5fa5ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:57.999034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41c824-7463-4ad6-8597-35d1e5fa5ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:57.999317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41c824-7463-4ad6-8597-35d1e5fa5ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:57.999590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41c824-7463-4ad6-8597-35d1e5fa5ef1 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:58.000349 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41c824-7463-4ad6-8597-35d1e5fa5ef1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:58.000661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41c824-7463-4ad6-8597-35d1e5fa5ef1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:58.002985 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41c824-7463-4ad6-8597-35d1e5fa5ef1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:58.037952 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 261/553] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 21 16:08:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:58.044759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41c824-7463-4ad6-8597-35d1e5fa5ef1 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:58.082869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a85df8-38ad-4a16-aad2-679ad8ded183 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:58.189538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f4749-2fd1-4bec-86d5-bed10a6f034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:58.190206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f4749-2fd1-4bec-86d5-bed10a6f034c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:58.190486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f4749-2fd1-4bec-86d5-bed10a6f034c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:58.191907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f4749-2fd1-4bec-86d5-bed10a6f034c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:58.207906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f4749-2fd1-4bec-86d5-bed10a6f034c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:58.209445 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f4749-2fd1-4bec-86d5-bed10a6f034c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:58.223781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41c824-7463-4ad6-8597-35d1e5fa5ef1 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-012f4749-2fd1-4bec-86d5-bed10a6f034c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:58.240717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:58.241740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:58.242629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:58.242629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:58.242629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:58.242629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 293/554] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:08:58.243702 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f4749-2fd1-4bec-86d5-bed10a6f034c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:58.253080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:58.264814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:58.308349 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f35d5-0231-4b5b-8991-04e2897bf23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:58.308936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f35d5-0231-4b5b-8991-04e2897bf23b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:58.309210 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f35d5-0231-4b5b-8991-04e2897bf23b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:58.309477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f35d5-0231-4b5b-8991-04e2897bf23b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:58.334257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f35d5-0231-4b5b-8991-04e2897bf23b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:58.335748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f35d5-0231-4b5b-8991-04e2897bf23b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-dd6f35d5-0231-4b5b-8991-04e2897bf23b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:08:58.365847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:58.366855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:08:58.368773 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:08:58.368773 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:08:58.368773 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:58.372727 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 262/555] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:58.375987 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f35d5-0231-4b5b-8991-04e2897bf23b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:58.501193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f4749-2fd1-4bec-86d5-bed10a6f034c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:58.563669 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbf663-54a7-431d-894a-6663599ca2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:58.564194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbf663-54a7-431d-894a-6663599ca2ec None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:58.564477 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbf663-54a7-431d-894a-6663599ca2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:58.564776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbf663-54a7-431d-894a-6663599ca2ec None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:58.565815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbf663-54a7-431d-894a-6663599ca2ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:58.565815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbf663-54a7-431d-894a-6663599ca2ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:58.567164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbf663-54a7-431d-894a-6663599ca2ec None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:58.581708 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 294/556] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:58.587940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbf663-54a7-431d-894a-6663599ca2ec None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:58.672181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f35d5-0231-4b5b-8991-04e2897bf23b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:58.699118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:58.749207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e573446-65b6-49bb-b472-477f2023c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:58.749831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e573446-65b6-49bb-b472-477f2023c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:58.750118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e573446-65b6-49bb-b472-477f2023c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:58.750454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e573446-65b6-49bb-b472-477f2023c9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:58.751426 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e573446-65b6-49bb-b472-477f2023c9b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:58.751740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e573446-65b6-49bb-b472-477f2023c9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:58.753661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e573446-65b6-49bb-b472-477f2023c9b7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:58.764552 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbf663-54a7-431d-894a-6663599ca2ec None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:58.772877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 263/557] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:08:58.776131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44febc-f675-4cb4-bbc8-3fa575a53aef None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:58.776436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44febc-f675-4cb4-bbc8-3fa575a53aef None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:58.776897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44febc-f675-4cb4-bbc8-3fa575a53aef None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:58.778749 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 264/558] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:58.779657 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44febc-f675-4cb4-bbc8-3fa575a53aef None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:58.812897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:58.819771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c1c2a-ebfb-4c22-acab-c39e1e8af562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:58.820853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1c2a-ebfb-4c22-acab-c39e1e8af562 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:58.821374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1c2a-ebfb-4c22-acab-c39e1e8af562 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:58.822003 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1c2a-ebfb-4c22-acab-c39e1e8af562 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:58.831512 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c1c2a-ebfb-4c22-acab-c39e1e8af562 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:58.834168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c1c2a-ebfb-4c22-acab-c39e1e8af562 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7c3c1c2a-ebfb-4c22-acab-c39e1e8af562 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:08:58.854242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:58.855276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:58.856224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:58.856224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:58.856224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:08:58.856224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:08:58.856224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:08:58.856224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:08:58.856224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:08:58.856224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:08:58.856224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 16:08:58.856224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:58.861720 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 295/559] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:08:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:58.863526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e94e6a-74d0-4049-9f49-2ef0709e44dd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:58.863809 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e94e6a-74d0-4049-9f49-2ef0709e44dd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:58.864114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e94e6a-74d0-4049-9f49-2ef0709e44dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:58.892585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d1e94e6a-74d0-4049-9f49-2ef0709e44dd None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:08:58.894039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d1e94e6a-74d0-4049-9f49-2ef0709e44dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:08:58.927273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44febc-f675-4cb4-bbc8-3fa575a53aef None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:58.987398 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f36a6d-6b6d-46a3-b135-44f5126a4fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:58.989048 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f36a6d-6b6d-46a3-b135-44f5126a4fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:58.990219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f36a6d-6b6d-46a3-b135-44f5126a4fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:58.990731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f36a6d-6b6d-46a3-b135-44f5126a4fe0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:59.000428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f36a6d-6b6d-46a3-b135-44f5126a4fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:59.002369 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f36a6d-6b6d-46a3-b135-44f5126a4fe0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-01f36a6d-6b6d-46a3-b135-44f5126a4fe0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:08:59.019404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:59.020375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:59.021355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:08:59.021355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:08:59.021355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:08:59.021355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:08:59.021355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:08:59.021355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:08:59.021355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:08:59.021355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:08:59.028898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 265/560] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:08:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:59.028898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f36a6d-6b6d-46a3-b135-44f5126a4fe0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:59.041331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 296/561] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:08:59.045733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e94e6a-74d0-4049-9f49-2ef0709e44dd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:59.187632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:59.223989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:59.254192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f36a6d-6b6d-46a3-b135-44f5126a4fe0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:59.296840 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e94e6a-74d0-4049-9f49-2ef0709e44dd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:59.308388 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55480e-8619-47b3-9721-5669e5786719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:59.309521 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55480e-8619-47b3-9721-5669e5786719 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:59.310079 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55480e-8619-47b3-9721-5669e5786719 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:59.310582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55480e-8619-47b3-9721-5669e5786719 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:59.311531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55480e-8619-47b3-9721-5669e5786719 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:59.312045 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55480e-8619-47b3-9721-5669e5786719 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:59.313760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55480e-8619-47b3-9721-5669e5786719 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:59.337940 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 266/562] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 21 16:08:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:59.346515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55480e-8619-47b3-9721-5669e5786719 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:59.371534 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9603bd3-825e-4c84-a370-bf9fde48dfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:59.372935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9603bd3-825e-4c84-a370-bf9fde48dfc8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:59.373439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9603bd3-825e-4c84-a370-bf9fde48dfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:59.373921 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9603bd3-825e-4c84-a370-bf9fde48dfc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:59.374872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9603bd3-825e-4c84-a370-bf9fde48dfc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:08:59.375386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9603bd3-825e-4c84-a370-bf9fde48dfc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:59.377079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9603bd3-825e-4c84-a370-bf9fde48dfc8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:59.391344 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 297/563] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:08:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:08:59.397621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9603bd3-825e-4c84-a370-bf9fde48dfc8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:59.556178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9603bd3-825e-4c84-a370-bf9fde48dfc8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:59.577944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:59.598987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600daf6-e7ef-4644-9856-7b62921267d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:59.600074 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600daf6-e7ef-4644-9856-7b62921267d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:59.600575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600daf6-e7ef-4644-9856-7b62921267d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:59.601100 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600daf6-e7ef-4644-9856-7b62921267d3 None admin] PATH_INFO: `/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/2974669e9d1a417892b1d59dbc9e87ae/roles/8e7b3a48a50745adad97c6205aafc562` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:59.619384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600daf6-e7ef-4644-9856-7b62921267d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=78142a67f69a4ba58113cc7c8dc269b1, user_id=2974669e9d1a417892b1d59dbc9e87ae, role_id=8e7b3a48a50745adad97c6205aafc562)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:59.621368 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600daf6-e7ef-4644-9856-7b62921267d3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:59.641768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 298/564] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:08:59 2022] PUT /identity/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/2974669e9d1a417892b1d59dbc9e87ae/roles/8e7b3a48a50745adad97c6205aafc562 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:08:59.650037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998bb2c-3c5c-4db6-9009-f2e744fb52f6 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:59.650037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998bb2c-3c5c-4db6-9009-f2e744fb52f6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:59.650037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998bb2c-3c5c-4db6-9009-f2e744fb52f6 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:59.650037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 299/565] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:08:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:08:59.651548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998bb2c-3c5c-4db6-9009-f2e744fb52f6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:08:59.682020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55480e-8619-47b3-9721-5669e5786719 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:59.753305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43ceb8-3db8-4272-9f7a-dc734c62323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:59.754640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43ceb8-3db8-4272-9f7a-dc734c62323a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:59.755234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43ceb8-3db8-4272-9f7a-dc734c62323a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:59.755701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43ceb8-3db8-4272-9f7a-dc734c62323a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:59.762041 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:08:59.858775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43ceb8-3db8-4272-9f7a-dc734c62323a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:08:59.860804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43ceb8-3db8-4272-9f7a-dc734c62323a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:08:59.878475 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998bb2c-3c5c-4db6-9009-f2e744fb52f6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:08:59.933823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5881a4-1936-476f-8d49-c7ae24b76caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:08:59.935401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5881a4-1936-476f-8d49-c7ae24b76caf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:59.935904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5881a4-1936-476f-8d49-c7ae24b76caf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:59.936372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5881a4-1936-476f-8d49-c7ae24b76caf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:08:59.951845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5881a4-1936-476f-8d49-c7ae24b76caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8f5881a4-1936-476f-8d49-c7ae24b76caf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:08:59.957732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:08:59.958806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:08:59.959710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:08:59.959710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:08:59.959710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:08:59.959710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:08:59.959710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:08:59.959710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:08:59.959710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:08:59.959710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:08:59.959710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:08:59.959710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:08:59.959710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:08:59.959710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:08:59.968816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 300/566] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:08:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:08:59.968816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b874f2-532b-4621-b061-68ef8a89050d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:08:59.968816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b874f2-532b-4621-b061-68ef8a89050d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:08:59.968816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b874f2-532b-4621-b061-68ef8a89050d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:00.009806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-29b874f2-532b-4621-b061-68ef8a89050d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:00.011936 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-29b874f2-532b-4621-b061-68ef8a89050d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:00.058566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:00.076651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 267/567] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:08:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:09:00.078589 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43ceb8-3db8-4272-9f7a-dc734c62323a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:00.150700 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 301/568] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:09:00.150927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:00.153156 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b874f2-532b-4621-b061-68ef8a89050d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:00.295897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43ceb8-3db8-4272-9f7a-dc734c62323a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:00.358909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d75eac-c031-452f-af3d-f6337c51f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:00.359936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d75eac-c031-452f-af3d-f6337c51f1cf None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:00.360431 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d75eac-c031-452f-af3d-f6337c51f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:00.360945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d75eac-c031-452f-af3d-f6337c51f1cf None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:00.362076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d75eac-c031-452f-af3d-f6337c51f1cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:00.362736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d75eac-c031-452f-af3d-f6337c51f1cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:00.365283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d75eac-c031-452f-af3d-f6337c51f1cf None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:00.387322 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 268/569] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:09:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:00.391626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d75eac-c031-452f-af3d-f6337c51f1cf None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:00.472877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b874f2-532b-4621-b061-68ef8a89050d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:00.544677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae816b5d-bedb-4868-84fa-0892fcdc2dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:00.545790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae816b5d-bedb-4868-84fa-0892fcdc2dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:00.546329 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae816b5d-bedb-4868-84fa-0892fcdc2dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:00.546756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae816b5d-bedb-4868-84fa-0892fcdc2dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:00.578043 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae816b5d-bedb-4868-84fa-0892fcdc2dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:00.580608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae816b5d-bedb-4868-84fa-0892fcdc2dd6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ae816b5d-bedb-4868-84fa-0892fcdc2dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:00.606929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:00.614463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:00.617170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:00.617170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:00.617170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:00.617170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 302/570] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 457 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:00.617170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe45e4-3234-446c-bc78-787d39d0d527 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:00.617170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe45e4-3234-446c-bc78-787d39d0d527 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:00.617170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe45e4-3234-446c-bc78-787d39d0d527 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:00.617170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 303/571] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:00.617170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe45e4-3234-446c-bc78-787d39d0d527 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:00.641357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:00.653164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:00.660551 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d75eac-c031-452f-af3d-f6337c51f1cf None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:00.715282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fdffb-5dc8-4882-b763-d022575670c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:00.716266 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fdffb-5dc8-4882-b763-d022575670c4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:00.716855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fdffb-5dc8-4882-b763-d022575670c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:00.717246 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fdffb-5dc8-4882-b763-d022575670c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:00.735660 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fdffb-5dc8-4882-b763-d022575670c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:00.738271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fdffb-5dc8-4882-b763-d022575670c4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-ba1fdffb-5dc8-4882-b763-d022575670c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:00.762314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:00.763569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:00.771025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:00.771025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:00.771025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:00.771025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 269/572] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:00.771025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f356b-b907-469c-88a3-c8d2694783f9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:00.771025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f356b-b907-469c-88a3-c8d2694783f9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:00.771025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f356b-b907-469c-88a3-c8d2694783f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:00.792329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b87f356b-b907-469c-88a3-c8d2694783f9 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:00.794257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b87f356b-b907-469c-88a3-c8d2694783f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:00.815190 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe45e4-3234-446c-bc78-787d39d0d527 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:00.874826 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037e118-7f87-45e5-8110-703c835560cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:00.875821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037e118-7f87-45e5-8110-703c835560cf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:00.876282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037e118-7f87-45e5-8110-703c835560cf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:00.876764 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037e118-7f87-45e5-8110-703c835560cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:00.894550 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037e118-7f87-45e5-8110-703c835560cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0037e118-7f87-45e5-8110-703c835560cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:00.903932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:00.906045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:00.908007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:00.908007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:00.908007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:00.908007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:00.908007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:00.908007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:00.908007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:00.908007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:00.908007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:00.908007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:00.908007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:00.908007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:00.908007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 304/573] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:09:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:00.908007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037e118-7f87-45e5-8110-703c835560cf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:00.916042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 270/574] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:09:00.917781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f356b-b907-469c-88a3-c8d2694783f9 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:01.017896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:01.026727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:01.042416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f356b-b907-469c-88a3-c8d2694783f9 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:01.080311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037e118-7f87-45e5-8110-703c835560cf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:01.082569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27c7fe-fda6-4181-91ad-68139c972269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:01.083834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c7fe-fda6-4181-91ad-68139c972269 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:01.084109 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c7fe-fda6-4181-91ad-68139c972269 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:01.084381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c7fe-fda6-4181-91ad-68139c972269 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:01.085117 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27c7fe-fda6-4181-91ad-68139c972269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:01.085419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27c7fe-fda6-4181-91ad-68139c972269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:01.086888 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27c7fe-fda6-4181-91ad-68139c972269 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:01.101209 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 271/575] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:01.102102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27c7fe-fda6-4181-91ad-68139c972269 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:01.155925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d24dc-448d-4832-abfc-87ee1479a84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:01.157490 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d24dc-448d-4832-abfc-87ee1479a84c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:01.158179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d24dc-448d-4832-abfc-87ee1479a84c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:01.159303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d24dc-448d-4832-abfc-87ee1479a84c None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:01.161284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d24dc-448d-4832-abfc-87ee1479a84c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:01.162378 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d24dc-448d-4832-abfc-87ee1479a84c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:01.165808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d24dc-448d-4832-abfc-87ee1479a84c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:01.196576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 305/576] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:01.198440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d24dc-448d-4832-abfc-87ee1479a84c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:01.302737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27c7fe-fda6-4181-91ad-68139c972269 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:01.370927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5046ed-a488-4d65-86ee-3959049e8cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:01.371896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5046ed-a488-4d65-86ee-3959049e8cfb None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:01.372189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5046ed-a488-4d65-86ee-3959049e8cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:01.372955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5046ed-a488-4d65-86ee-3959049e8cfb None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:01.373890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5046ed-a488-4d65-86ee-3959049e8cfb None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:01.374394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5046ed-a488-4d65-86ee-3959049e8cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:01.376960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5046ed-a488-4d65-86ee-3959049e8cfb None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:01.392126 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d24dc-448d-4832-abfc-87ee1479a84c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:01.400212 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 272/577] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:09:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:01.401696 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5046ed-a488-4d65-86ee-3959049e8cfb None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:01.406463 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:01.431008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:01.441368 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7be55-26ce-4912-96d7-4c6cb1ae82fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:01.442467 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7be55-26ce-4912-96d7-4c6cb1ae82fb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:01.443462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7be55-26ce-4912-96d7-4c6cb1ae82fb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:01.443462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7be55-26ce-4912-96d7-4c6cb1ae82fb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:01.462216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7be55-26ce-4912-96d7-4c6cb1ae82fb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:01.465010 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7be55-26ce-4912-96d7-4c6cb1ae82fb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8ea7be55-26ce-4912-96d7-4c6cb1ae82fb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:01.486537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:01.487591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:01.488598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:01.488598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:01.488598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:01.488598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:01.488598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:01.488598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:01.488598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:01.488598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:01.488598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 16:09:01.488598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:01.488598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 306/578] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:09:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:01.489726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7be55-26ce-4912-96d7-4c6cb1ae82fb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:01.577292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5046ed-a488-4d65-86ee-3959049e8cfb None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:01.641083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfa039-2be3-4c8b-aff4-b8efb291902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:01.642166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfa039-2be3-4c8b-aff4-b8efb291902e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:01.642649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfa039-2be3-4c8b-aff4-b8efb291902e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:01.643145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfa039-2be3-4c8b-aff4-b8efb291902e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:01.647566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7be55-26ce-4912-96d7-4c6cb1ae82fb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:01.657436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfa039-2be3-4c8b-aff4-b8efb291902e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:01.660231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfa039-2be3-4c8b-aff4-b8efb291902e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-e8cfa039-2be3-4c8b-aff4-b8efb291902e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:01.683215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:01.684204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:01.685128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:01.685128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:01.685128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:01.685128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:01.685128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:01.685128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:01.685128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:01.685128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:01.685575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 273/579] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:01.686696 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfa039-2be3-4c8b-aff4-b8efb291902e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:01.696764 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd1641-01ae-46dd-a8fb-134780f4fab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:01.697420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1641-01ae-46dd-a8fb-134780f4fab5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:01.697699 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1641-01ae-46dd-a8fb-134780f4fab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:01.697969 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1641-01ae-46dd-a8fb-134780f4fab5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:01.709358 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd1641-01ae-46dd-a8fb-134780f4fab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7ebd1641-01ae-46dd-a8fb-134780f4fab5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:01.715632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:01.716930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:01.717959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:01.717959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:01.717959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:01.717959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:01.717959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:01.717959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:01.717959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:01.717959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:01.717959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:01.717959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:01.717959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:01.717959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:01.721974 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 307/580] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:09:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:01.722939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd1641-01ae-46dd-a8fb-134780f4fab5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:01.788363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:01.792267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:01.837488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfa039-2be3-4c8b-aff4-b8efb291902e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:01.876495 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b85a5b-59da-4db7-aea2-0ae3817177e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:01.877170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85a5b-59da-4db7-aea2-0ae3817177e6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:01.877446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85a5b-59da-4db7-aea2-0ae3817177e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:01.877727 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85a5b-59da-4db7-aea2-0ae3817177e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:01.885897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd1641-01ae-46dd-a8fb-134780f4fab5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:01.890145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b85a5b-59da-4db7-aea2-0ae3817177e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:01.891676 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b85a5b-59da-4db7-aea2-0ae3817177e6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-89b85a5b-59da-4db7-aea2-0ae3817177e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:01.907313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:01.908342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:01.909296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:01.909296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:01.909296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:01.909296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 274/581] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:01.909296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b85a5b-59da-4db7-aea2-0ae3817177e6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:01.954456 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d859e-7e6e-46f5-bfeb-f2bf69a4ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:01.955495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d859e-7e6e-46f5-bfeb-f2bf69a4ed51 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:01.955984 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d859e-7e6e-46f5-bfeb-f2bf69a4ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:01.956462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d859e-7e6e-46f5-bfeb-f2bf69a4ed51 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:01.957851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d859e-7e6e-46f5-bfeb-f2bf69a4ed51 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:01.958410 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d859e-7e6e-46f5-bfeb-f2bf69a4ed51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:01.961149 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d859e-7e6e-46f5-bfeb-f2bf69a4ed51 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:01.997363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 308/582] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Sep 21 16:09:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:01.997363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d859e-7e6e-46f5-bfeb-f2bf69a4ed51 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:02.102233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b85a5b-59da-4db7-aea2-0ae3817177e6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:02.128556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:02.165148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d859e-7e6e-46f5-bfeb-f2bf69a4ed51 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:02.171367 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dbf02-468b-4fed-aa7f-ed60e8f3a7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:02.172336 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dbf02-468b-4fed-aa7f-ed60e8f3a7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:02.172821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dbf02-468b-4fed-aa7f-ed60e8f3a7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:02.173263 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dbf02-468b-4fed-aa7f-ed60e8f3a7e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:02.174481 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dbf02-468b-4fed-aa7f-ed60e8f3a7e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:02.174978 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dbf02-468b-4fed-aa7f-ed60e8f3a7e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:02.177692 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dbf02-468b-4fed-aa7f-ed60e8f3a7e7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:02.184562 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:02.201578 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 275/583] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:02.203704 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dbf02-468b-4fed-aa7f-ed60e8f3a7e7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:02.227889 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a02db9-9051-45aa-9b17-8324bd87c477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:02.228392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a02db9-9051-45aa-9b17-8324bd87c477 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:02.228666 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a02db9-9051-45aa-9b17-8324bd87c477 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:02.228969 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a02db9-9051-45aa-9b17-8324bd87c477 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:02.229669 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a02db9-9051-45aa-9b17-8324bd87c477 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:02.229972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a02db9-9051-45aa-9b17-8324bd87c477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:02.231413 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a02db9-9051-45aa-9b17-8324bd87c477 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:02.241471 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 309/584] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:09:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:02.242401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a02db9-9051-45aa-9b17-8324bd87c477 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:02.360902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dbf02-468b-4fed-aa7f-ed60e8f3a7e7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:02.404595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a02db9-9051-45aa-9b17-8324bd87c477 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:02.409662 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a15df-7511-411d-856b-3e22088876d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:02.410352 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a15df-7511-411d-856b-3e22088876d6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:02.410691 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a15df-7511-411d-856b-3e22088876d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:02.411022 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a15df-7511-411d-856b-3e22088876d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:02.411806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a15df-7511-411d-856b-3e22088876d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:02.412169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a15df-7511-411d-856b-3e22088876d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:02.414041 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a15df-7511-411d-856b-3e22088876d6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:02.427884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 276/585] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:02.429423 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a15df-7511-411d-856b-3e22088876d6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:02.446724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2948c-b75a-4ef1-be20-7099fbd0f0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:02.447668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2948c-b75a-4ef1-be20-7099fbd0f0fa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:02.448140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2948c-b75a-4ef1-be20-7099fbd0f0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:02.448592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2948c-b75a-4ef1-be20-7099fbd0f0fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:02.461923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2948c-b75a-4ef1-be20-7099fbd0f0fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:02.463404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2948c-b75a-4ef1-be20-7099fbd0f0fa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5ac2948c-b75a-4ef1-be20-7099fbd0f0fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:02.479606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:02.489161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:02.491139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:02.491139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:02.491139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:02.491139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 310/586] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:02.491139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2948c-b75a-4ef1-be20-7099fbd0f0fa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:02.491987 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:02.517038 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:02.569575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a15df-7511-411d-856b-3e22088876d6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:02.610823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005dc080-5750-4600-8200-c90acaeecb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:02.611473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dc080-5750-4600-8200-c90acaeecb5b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:02.611757 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dc080-5750-4600-8200-c90acaeecb5b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:02.612002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dc080-5750-4600-8200-c90acaeecb5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:02.612648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2948c-b75a-4ef1-be20-7099fbd0f0fa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:02.612893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005dc080-5750-4600-8200-c90acaeecb5b None admin] RBAC: Adding query filter params (role.id=8e7b3a48a50745adad97c6205aafc562, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=0b28aaefcb154b228987362921f6476b) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:02.613053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005dc080-5750-4600-8200-c90acaeecb5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:02.614711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005dc080-5750-4600-8200-c90acaeecb5b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:02.622649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 277/587] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:09:02 2022] GET /identity/v3/role_assignments?user.id=0b28aaefcb154b228987362921f6476b&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=8e7b3a48a50745adad97c6205aafc562 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:02.624647 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33fdee-5bb7-4339-8cf0-3296a8fb8892 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:02.625154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33fdee-5bb7-4339-8cf0-3296a8fb8892 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:02.625650 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33fdee-5bb7-4339-8cf0-3296a8fb8892 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:02.627915 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 278/588] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:02.629177 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33fdee-5bb7-4339-8cf0-3296a8fb8892 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:02.676022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdd459-2650-4b82-8aa5-143a3e50ba42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:02.677203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdd459-2650-4b82-8aa5-143a3e50ba42 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:02.677662 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdd459-2650-4b82-8aa5-143a3e50ba42 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:02.678146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdd459-2650-4b82-8aa5-143a3e50ba42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:02.693725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdd459-2650-4b82-8aa5-143a3e50ba42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:02.695874 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdd459-2650-4b82-8aa5-143a3e50ba42 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d7cdd459-2650-4b82-8aa5-143a3e50ba42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:02.716426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:02.718615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:02.720782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:02.720782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:02.720782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:02.721368 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 311/589] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:02.722534 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdd459-2650-4b82-8aa5-143a3e50ba42 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:02.803461 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:02.809831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33fdee-5bb7-4339-8cf0-3296a8fb8892 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:02.856149 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b357bfc-2848-46de-b914-6b9151901df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:02.856855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b357bfc-2848-46de-b914-6b9151901df7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:02.857145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b357bfc-2848-46de-b914-6b9151901df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:02.857426 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b357bfc-2848-46de-b914-6b9151901df7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:02.866031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b357bfc-2848-46de-b914-6b9151901df7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:02.867580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b357bfc-2848-46de-b914-6b9151901df7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:02.872103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-7b357bfc-2848-46de-b914-6b9151901df7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:02.880941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:02.882100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:02.883153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:02.883153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:02.883153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:02.883153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:02.883153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:02.883153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:02.883153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:02.883153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:02.883153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 16:09:02.883153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:02.887293 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 279/590] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:09:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:02.888604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3faa-37be-4928-8c5c-5dd394f564b5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:02.888920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3faa-37be-4928-8c5c-5dd394f564b5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:02.889197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3faa-37be-4928-8c5c-5dd394f564b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:02.909379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdd459-2650-4b82-8aa5-143a3e50ba42 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:02.910184 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ad2e3faa-37be-4928-8c5c-5dd394f564b5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:02.911389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ad2e3faa-37be-4928-8c5c-5dd394f564b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:02.964343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e08023-0a51-4313-9b07-a4e9fdaca366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:02.966441 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e08023-0a51-4313-9b07-a4e9fdaca366 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:02.966919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e08023-0a51-4313-9b07-a4e9fdaca366 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:02.967423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e08023-0a51-4313-9b07-a4e9fdaca366 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:02.968476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e08023-0a51-4313-9b07-a4e9fdaca366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:02.969019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e08023-0a51-4313-9b07-a4e9fdaca366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:02.971468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e08023-0a51-4313-9b07-a4e9fdaca366 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:02.995646 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 312/591] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:02.997409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e08023-0a51-4313-9b07-a4e9fdaca366 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:03.025677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 280/592] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:09:03.027383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3faa-37be-4928-8c5c-5dd394f564b5 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:03.134543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e08023-0a51-4313-9b07-a4e9fdaca366 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:03.173352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a03c8e-a532-4874-a71d-fbbfce21fe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:03.174252 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a03c8e-a532-4874-a71d-fbbfce21fe94 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:03.174675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a03c8e-a532-4874-a71d-fbbfce21fe94 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:03.175094 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a03c8e-a532-4874-a71d-fbbfce21fe94 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:03.175885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a03c8e-a532-4874-a71d-fbbfce21fe94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:03.176345 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a03c8e-a532-4874-a71d-fbbfce21fe94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:03.177999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a03c8e-a532-4874-a71d-fbbfce21fe94 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:03.179806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:03.196889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:03.212549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 313/593] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:03.215036 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a03c8e-a532-4874-a71d-fbbfce21fe94 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:03.226099 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3faa-37be-4928-8c5c-5dd394f564b5 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:03.297359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087a4d2-f747-4707-b86a-a50a3b7ac38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:03.298753 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087a4d2-f747-4707-b86a-a50a3b7ac38e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:03.299333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087a4d2-f747-4707-b86a-a50a3b7ac38e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:03.300421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087a4d2-f747-4707-b86a-a50a3b7ac38e None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:03.302309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087a4d2-f747-4707-b86a-a50a3b7ac38e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:03.302953 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087a4d2-f747-4707-b86a-a50a3b7ac38e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:03.305934 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087a4d2-f747-4707-b86a-a50a3b7ac38e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:03.346714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 281/594] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 21 16:09:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:03.348639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087a4d2-f747-4707-b86a-a50a3b7ac38e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:03.424457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a03c8e-a532-4874-a71d-fbbfce21fe94 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:03.488961 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab52eb3-78b1-46d4-9538-c628ab13b3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:03.489861 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab52eb3-78b1-46d4-9538-c628ab13b3bf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:03.490308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab52eb3-78b1-46d4-9538-c628ab13b3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:03.490752 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab52eb3-78b1-46d4-9538-c628ab13b3bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:03.502097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab52eb3-78b1-46d4-9538-c628ab13b3bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:03.504591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab52eb3-78b1-46d4-9538-c628ab13b3bf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-eab52eb3-78b1-46d4-9538-c628ab13b3bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:03.523820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:03.526370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:03.528284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:03.528284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:03.528284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:03.528284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:03.528284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:03.528284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:03.528284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:03.528284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:03.528284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 314/595] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:03.528284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab52eb3-78b1-46d4-9538-c628ab13b3bf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:03.541416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087a4d2-f747-4707-b86a-a50a3b7ac38e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:03.593418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bab701-43a4-4f8a-af38-462d004fbbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:03.594317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bab701-43a4-4f8a-af38-462d004fbbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:03.594734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bab701-43a4-4f8a-af38-462d004fbbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:03.595589 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bab701-43a4-4f8a-af38-462d004fbbc7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:03.605669 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bab701-43a4-4f8a-af38-462d004fbbc7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:03.606887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:03.608067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bab701-43a4-4f8a-af38-462d004fbbc7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-27bab701-43a4-4f8a-af38-462d004fbbc7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:03.624548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:03.627168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:03.629096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:03.629096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:03.629096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:03.629096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:03.629096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:03.629096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:03.629096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:03.629096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:03.629096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:09:03.629096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:03.629096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 282/596] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 21 16:09:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:03.635028 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bab701-43a4-4f8a-af38-462d004fbbc7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:03.646790 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:03.676639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab52eb3-78b1-46d4-9538-c628ab13b3bf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:03.724358 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fb655-64af-4671-8ee1-5ccf91207c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:03.725223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fb655-64af-4671-8ee1-5ccf91207c55 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:03.725645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fb655-64af-4671-8ee1-5ccf91207c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:03.726048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fb655-64af-4671-8ee1-5ccf91207c55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:03.741692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fb655-64af-4671-8ee1-5ccf91207c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:03.744234 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fb655-64af-4671-8ee1-5ccf91207c55 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:03.758727 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bab701-43a4-4f8a-af38-462d004fbbc7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-101fb655-64af-4671-8ee1-5ccf91207c55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:03.763510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:03.765877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:03.768124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:03.768124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:03.768124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:03.768124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 315/597] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:03.768124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fb655-64af-4671-8ee1-5ccf91207c55 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:03.812849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6d902-6c5a-459a-9e87-3fb58ef93b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:03.814034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6d902-6c5a-459a-9e87-3fb58ef93b88 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:03.814584 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6d902-6c5a-459a-9e87-3fb58ef93b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:03.815032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6d902-6c5a-459a-9e87-3fb58ef93b88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:03.832583 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6d902-6c5a-459a-9e87-3fb58ef93b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-b3d6d902-6c5a-459a-9e87-3fb58ef93b88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:03.842353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:03.843564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:03.849494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:03.849494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:03.849494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:03.849494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:03.849494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:03.849494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:03.849494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:03.849494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:03.849494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:03.849494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:03.849494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:03.849494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:03.849494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 283/598] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:09:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:03.849494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6d902-6c5a-459a-9e87-3fb58ef93b88 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:03.936538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fb655-64af-4671-8ee1-5ccf91207c55 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:03.945647 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:03.946289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:03.983574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3e7cb-2b69-4404-8a21-0ddf178eb4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:03.984550 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3e7cb-2b69-4404-8a21-0ddf178eb4dd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:03.984850 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3e7cb-2b69-4404-8a21-0ddf178eb4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:03.985284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3e7cb-2b69-4404-8a21-0ddf178eb4dd None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:03.986003 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3e7cb-2b69-4404-8a21-0ddf178eb4dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:03.986311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3e7cb-2b69-4404-8a21-0ddf178eb4dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:03.987069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6d902-6c5a-459a-9e87-3fb58ef93b88 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:03.987771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3e7cb-2b69-4404-8a21-0ddf178eb4dd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:04.001770 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 316/599] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:04.007353 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3e7cb-2b69-4404-8a21-0ddf178eb4dd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:04.050578 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef217f-9796-4900-ab3a-755b3640543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:04.051374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef217f-9796-4900-ab3a-755b3640543b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:04.051756 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef217f-9796-4900-ab3a-755b3640543b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:04.052168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef217f-9796-4900-ab3a-755b3640543b None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:04.053027 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef217f-9796-4900-ab3a-755b3640543b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:04.053439 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef217f-9796-4900-ab3a-755b3640543b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:04.055005 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef217f-9796-4900-ab3a-755b3640543b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:04.084761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 284/600] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 21 16:09:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:04.084761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef217f-9796-4900-ab3a-755b3640543b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:04.142633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3e7cb-2b69-4404-8a21-0ddf178eb4dd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:04.200791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37615214-bc51-4ac0-84f6-7fca779ce2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:04.202133 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37615214-bc51-4ac0-84f6-7fca779ce2da None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:04.202836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37615214-bc51-4ac0-84f6-7fca779ce2da None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:04.203490 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37615214-bc51-4ac0-84f6-7fca779ce2da None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:04.204870 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37615214-bc51-4ac0-84f6-7fca779ce2da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:04.205599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37615214-bc51-4ac0-84f6-7fca779ce2da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:04.208333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37615214-bc51-4ac0-84f6-7fca779ce2da None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:04.209076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef217f-9796-4900-ab3a-755b3640543b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:04.236941 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 317/601] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:04.236941 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37615214-bc51-4ac0-84f6-7fca779ce2da None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:04.238627 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:04.254141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac0504-7cd6-47c0-98c1-7ef1d6ea127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:04.254747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac0504-7cd6-47c0-98c1-7ef1d6ea127d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:04.255095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac0504-7cd6-47c0-98c1-7ef1d6ea127d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:04.255377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac0504-7cd6-47c0-98c1-7ef1d6ea127d None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:04.256059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac0504-7cd6-47c0-98c1-7ef1d6ea127d None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:04.256366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac0504-7cd6-47c0-98c1-7ef1d6ea127d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:04.257801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac0504-7cd6-47c0-98c1-7ef1d6ea127d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:04.267009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 285/602] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:09:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:04.267622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:04.268017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac0504-7cd6-47c0-98c1-7ef1d6ea127d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:04.375248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37615214-bc51-4ac0-84f6-7fca779ce2da None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:04.393975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac0504-7cd6-47c0-98c1-7ef1d6ea127d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:04.418019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd20f3f-a005-44dc-8012-8009e73f0a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:04.418957 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd20f3f-a005-44dc-8012-8009e73f0a29 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:04.419294 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd20f3f-a005-44dc-8012-8009e73f0a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:04.419632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd20f3f-a005-44dc-8012-8009e73f0a29 None admin] PATH_INFO: `/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/0e765e2cc4c94243b00f919e8f8d01a1/roles/8e7b3a48a50745adad97c6205aafc562` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:04.431762 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657e8a4-c9c6-430f-a5ac-8d05bbb8f1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:04.432467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657e8a4-c9c6-430f-a5ac-8d05bbb8f1ef None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:04.432775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657e8a4-c9c6-430f-a5ac-8d05bbb8f1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:04.433044 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657e8a4-c9c6-430f-a5ac-8d05bbb8f1ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:04.440438 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd20f3f-a005-44dc-8012-8009e73f0a29 None admin] RBAC: Authorizing `identity:create_grant(project_id=78142a67f69a4ba58113cc7c8dc269b1, user_id=0e765e2cc4c94243b00f919e8f8d01a1, role_id=8e7b3a48a50745adad97c6205aafc562)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:04.443254 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd20f3f-a005-44dc-8012-8009e73f0a29 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:04.445950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657e8a4-c9c6-430f-a5ac-8d05bbb8f1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:04.447436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657e8a4-c9c6-430f-a5ac-8d05bbb8f1ef None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:04.472738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 318/603] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:09:04 2022] PUT /identity/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/0e765e2cc4c94243b00f919e8f8d01a1/roles/8e7b3a48a50745adad97c6205aafc562 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:09:04.472738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd20f3f-a005-44dc-8012-8009e73f0a29 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-7657e8a4-c9c6-430f-a5ac-8d05bbb8f1ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:04.473147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:04.474831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:04.476544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:04.476544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:04.476544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:04.476544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 286/604] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:04.476544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657e8a4-c9c6-430f-a5ac-8d05bbb8f1ef None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:04.523640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:04.614352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:04.634023 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657e8a4-c9c6-430f-a5ac-8d05bbb8f1ef None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:04.647958 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd20f3f-a005-44dc-8012-8009e73f0a29 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:04.692855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16473d4c-f1bd-465f-bd13-279b88f0e3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:04.693910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16473d4c-f1bd-465f-bd13-279b88f0e3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:04.694392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16473d4c-f1bd-465f-bd13-279b88f0e3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:04.694879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16473d4c-f1bd-465f-bd13-279b88f0e3f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:04.714041 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16473d4c-f1bd-465f-bd13-279b88f0e3f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:04.716347 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16473d4c-f1bd-465f-bd13-279b88f0e3f8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:04.718175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3f907-0a13-4d30-bda4-189886624aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:04.719744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f907-0a13-4d30-bda4-189886624aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:04.720394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f907-0a13-4d30-bda4-189886624aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:04.722790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f907-0a13-4d30-bda4-189886624aa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-16473d4c-f1bd-465f-bd13-279b88f0e3f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:04.736378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:04.737497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:04.738871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:04.738871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:04.738871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:04.738871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 287/605] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:04.738871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16473d4c-f1bd-465f-bd13-279b88f0e3f8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:04.743704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3f907-0a13-4d30-bda4-189886624aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:04.746589 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3f907-0a13-4d30-bda4-189886624aa7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-24b3f907-0a13-4d30-bda4-189886624aa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:04.770517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:04.771540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:04.772450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:04.772450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:04.772450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:04.772450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:04.772450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:04.772450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:04.772450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:04.772450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:04.773702 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 319/606] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:04.774960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3f907-0a13-4d30-bda4-189886624aa7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:04.868441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:04.889284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16473d4c-f1bd-465f-bd13-279b88f0e3f8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:04.927809 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c49870-c652-48b7-ae67-72ef56c64dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:04.928514 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c49870-c652-48b7-ae67-72ef56c64dbe None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:04.928930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c49870-c652-48b7-ae67-72ef56c64dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:04.929335 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c49870-c652-48b7-ae67-72ef56c64dbe None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:04.930054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c49870-c652-48b7-ae67-72ef56c64dbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:04.931113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c49870-c652-48b7-ae67-72ef56c64dbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:04.933660 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c49870-c652-48b7-ae67-72ef56c64dbe None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:04.948202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 288/607] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:04.949313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c49870-c652-48b7-ae67-72ef56c64dbe None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:04.972245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3f907-0a13-4d30-bda4-189886624aa7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:05.042667 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3465811-27b4-4d15-aea8-607fea219e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:05.043617 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3465811-27b4-4d15-aea8-607fea219e4b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:05.044204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3465811-27b4-4d15-aea8-607fea219e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:05.044723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3465811-27b4-4d15-aea8-607fea219e4b None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:05.045942 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3465811-27b4-4d15-aea8-607fea219e4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:05.046495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3465811-27b4-4d15-aea8-607fea219e4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:05.049339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3465811-27b4-4d15-aea8-607fea219e4b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:05.054206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:05.073919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 320/608] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:05.074252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c49870-c652-48b7-ae67-72ef56c64dbe None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:05.075484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3465811-27b4-4d15-aea8-607fea219e4b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:05.114269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6393f-6129-41eb-8379-a8dd9f1644ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:05.115166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6393f-6129-41eb-8379-a8dd9f1644ca None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:05.115600 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6393f-6129-41eb-8379-a8dd9f1644ca None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:05.116010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6393f-6129-41eb-8379-a8dd9f1644ca None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:05.116881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6393f-6129-41eb-8379-a8dd9f1644ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:05.117350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6393f-6129-41eb-8379-a8dd9f1644ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:05.119531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6393f-6129-41eb-8379-a8dd9f1644ca None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:05.137707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 289/609] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:05.138973 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6393f-6129-41eb-8379-a8dd9f1644ca None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:05.153130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:05.250543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6393f-6129-41eb-8379-a8dd9f1644ca None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:05.283058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3465811-27b4-4d15-aea8-607fea219e4b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:05.287205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a31ea-2cf6-4518-87f3-a0a4418e8a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:05.288098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a31ea-2cf6-4518-87f3-a0a4418e8a00 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:05.288534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a31ea-2cf6-4518-87f3-a0a4418e8a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:05.288984 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a31ea-2cf6-4518-87f3-a0a4418e8a00 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:05.298243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a31ea-2cf6-4518-87f3-a0a4418e8a00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:05.299966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a31ea-2cf6-4518-87f3-a0a4418e8a00 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-204a31ea-2cf6-4518-87f3-a0a4418e8a00 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:05.313459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:05.314636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:05.315720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:05.315720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:05.315720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:05.315720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:05.315720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:05.315720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:05.315720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:05.315720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:05.315720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 16:09:05.315720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:05.317562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 290/610] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:09:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:05.318520 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a31ea-2cf6-4518-87f3-a0a4418e8a00 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:05.357328 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069b415-f8a0-4708-a099-4509393bd469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:05.360411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069b415-f8a0-4708-a099-4509393bd469 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:05.360726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069b415-f8a0-4708-a099-4509393bd469 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:05.361045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069b415-f8a0-4708-a099-4509393bd469 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:05.371716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069b415-f8a0-4708-a099-4509393bd469 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:05.373645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069b415-f8a0-4708-a099-4509393bd469 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9069b415-f8a0-4708-a099-4509393bd469 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:05.388300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:05.390082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:05.391872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:05.391872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:05.391872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:05.391872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:05.391872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:05.391872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:05.391872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:05.391872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:05.391872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 321/611] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:05.391872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069b415-f8a0-4708-a099-4509393bd469 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:05.423528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:05.484421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a31ea-2cf6-4518-87f3-a0a4418e8a00 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:05.506451 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:05.541788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0196501-8d56-461d-883e-a6b2e59df29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:05.542515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0196501-8d56-461d-883e-a6b2e59df29e None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:05.542800 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0196501-8d56-461d-883e-a6b2e59df29e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:05.543075 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0196501-8d56-461d-883e-a6b2e59df29e None admin] PATH_INFO: `/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/aa61549530e648a0b774a784b0450162/roles/8e7b3a48a50745adad97c6205aafc562` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:05.565446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0196501-8d56-461d-883e-a6b2e59df29e None admin] RBAC: Authorizing `identity:create_grant(project_id=78142a67f69a4ba58113cc7c8dc269b1, user_id=aa61549530e648a0b774a784b0450162, role_id=8e7b3a48a50745adad97c6205aafc562)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:05.567232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0196501-8d56-461d-883e-a6b2e59df29e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:05.576382 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069b415-f8a0-4708-a099-4509393bd469 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:05.590838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 291/612] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:09:05 2022] PUT /identity/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/aa61549530e648a0b774a784b0450162/roles/8e7b3a48a50745adad97c6205aafc562 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:09:05.592034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0196501-8d56-461d-883e-a6b2e59df29e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:05.658659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce2dcf-3357-40d3-a94a-7be16fe2e1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:05.660872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2dcf-3357-40d3-a94a-7be16fe2e1cb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:05.661425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2dcf-3357-40d3-a94a-7be16fe2e1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:05.663357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2dcf-3357-40d3-a94a-7be16fe2e1cb None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:05.664367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce2dcf-3357-40d3-a94a-7be16fe2e1cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:05.665061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce2dcf-3357-40d3-a94a-7be16fe2e1cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:05.668443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce2dcf-3357-40d3-a94a-7be16fe2e1cb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:05.700936 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 322/613] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 21 16:09:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:05.706854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce2dcf-3357-40d3-a94a-7be16fe2e1cb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:05.779713 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0196501-8d56-461d-883e-a6b2e59df29e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:05.806672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:05.824223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a39dd-e130-452f-aa56-826be9638e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:05.824804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a39dd-e130-452f-aa56-826be9638e22 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:05.825094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a39dd-e130-452f-aa56-826be9638e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:05.825371 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a39dd-e130-452f-aa56-826be9638e22 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:05.826090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a39dd-e130-452f-aa56-826be9638e22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:05.826401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a39dd-e130-452f-aa56-826be9638e22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:05.827990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a39dd-e130-452f-aa56-826be9638e22 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:05.843370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 292/614] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:05.853383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a39dd-e130-452f-aa56-826be9638e22 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:05.962095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce2dcf-3357-40d3-a94a-7be16fe2e1cb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:05.993860 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:06.043926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40473d-169d-43bf-b94f-f2e187069197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:06.044552 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40473d-169d-43bf-b94f-f2e187069197 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:06.044858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40473d-169d-43bf-b94f-f2e187069197 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:06.045132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40473d-169d-43bf-b94f-f2e187069197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:06.073592 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a39dd-e130-452f-aa56-826be9638e22 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:06.148463 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d0a51-2ebc-4598-a0ce-5bdea1c86449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:06.149231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d0a51-2ebc-4598-a0ce-5bdea1c86449 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:06.149514 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d0a51-2ebc-4598-a0ce-5bdea1c86449 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:06.149788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d0a51-2ebc-4598-a0ce-5bdea1c86449 None admin] PATH_INFO: `/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/d7ff08c990dc41b4811f97fecb7c4c3a/roles/8e7b3a48a50745adad97c6205aafc562` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:06.169464 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d0a51-2ebc-4598-a0ce-5bdea1c86449 None admin] RBAC: Authorizing `identity:create_grant(project_id=78142a67f69a4ba58113cc7c8dc269b1, user_id=d7ff08c990dc41b4811f97fecb7c4c3a, role_id=8e7b3a48a50745adad97c6205aafc562)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:06.170943 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d0a51-2ebc-4598-a0ce-5bdea1c86449 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:06.191933 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 293/615] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:09:05 2022] PUT /identity/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/d7ff08c990dc41b4811f97fecb7c4c3a/roles/8e7b3a48a50745adad97c6205aafc562 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:09:06.200757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40473d-169d-43bf-b94f-f2e187069197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:06.203831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40473d-169d-43bf-b94f-f2e187069197 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:06.453263 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 323/616] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:09:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 743 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:09:06.455385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d0a51-2ebc-4598-a0ce-5bdea1c86449 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:06.491217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd68961-010c-40f1-9e35-69b26a1f9ba1 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:06.491788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd68961-010c-40f1-9e35-69b26a1f9ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:06.492257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd68961-010c-40f1-9e35-69b26a1f9ba1 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:06.496058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 324/617] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:06.501106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce146cc-89fc-4ac0-a4ce-40b6cf69ea23 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:06.501737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce146cc-89fc-4ac0-a4ce-40b6cf69ea23 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:06.502185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce146cc-89fc-4ac0-a4ce-40b6cf69ea23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:06.514582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:06.536865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1ce146cc-89fc-4ac0-a4ce-40b6cf69ea23 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:06.539223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ce146cc-89fc-4ac0-a4ce-40b6cf69ea23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:06.561065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:06.607070 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d0a51-2ebc-4598-a0ce-5bdea1c86449 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:06.663470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 325/618] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:09:06.683061 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee393a-f513-4c7f-95e5-0f88877047c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:06.684674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee393a-f513-4c7f-95e5-0f88877047c3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:06.685201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee393a-f513-4c7f-95e5-0f88877047c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:06.685745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee393a-f513-4c7f-95e5-0f88877047c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:06.711273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee393a-f513-4c7f-95e5-0f88877047c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:06.713336 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee393a-f513-4c7f-95e5-0f88877047c3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-68ee393a-f513-4c7f-95e5-0f88877047c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:06.748326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:06.749528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:06.750533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:06.750533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:06.750533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:06.751251 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 294/619] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:06.758344 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce146cc-89fc-4ac0-a4ce-40b6cf69ea23 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:06.933411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce146cc-89fc-4ac0-a4ce-40b6cf69ea23 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:06.992981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249159e-9436-4225-b246-ba1423211041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:06.993743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249159e-9436-4225-b246-ba1423211041 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:06.993914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249159e-9436-4225-b246-ba1423211041 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:06.994081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249159e-9436-4225-b246-ba1423211041 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:06.994709 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249159e-9436-4225-b246-ba1423211041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:06.995011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249159e-9436-4225-b246-ba1423211041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:06.996425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249159e-9436-4225-b246-ba1423211041 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:07.014956 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 326/620] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:07.021534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee393a-f513-4c7f-95e5-0f88877047c3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:07.174982 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249159e-9436-4225-b246-ba1423211041 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:07.187347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:07.225239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:07.265413 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee393a-f513-4c7f-95e5-0f88877047c3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:07.332975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24da58-0562-45c7-a709-2c45cb55d94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:07.334430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24da58-0562-45c7-a709-2c45cb55d94d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:07.335321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24da58-0562-45c7-a709-2c45cb55d94d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:07.335810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24da58-0562-45c7-a709-2c45cb55d94d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:07.346923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24da58-0562-45c7-a709-2c45cb55d94d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:07.349259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24da58-0562-45c7-a709-2c45cb55d94d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:07.350455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249159e-9436-4225-b246-ba1423211041 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-3a24da58-0562-45c7-a709-2c45cb55d94d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:07.380428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:07.381890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:07.382821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:07.382821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:07.382821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:07.382821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:07.382821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:07.382821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:07.382821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:07.382821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:07.382821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 295/621] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:07.385256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebb9f3-f115-4dff-822d-7bfc13fa71bb None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:07.385415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebb9f3-f115-4dff-822d-7bfc13fa71bb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:07.388918 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebb9f3-f115-4dff-822d-7bfc13fa71bb None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:07.389111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 296/622] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:07.391586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebb9f3-f115-4dff-822d-7bfc13fa71bb None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:07.403906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17119bed-92f3-476a-8856-15e09300419e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:07.405260 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17119bed-92f3-476a-8856-15e09300419e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:07.405883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17119bed-92f3-476a-8856-15e09300419e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:07.406501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17119bed-92f3-476a-8856-15e09300419e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:07.427396 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17119bed-92f3-476a-8856-15e09300419e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-17119bed-92f3-476a-8856-15e09300419e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:07.439121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:07.440155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:07.441062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:07.441062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:07.441062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:07.441062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:07.441062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:07.441062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:07.441062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:07.441062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:07.441062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:07.441062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:07.441062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:07.441062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:07.441998 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 327/623] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:09:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:07.444723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e073e8-a1da-47d3-9d0f-29b8d3b7ac89 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:07.445391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e073e8-a1da-47d3-9d0f-29b8d3b7ac89 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:07.446625 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e073e8-a1da-47d3-9d0f-29b8d3b7ac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:07.484178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e3e073e8-a1da-47d3-9d0f-29b8d3b7ac89 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:07.486803 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e3e073e8-a1da-47d3-9d0f-29b8d3b7ac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:07.521643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebb9f3-f115-4dff-822d-7bfc13fa71bb None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:07.560970 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2ad52-8539-439d-9555-2a2a81d59ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:07.561835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2ad52-8539-439d-9555-2a2a81d59ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:07.562257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2ad52-8539-439d-9555-2a2a81d59ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:07.562696 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2ad52-8539-439d-9555-2a2a81d59ea0 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:07.563585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2ad52-8539-439d-9555-2a2a81d59ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:07.564031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2ad52-8539-439d-9555-2a2a81d59ea0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:07.565635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2ad52-8539-439d-9555-2a2a81d59ea0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:07.584239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 297/624] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:07.585539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2ad52-8539-439d-9555-2a2a81d59ea0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:07.588766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:07.611486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:07.630046 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 328/625] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:09:07.631376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e073e8-a1da-47d3-9d0f-29b8d3b7ac89 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:07.705241 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2ad52-8539-439d-9555-2a2a81d59ea0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:07.755508 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901adb9-154e-48ba-a4df-6d27f71e0dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:07.756491 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901adb9-154e-48ba-a4df-6d27f71e0dfa None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:07.756945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901adb9-154e-48ba-a4df-6d27f71e0dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:07.757356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901adb9-154e-48ba-a4df-6d27f71e0dfa None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:07.758179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901adb9-154e-48ba-a4df-6d27f71e0dfa None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:07.759236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901adb9-154e-48ba-a4df-6d27f71e0dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:07.760831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901adb9-154e-48ba-a4df-6d27f71e0dfa None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:07.785337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 298/626] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:09:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:07.793758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901adb9-154e-48ba-a4df-6d27f71e0dfa None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:07.828999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e073e8-a1da-47d3-9d0f-29b8d3b7ac89 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:07.888486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b5e35-0fac-455b-a2a7-687eef37baaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:07.889708 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5e35-0fac-455b-a2a7-687eef37baaa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:07.890310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5e35-0fac-455b-a2a7-687eef37baaa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:07.890994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5e35-0fac-455b-a2a7-687eef37baaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:07.892388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b5e35-0fac-455b-a2a7-687eef37baaa None admin] RBAC: Adding query filter params (role.id=8e7b3a48a50745adad97c6205aafc562, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=2974669e9d1a417892b1d59dbc9e87ae) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:07.893087 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b5e35-0fac-455b-a2a7-687eef37baaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:07.900746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b5e35-0fac-455b-a2a7-687eef37baaa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:07.913830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 329/627] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:09:07 2022] GET /identity/v3/role_assignments?user.id=2974669e9d1a417892b1d59dbc9e87ae&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=8e7b3a48a50745adad97c6205aafc562 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:07.919305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:07.963172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b5e35-0fac-455b-a2a7-687eef37baaa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:07.985374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901adb9-154e-48ba-a4df-6d27f71e0dfa None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:08.039226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378b2a1-54d3-4276-b329-e4949f22df9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:08.040779 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378b2a1-54d3-4276-b329-e4949f22df9a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:08.041211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378b2a1-54d3-4276-b329-e4949f22df9a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:08.041733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378b2a1-54d3-4276-b329-e4949f22df9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:08.055009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378b2a1-54d3-4276-b329-e4949f22df9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:08.056936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378b2a1-54d3-4276-b329-e4949f22df9a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-d378b2a1-54d3-4276-b329-e4949f22df9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:08.074195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:08.075255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:08.076165 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:08.076165 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:08.076165 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:08.078305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 299/628] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:08.089851 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378b2a1-54d3-4276-b329-e4949f22df9a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:08.200674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:08.206348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378b2a1-54d3-4276-b329-e4949f22df9a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:08.225446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:08.248193 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90b890-d6db-48e6-9dbc-f31e43ba462f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:08.249226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90b890-d6db-48e6-9dbc-f31e43ba462f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:08.249705 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90b890-d6db-48e6-9dbc-f31e43ba462f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:08.250188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90b890-d6db-48e6-9dbc-f31e43ba462f None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:08.251073 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90b890-d6db-48e6-9dbc-f31e43ba462f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:08.251588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90b890-d6db-48e6-9dbc-f31e43ba462f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:08.253313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90b890-d6db-48e6-9dbc-f31e43ba462f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:08.269563 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 300/629] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:08.281860 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90b890-d6db-48e6-9dbc-f31e43ba462f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:08.308282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b5e35-0fac-455b-a2a7-687eef37baaa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:08.401310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486540ac-4699-40ce-b0d9-9a389ae6ee44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:08.402414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486540ac-4699-40ce-b0d9-9a389ae6ee44 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:08.402890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486540ac-4699-40ce-b0d9-9a389ae6ee44 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:08.403357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486540ac-4699-40ce-b0d9-9a389ae6ee44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:08.430678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90b890-d6db-48e6-9dbc-f31e43ba462f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:08.433844 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486540ac-4699-40ce-b0d9-9a389ae6ee44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-486540ac-4699-40ce-b0d9-9a389ae6ee44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:08.444330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:08.445384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:08.447397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:08.447397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:08.447397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:08.447397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:08.447397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:08.447397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:08.447397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:08.447397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:08.447397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:08.447397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:08.447397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:08.447397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:08.447397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 330/630] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:09:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 485 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:08.468662 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486540ac-4699-40ce-b0d9-9a389ae6ee44 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:08.482419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067498e-0a8e-4899-92cc-5f6e019b322a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:08.483306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067498e-0a8e-4899-92cc-5f6e019b322a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:08.483612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067498e-0a8e-4899-92cc-5f6e019b322a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:08.484002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067498e-0a8e-4899-92cc-5f6e019b322a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:08.493738 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067498e-0a8e-4899-92cc-5f6e019b322a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:08.495380 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067498e-0a8e-4899-92cc-5f6e019b322a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-f067498e-0a8e-4899-92cc-5f6e019b322a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:08.516802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:08.518939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:08.520126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:08.520126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:08.520126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:08.520126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:08.520126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:08.520126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:08.520126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:08.520126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:08.520126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 16:09:08.520126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:08.520126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 301/631] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:09:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:08.530362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067498e-0a8e-4899-92cc-5f6e019b322a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:08.622369 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:08.699230 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486540ac-4699-40ce-b0d9-9a389ae6ee44 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:08.756209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:08.787482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e210a3-f70e-450b-95b4-3d54e2c09dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:08.788103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e210a3-f70e-450b-95b4-3d54e2c09dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:08.788379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e210a3-f70e-450b-95b4-3d54e2c09dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:08.788663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e210a3-f70e-450b-95b4-3d54e2c09dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:08.789351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e210a3-f70e-450b-95b4-3d54e2c09dd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:08.792720 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e210a3-f70e-450b-95b4-3d54e2c09dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:08.792720 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e210a3-f70e-450b-95b4-3d54e2c09dd5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:08.803608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 331/632] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:09:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:08.806446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067498e-0a8e-4899-92cc-5f6e019b322a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:08.809103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45549f-39ca-4000-b5cb-93e608fd3177 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:08.809679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45549f-39ca-4000-b5cb-93e608fd3177 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:08.810169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45549f-39ca-4000-b5cb-93e608fd3177 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:08.816198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 332/633] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:08.817566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45549f-39ca-4000-b5cb-93e608fd3177 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:08.857398 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbf43e-fbfa-4514-a387-afe4ac3a8c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:08.858015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbf43e-fbfa-4514-a387-afe4ac3a8c0f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:08.858287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbf43e-fbfa-4514-a387-afe4ac3a8c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:08.858552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbf43e-fbfa-4514-a387-afe4ac3a8c0f None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:08.859283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbf43e-fbfa-4514-a387-afe4ac3a8c0f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:08.859585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbf43e-fbfa-4514-a387-afe4ac3a8c0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:08.861063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbf43e-fbfa-4514-a387-afe4ac3a8c0f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:08.890911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 302/634] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 21 16:09:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:08.892707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de0fa9-64be-4eb6-bf97-e9254fb26ba2 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:08.893211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de0fa9-64be-4eb6-bf97-e9254fb26ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:08.893738 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de0fa9-64be-4eb6-bf97-e9254fb26ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:08.921243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-04de0fa9-64be-4eb6-bf97-e9254fb26ba2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:08.922833 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-04de0fa9-64be-4eb6-bf97-e9254fb26ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:08.954406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45549f-39ca-4000-b5cb-93e608fd3177 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:09.000431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3d947-87a1-4aa6-b208-8b723313bd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:09.001186 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3d947-87a1-4aa6-b208-8b723313bd07 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:09.001463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3d947-87a1-4aa6-b208-8b723313bd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:09.001828 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3d947-87a1-4aa6-b208-8b723313bd07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:09.023100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 303/635] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:09:09.025030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de0fa9-64be-4eb6-bf97-e9254fb26ba2 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:09.033149 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3d947-87a1-4aa6-b208-8b723313bd07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:09.035929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3d947-87a1-4aa6-b208-8b723313bd07 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:09.055739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7cc3d947-87a1-4aa6-b208-8b723313bd07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:09.087202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:09.088243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:09.089157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:09.089157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:09.089157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:09.090033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 333/636] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:09.097089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3d947-87a1-4aa6-b208-8b723313bd07 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:09.157870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de0fa9-64be-4eb6-bf97-e9254fb26ba2 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:09.199471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af611014-744c-4be4-8942-e3e4c940d640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:09.200526 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af611014-744c-4be4-8942-e3e4c940d640 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:09.201035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af611014-744c-4be4-8942-e3e4c940d640 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:09.201506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af611014-744c-4be4-8942-e3e4c940d640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:09.215332 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af611014-744c-4be4-8942-e3e4c940d640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:09.217205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af611014-744c-4be4-8942-e3e4c940d640 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:09.233415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-af611014-744c-4be4-8942-e3e4c940d640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:09.240202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:09.241489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:09.242379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:09.242379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:09.242379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:09.245016 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 304/637] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:09.269167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af611014-744c-4be4-8942-e3e4c940d640 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:09.389335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3d947-87a1-4aa6-b208-8b723313bd07 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:09.436391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb57527-0b32-4da7-b1e3-420d4c8e9b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:09.436959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb57527-0b32-4da7-b1e3-420d4c8e9b8f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:09.437239 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb57527-0b32-4da7-b1e3-420d4c8e9b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:09.437512 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb57527-0b32-4da7-b1e3-420d4c8e9b8f None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:09.438162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb57527-0b32-4da7-b1e3-420d4c8e9b8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:09.438464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb57527-0b32-4da7-b1e3-420d4c8e9b8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:09.439863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb57527-0b32-4da7-b1e3-420d4c8e9b8f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:09.452643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:09.460994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 334/638] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:09.463408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794cab2-af01-48db-929e-8306bc03b5ac None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:09.463896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794cab2-af01-48db-929e-8306bc03b5ac None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:09.464648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794cab2-af01-48db-929e-8306bc03b5ac None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:09.468774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 335/639] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:09.469685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794cab2-af01-48db-929e-8306bc03b5ac None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:09.510718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af611014-744c-4be4-8942-e3e4c940d640 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:09.566295 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bd0d9-0ca5-43c1-b569-ddc1242d4744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:09.567333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bd0d9-0ca5-43c1-b569-ddc1242d4744 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:09.567333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bd0d9-0ca5-43c1-b569-ddc1242d4744 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:09.567593 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bd0d9-0ca5-43c1-b569-ddc1242d4744 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:09.568081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bd0d9-0ca5-43c1-b569-ddc1242d4744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:09.568395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bd0d9-0ca5-43c1-b569-ddc1242d4744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:09.569820 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bd0d9-0ca5-43c1-b569-ddc1242d4744 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:09.583937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 305/640] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:09.584949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bd0d9-0ca5-43c1-b569-ddc1242d4744 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:09.599139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:09.617466 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794cab2-af01-48db-929e-8306bc03b5ac None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:09.687274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a199c-c4b5-4efc-a7be-19bf12e1c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:09.687893 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a199c-c4b5-4efc-a7be-19bf12e1c968 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:09.688178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a199c-c4b5-4efc-a7be-19bf12e1c968 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:09.688522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a199c-c4b5-4efc-a7be-19bf12e1c968 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:09.700223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a199c-c4b5-4efc-a7be-19bf12e1c968 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:09.701829 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a199c-c4b5-4efc-a7be-19bf12e1c968 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7f0a199c-c4b5-4efc-a7be-19bf12e1c968 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:09.716308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:09.718261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:09.719540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:09.719540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:09.719540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:09.719540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:09.719540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:09.719540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:09.719540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:09.719540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:09.719540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 16:09:09.719540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:09.719540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 336/641] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:09:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:09.719540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851ecb9-4a84-4bde-9614-bd0495cc5a85 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:09.719540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851ecb9-4a84-4bde-9614-bd0495cc5a85 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:09.722656 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851ecb9-4a84-4bde-9614-bd0495cc5a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:09.739935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8851ecb9-4a84-4bde-9614-bd0495cc5a85 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:09.741185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8851ecb9-4a84-4bde-9614-bd0495cc5a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:09.762385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bd0d9-0ca5-43c1-b569-ddc1242d4744 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:09.809856 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae07688-71c8-4dc6-b890-b6a29758b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:09.810497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae07688-71c8-4dc6-b890-b6a29758b86d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:09.810778 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae07688-71c8-4dc6-b890-b6a29758b86d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:09.811051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae07688-71c8-4dc6-b890-b6a29758b86d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:09.814174 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:09.825208 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae07688-71c8-4dc6-b890-b6a29758b86d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-fae07688-71c8-4dc6-b890-b6a29758b86d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:09.831056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:09.832051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:09.832925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:09.832925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:09.832925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:09.832925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:09.832925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:09.832925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:09.832925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:09.832925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:09.832925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:09.832925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:09.832925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:09.832925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:09.832925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 306/642] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:09:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:09.833636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae07688-71c8-4dc6-b890-b6a29758b86d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:09.848771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 337/643] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:09:09.849751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851ecb9-4a84-4bde-9614-bd0495cc5a85 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:09.982299 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:09.988101 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae07688-71c8-4dc6-b890-b6a29758b86d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:10.016050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851ecb9-4a84-4bde-9614-bd0495cc5a85 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:10.054303 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b95c9e-a481-43d7-917c-b0bc58ee1aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:10.055647 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b95c9e-a481-43d7-917c-b0bc58ee1aaa None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:10.056184 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b95c9e-a481-43d7-917c-b0bc58ee1aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:10.057755 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b95c9e-a481-43d7-917c-b0bc58ee1aaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:10.068932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d572c-b358-440c-ad44-4a8aa580b35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:10.069967 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d572c-b358-440c-ad44-4a8aa580b35a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:10.069967 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d572c-b358-440c-ad44-4a8aa580b35a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:10.070174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d572c-b358-440c-ad44-4a8aa580b35a None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:10.071321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d572c-b358-440c-ad44-4a8aa580b35a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:10.071623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d572c-b358-440c-ad44-4a8aa580b35a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:10.073073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d572c-b358-440c-ad44-4a8aa580b35a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:10.075960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b95c9e-a481-43d7-917c-b0bc58ee1aaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:10.081640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b95c9e-a481-43d7-917c-b0bc58ee1aaa None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:10.095869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 338/644] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Sep 21 16:09:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:10.097104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d572c-b358-440c-ad44-4a8aa580b35a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-a5b95c9e-a481-43d7-917c-b0bc58ee1aaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:10.101807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:10.102794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:10.103874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:10.103874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:10.103874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:10.103874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:10.103874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:10.103874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:10.103874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:10.103874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:10.103874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 307/645] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:10.103874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b95c9e-a481-43d7-917c-b0bc58ee1aaa None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:10.166120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:10.224203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b95c9e-a481-43d7-917c-b0bc58ee1aaa None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:10.226980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d572c-b358-440c-ad44-4a8aa580b35a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:10.263160 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f328c-78c3-4555-a71c-a1df64fae433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:10.263893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f328c-78c3-4555-a71c-a1df64fae433 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:10.264166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f328c-78c3-4555-a71c-a1df64fae433 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:10.264428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f328c-78c3-4555-a71c-a1df64fae433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:10.266847 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ad2e8-624f-46d9-98f4-b956db00cda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:10.267607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ad2e8-624f-46d9-98f4-b956db00cda9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:10.267888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ad2e8-624f-46d9-98f4-b956db00cda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:10.268161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ad2e8-624f-46d9-98f4-b956db00cda9 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:10.268878 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ad2e8-624f-46d9-98f4-b956db00cda9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:10.269258 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ad2e8-624f-46d9-98f4-b956db00cda9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:10.270668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ad2e8-624f-46d9-98f4-b956db00cda9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:10.280251 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 339/646] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:09:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:10.280993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ad2e8-624f-46d9-98f4-b956db00cda9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:10.287733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:10.362876 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f328c-78c3-4555-a71c-a1df64fae433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:10.364487 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f328c-78c3-4555-a71c-a1df64fae433 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:10.442912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:10.450129 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ad2e8-624f-46d9-98f4-b956db00cda9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:10.510194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886e401-5631-4aad-84c2-03e43856da0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:10.511182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886e401-5631-4aad-84c2-03e43856da0f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:10.511660 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886e401-5631-4aad-84c2-03e43856da0f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:10.512111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886e401-5631-4aad-84c2-03e43856da0f None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:10.513427 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886e401-5631-4aad-84c2-03e43856da0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:10.513907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886e401-5631-4aad-84c2-03e43856da0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:10.516567 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886e401-5631-4aad-84c2-03e43856da0f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:10.528609 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 308/647] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:09:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:09:10.530450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f328c-78c3-4555-a71c-a1df64fae433 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:10.540922 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 340/648] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:10.542378 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886e401-5631-4aad-84c2-03e43856da0f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:10.626163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:10.692240 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f328c-78c3-4555-a71c-a1df64fae433 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:10.706616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886e401-5631-4aad-84c2-03e43856da0f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:10.735840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e8f16-d3be-46f3-8e24-27ed0310f1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:10.736794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e8f16-d3be-46f3-8e24-27ed0310f1de None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:10.737085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e8f16-d3be-46f3-8e24-27ed0310f1de None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:10.737387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e8f16-d3be-46f3-8e24-27ed0310f1de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:10.747850 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1490c-62dd-49b8-885a-a2145aba0c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:10.748526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1490c-62dd-49b8-885a-a2145aba0c66 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:10.748838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1490c-62dd-49b8-885a-a2145aba0c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:10.749281 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1490c-62dd-49b8-885a-a2145aba0c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:10.749981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e8f16-d3be-46f3-8e24-27ed0310f1de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-489e8f16-d3be-46f3-8e24-27ed0310f1de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:10.755015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:10.761538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:10.762613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:10.762613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:10.762613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:10.762613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:10.762613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:10.762613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:10.762613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:10.762613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:10.762613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:10.762613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:10.762613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:10.762613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:10.762613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 309/649] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:09:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:10.762613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e8f16-d3be-46f3-8e24-27ed0310f1de None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:10.769608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1490c-62dd-49b8-885a-a2145aba0c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:10.770968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1490c-62dd-49b8-885a-a2145aba0c66 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:10.781163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b8f1490c-62dd-49b8-885a-a2145aba0c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:10.792810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:10.794661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:10.796404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:10.796404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:10.796404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:10.796404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 341/650] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:10.796404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1490c-62dd-49b8-885a-a2145aba0c66 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:10.892555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e8f16-d3be-46f3-8e24-27ed0310f1de None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:10.944126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2353e-7e88-47b0-9919-ed1a9f4d639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:10.944833 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2353e-7e88-47b0-9919-ed1a9f4d639a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:10.945106 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2353e-7e88-47b0-9919-ed1a9f4d639a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:10.945377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2353e-7e88-47b0-9919-ed1a9f4d639a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:10.957953 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2353e-7e88-47b0-9919-ed1a9f4d639a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:10.959475 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2353e-7e88-47b0-9919-ed1a9f4d639a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:10.963756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1490c-62dd-49b8-885a-a2145aba0c66 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-aff2353e-7e88-47b0-9919-ed1a9f4d639a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:10.978732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:10.980640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:10.982547 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:10.982547 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:10.982547 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:10.982547 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 310/651] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:10.982547 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2353e-7e88-47b0-9919-ed1a9f4d639a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:11.003002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:11.046250 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67be2f-1c62-476e-81c6-255f0714cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:11.046599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67be2f-1c62-476e-81c6-255f0714cf22 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:11.047020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67be2f-1c62-476e-81c6-255f0714cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:11.047292 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67be2f-1c62-476e-81c6-255f0714cf22 None admin] PATH_INFO: `/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/0b28aaefcb154b228987362921f6476b/roles/8e7b3a48a50745adad97c6205aafc562` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:11.068220 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:11.072851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67be2f-1c62-476e-81c6-255f0714cf22 None admin] RBAC: Authorizing `identity:create_grant(project_id=78142a67f69a4ba58113cc7c8dc269b1, user_id=0b28aaefcb154b228987362921f6476b, role_id=8e7b3a48a50745adad97c6205aafc562)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:11.074314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67be2f-1c62-476e-81c6-255f0714cf22 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:11.090905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 342/652] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:09:10 2022] PUT /identity/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/0b28aaefcb154b228987362921f6476b/roles/8e7b3a48a50745adad97c6205aafc562 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:09:11.091859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67be2f-1c62-476e-81c6-255f0714cf22 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:11.127840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2353e-7e88-47b0-9919-ed1a9f4d639a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:11.190130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571d782-c2b7-4aac-86c6-3caecadcf1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:11.191362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571d782-c2b7-4aac-86c6-3caecadcf1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:11.191816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571d782-c2b7-4aac-86c6-3caecadcf1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:11.192849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571d782-c2b7-4aac-86c6-3caecadcf1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:11.194415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571d782-c2b7-4aac-86c6-3caecadcf1c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:11.194902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571d782-c2b7-4aac-86c6-3caecadcf1c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:11.197786 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571d782-c2b7-4aac-86c6-3caecadcf1c3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:11.221052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 311/653] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:09:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:11.221052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571d782-c2b7-4aac-86c6-3caecadcf1c3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:11.268618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67be2f-1c62-476e-81c6-255f0714cf22 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:11.322896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c6a8c-f513-45dd-ae0b-a291727bc548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:11.323722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c6a8c-f513-45dd-ae0b-a291727bc548 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:11.324174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c6a8c-f513-45dd-ae0b-a291727bc548 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:11.324627 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c6a8c-f513-45dd-ae0b-a291727bc548 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:11.325727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c6a8c-f513-45dd-ae0b-a291727bc548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:11.326235 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c6a8c-f513-45dd-ae0b-a291727bc548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:11.328611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c6a8c-f513-45dd-ae0b-a291727bc548 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:11.352603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 343/654] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:11.352603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f5ad7-7c14-4ee3-a876-cf1953b64d41 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:11.352603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f5ad7-7c14-4ee3-a876-cf1953b64d41 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:11.352603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f5ad7-7c14-4ee3-a876-cf1953b64d41 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:11.352603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 344/655] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:11.353724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f5ad7-7c14-4ee3-a876-cf1953b64d41 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:11.384520 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571d782-c2b7-4aac-86c6-3caecadcf1c3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:11.399775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:11.434049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:11.441588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeec65d-60fd-46e4-af83-04a82007e51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:11.442264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeec65d-60fd-46e4-af83-04a82007e51b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:11.442559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeec65d-60fd-46e4-af83-04a82007e51b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:11.442830 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeec65d-60fd-46e4-af83-04a82007e51b None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:11.446698 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeec65d-60fd-46e4-af83-04a82007e51b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:11.446698 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeec65d-60fd-46e4-af83-04a82007e51b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:11.446698 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeec65d-60fd-46e4-af83-04a82007e51b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:11.462148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 312/656] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:11.463601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef1b4-2917-40f6-8b06-60bd6ce68961 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:11.463887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef1b4-2917-40f6-8b06-60bd6ce68961 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:11.464158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef1b4-2917-40f6-8b06-60bd6ce68961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:11.486759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e67ef1b4-2917-40f6-8b06-60bd6ce68961 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:11.488038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e67ef1b4-2917-40f6-8b06-60bd6ce68961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:11.548481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f5ad7-7c14-4ee3-a876-cf1953b64d41 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:11.582005 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 313/657] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:09:11.583902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ef1b4-2917-40f6-8b06-60bd6ce68961 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:11.623018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0114-3458-41aa-ab1d-37e86a555926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:11.624158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0114-3458-41aa-ab1d-37e86a555926 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:11.624622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0114-3458-41aa-ab1d-37e86a555926 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:11.625115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0114-3458-41aa-ab1d-37e86a555926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:11.649480 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a0114-3458-41aa-ab1d-37e86a555926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:11.652733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a0114-3458-41aa-ab1d-37e86a555926 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ed0a0114-3458-41aa-ab1d-37e86a555926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:11.682312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:11.684153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:11.686352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:11.686352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:11.686352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:11.689776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 345/658] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:11.691732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0114-3458-41aa-ab1d-37e86a555926 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:11.778093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ef1b4-2917-40f6-8b06-60bd6ce68961 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:11.818396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:11.850759 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:11.856057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1bf83-4116-4815-95c9-60874f8800c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:11.857937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1bf83-4116-4815-95c9-60874f8800c2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:11.858666 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1bf83-4116-4815-95c9-60874f8800c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:11.859366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1bf83-4116-4815-95c9-60874f8800c2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:11.879301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1bf83-4116-4815-95c9-60874f8800c2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:11.881260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1bf83-4116-4815-95c9-60874f8800c2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-28e1bf83-4116-4815-95c9-60874f8800c2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:11.897183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:11.899077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:11.901515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:11.901515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:11.901515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:11.901515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:11.901515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:11.901515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:11.901515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:11.901515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:11.901515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 16:09:11.901515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:11.901515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 314/659] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:09:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:11.901515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1bf83-4116-4815-95c9-60874f8800c2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:11.910407 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0114-3458-41aa-ab1d-37e86a555926 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:11.979301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b1ba3-96d7-416f-ab04-d96e4c43c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:11.980403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b1ba3-96d7-416f-ab04-d96e4c43c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:11.980935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b1ba3-96d7-416f-ab04-d96e4c43c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:11.981433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b1ba3-96d7-416f-ab04-d96e4c43c3c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:11.994786 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b1ba3-96d7-416f-ab04-d96e4c43c3c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:11.997628 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b1ba3-96d7-416f-ab04-d96e4c43c3c6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4b5b1ba3-96d7-416f-ab04-d96e4c43c3c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:12.021210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:12.022869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:12.024901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:12.024901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:12.024901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:12.024901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:12.024901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:12.024901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:12.024901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:12.024901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:12.024901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 346/660] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:12.027437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b1ba3-96d7-416f-ab04-d96e4c43c3c6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:12.046166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1bf83-4116-4815-95c9-60874f8800c2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:12.091913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fc0d8-6747-4d23-a047-d14d25ece9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:12.092747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fc0d8-6747-4d23-a047-d14d25ece9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:12.093147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fc0d8-6747-4d23-a047-d14d25ece9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:12.093546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fc0d8-6747-4d23-a047-d14d25ece9a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:12.094342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fc0d8-6747-4d23-a047-d14d25ece9a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:12.094870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fc0d8-6747-4d23-a047-d14d25ece9a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:12.096591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fc0d8-6747-4d23-a047-d14d25ece9a5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:12.112924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 315/661] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:12.114270 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fc0d8-6747-4d23-a047-d14d25ece9a5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:12.189908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:12.232544 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b1ba3-96d7-416f-ab04-d96e4c43c3c6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:12.277145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533df7a-f77f-4f75-b38f-95a701bb620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:12.278053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533df7a-f77f-4f75-b38f-95a701bb620c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:12.278053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533df7a-f77f-4f75-b38f-95a701bb620c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:12.278329 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533df7a-f77f-4f75-b38f-95a701bb620c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:12.281673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:12.293508 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fc0d8-6747-4d23-a047-d14d25ece9a5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:12.293789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533df7a-f77f-4f75-b38f-95a701bb620c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:12.295180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533df7a-f77f-4f75-b38f-95a701bb620c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f533df7a-f77f-4f75-b38f-95a701bb620c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:12.313216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:12.315332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:12.317164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:12.317164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:12.317164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:12.317164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 347/662] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:12.317164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533df7a-f77f-4f75-b38f-95a701bb620c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:12.357227 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45fc5c-44a2-4c77-bcc8-d2bf9344eda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:12.358196 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45fc5c-44a2-4c77-bcc8-d2bf9344eda6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:12.358658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45fc5c-44a2-4c77-bcc8-d2bf9344eda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:12.359404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45fc5c-44a2-4c77-bcc8-d2bf9344eda6 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:12.360354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45fc5c-44a2-4c77-bcc8-d2bf9344eda6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:12.360887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45fc5c-44a2-4c77-bcc8-d2bf9344eda6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:12.363593 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45fc5c-44a2-4c77-bcc8-d2bf9344eda6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:12.400730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 316/663] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 21 16:09:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:12.400730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45fc5c-44a2-4c77-bcc8-d2bf9344eda6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:12.506935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533df7a-f77f-4f75-b38f-95a701bb620c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:12.551610 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6b4bc-8940-4aeb-b0a3-ead2c1f6bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:12.552512 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6b4bc-8940-4aeb-b0a3-ead2c1f6bf2a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:12.553006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6b4bc-8940-4aeb-b0a3-ead2c1f6bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:12.553394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6b4bc-8940-4aeb-b0a3-ead2c1f6bf2a None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:12.554253 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6b4bc-8940-4aeb-b0a3-ead2c1f6bf2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:12.554710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6b4bc-8940-4aeb-b0a3-ead2c1f6bf2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:12.556523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6b4bc-8940-4aeb-b0a3-ead2c1f6bf2a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:12.579097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 348/664] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:12.579097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6b4bc-8940-4aeb-b0a3-ead2c1f6bf2a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:12.594811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:12.603599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45fc5c-44a2-4c77-bcc8-d2bf9344eda6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:12.643893 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:12.677197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae801d-a007-49d1-bd3b-56f7c45a097c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:12.678313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae801d-a007-49d1-bd3b-56f7c45a097c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:12.678815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae801d-a007-49d1-bd3b-56f7c45a097c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:12.679308 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae801d-a007-49d1-bd3b-56f7c45a097c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:12.694704 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae801d-a007-49d1-bd3b-56f7c45a097c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:12.698226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae801d-a007-49d1-bd3b-56f7c45a097c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:12.718001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6b4bc-8940-4aeb-b0a3-ead2c1f6bf2a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-52ae801d-a007-49d1-bd3b-56f7c45a097c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:12.722524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:12.724333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:12.733726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:12.733726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:12.733726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:12.733726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:12.733726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:12.733726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:12.733726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:12.733726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:12.733726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:09:12.733726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:12.733726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 317/665] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 21 16:09:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:12.733726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae801d-a007-49d1-bd3b-56f7c45a097c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:12.787710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9c745-2a45-40df-b6f3-21aec3119359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:12.788592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c745-2a45-40df-b6f3-21aec3119359 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:12.789065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c745-2a45-40df-b6f3-21aec3119359 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:12.789993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c745-2a45-40df-b6f3-21aec3119359 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:12.790990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9c745-2a45-40df-b6f3-21aec3119359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:12.791293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9c745-2a45-40df-b6f3-21aec3119359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:12.792671 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9c745-2a45-40df-b6f3-21aec3119359 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:12.808058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 349/666] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:12.810259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9c745-2a45-40df-b6f3-21aec3119359 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:12.892284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae801d-a007-49d1-bd3b-56f7c45a097c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:12.942760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219f8be-45eb-4e6b-8496-6b147bd10510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:12.943510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219f8be-45eb-4e6b-8496-6b147bd10510 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:12.944320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219f8be-45eb-4e6b-8496-6b147bd10510 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:12.944768 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219f8be-45eb-4e6b-8496-6b147bd10510 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:12.985033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9c745-2a45-40df-b6f3-21aec3119359 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:12.991219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:13.005473 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:13.047113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219f8be-45eb-4e6b-8496-6b147bd10510 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:13.049054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219f8be-45eb-4e6b-8496-6b147bd10510 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:13.058303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb5e8d-177a-459a-b999-a043be2effb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:13.059637 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5e8d-177a-459a-b999-a043be2effb4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:13.060711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5e8d-177a-459a-b999-a043be2effb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:13.060879 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5e8d-177a-459a-b999-a043be2effb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:13.062179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb5e8d-177a-459a-b999-a043be2effb4 None admin] RBAC: Adding query filter params (role.id=8e7b3a48a50745adad97c6205aafc562, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=0e765e2cc4c94243b00f919e8f8d01a1) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:13.062724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb5e8d-177a-459a-b999-a043be2effb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:13.065499 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb5e8d-177a-459a-b999-a043be2effb4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:13.088740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 350/667] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:09:12 2022] GET /identity/v3/role_assignments?user.id=0e765e2cc4c94243b00f919e8f8d01a1&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=8e7b3a48a50745adad97c6205aafc562 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:13.088740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb5e8d-177a-459a-b999-a043be2effb4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:13.264531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 318/668] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:09:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:09:13.266278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219f8be-45eb-4e6b-8496-6b147bd10510 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:13.292282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb5e8d-177a-459a-b999-a043be2effb4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:13.372855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4fb9e-62b1-44e4-811e-b4577335f68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:13.373925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4fb9e-62b1-44e4-811e-b4577335f68d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:13.374420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4fb9e-62b1-44e4-811e-b4577335f68d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:13.374926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4fb9e-62b1-44e4-811e-b4577335f68d None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:13.376809 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4fb9e-62b1-44e4-811e-b4577335f68d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:13.378160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4fb9e-62b1-44e4-811e-b4577335f68d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:13.381641 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4fb9e-62b1-44e4-811e-b4577335f68d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:13.402280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:13.420670 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 351/669] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 21 16:09:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:13.422126 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4fb9e-62b1-44e4-811e-b4577335f68d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:13.476453 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219f8be-45eb-4e6b-8496-6b147bd10510 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:13.488617 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:13.520512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb3208-0fb4-436b-b37a-09bf491fa67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:13.521528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb3208-0fb4-436b-b37a-09bf491fa67a None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:13.522007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb3208-0fb4-436b-b37a-09bf491fa67a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:13.522446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb3208-0fb4-436b-b37a-09bf491fa67a None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:13.524391 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb3208-0fb4-436b-b37a-09bf491fa67a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:13.527211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb3208-0fb4-436b-b37a-09bf491fa67a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:13.572747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 319/670] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:09:13 2022] POST /identity/v3/users => generated 254 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:09:13.572747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb3208-0fb4-436b-b37a-09bf491fa67a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:13.603363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4fb9e-62b1-44e4-811e-b4577335f68d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:13.679370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f3acf-b4b3-4d7f-95bf-e18354c5d95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:13.682166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f3acf-b4b3-4d7f-95bf-e18354c5d95a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:13.682721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f3acf-b4b3-4d7f-95bf-e18354c5d95a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:13.683196 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f3acf-b4b3-4d7f-95bf-e18354c5d95a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:13.709429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f3acf-b4b3-4d7f-95bf-e18354c5d95a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:13.714966 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f3acf-b4b3-4d7f-95bf-e18354c5d95a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f46f3acf-b4b3-4d7f-95bf-e18354c5d95a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:13.750316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:13.752130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:13.755168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:13.755168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:13.755168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:13.755168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 352/671] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:13.755996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9eeda-4223-4b7d-940f-cb2f39c2034e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:13.756228 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9eeda-4223-4b7d-940f-cb2f39c2034e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:13.760170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9eeda-4223-4b7d-940f-cb2f39c2034e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:13.764836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 353/672] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:13.769654 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9eeda-4223-4b7d-940f-cb2f39c2034e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:13.786182 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb3208-0fb4-436b-b37a-09bf491fa67a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:13.824290 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:13.864640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1684de-4982-4991-9776-b1b859adc0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:13.866002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1684de-4982-4991-9776-b1b859adc0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:13.866760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1684de-4982-4991-9776-b1b859adc0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:13.867330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1684de-4982-4991-9776-b1b859adc0b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:13.956614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:13.994946 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9eeda-4223-4b7d-940f-cb2f39c2034e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:13.998118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1684de-4982-4991-9776-b1b859adc0b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:14.003034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1684de-4982-4991-9776-b1b859adc0b0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:14.069624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35148650-5d62-4e7a-86f5-d15ad4b43ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:14.072266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35148650-5d62-4e7a-86f5-d15ad4b43ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:14.073177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35148650-5d62-4e7a-86f5-d15ad4b43ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:14.073932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35148650-5d62-4e7a-86f5-d15ad4b43ed7 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:14.076321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35148650-5d62-4e7a-86f5-d15ad4b43ed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:14.077282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35148650-5d62-4e7a-86f5-d15ad4b43ed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:14.081136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35148650-5d62-4e7a-86f5-d15ad4b43ed7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:14.107755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 354/673] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:14.110625 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201701-b9da-46a9-bba2-5d49de5de93b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:14.110625 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201701-b9da-46a9-bba2-5d49de5de93b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:14.111242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201701-b9da-46a9-bba2-5d49de5de93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:14.141634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-23201701-b9da-46a9-bba2-5d49de5de93b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:14.143391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-23201701-b9da-46a9-bba2-5d49de5de93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:14.195060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 320/674] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:09:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:09:14.197036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1684de-4982-4991-9776-b1b859adc0b0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:14.223820 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:14.264761 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 355/675] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:09:14.264761 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201701-b9da-46a9-bba2-5d49de5de93b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:14.437373 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:14.517507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201701-b9da-46a9-bba2-5d49de5de93b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:14.526446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1684de-4982-4991-9776-b1b859adc0b0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:14.595486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc9bfb-0b3c-4ce8-90c3-76ecf2cfbd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:14.596620 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc9bfb-0b3c-4ce8-90c3-76ecf2cfbd4c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:14.597154 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc9bfb-0b3c-4ce8-90c3-76ecf2cfbd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:14.597652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc9bfb-0b3c-4ce8-90c3-76ecf2cfbd4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:14.638547 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc9bfb-0b3c-4ce8-90c3-76ecf2cfbd4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:14.641182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc9bfb-0b3c-4ce8-90c3-76ecf2cfbd4c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:14.661881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b6f94-c6a0-4a59-b8c1-6eba532c3330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:14.663024 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b6f94-c6a0-4a59-b8c1-6eba532c3330 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:14.663524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b6f94-c6a0-4a59-b8c1-6eba532c3330 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:14.664015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b6f94-c6a0-4a59-b8c1-6eba532c3330 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-79cc9bfb-0b3c-4ce8-90c3-76ecf2cfbd4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:14.699867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:14.701676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:14.703394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:14.703394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:14.703394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:14.703394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 356/676] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:14.710338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b6f94-c6a0-4a59-b8c1-6eba532c3330 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:14.713486 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b6f94-c6a0-4a59-b8c1-6eba532c3330 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:14.720386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc9bfb-0b3c-4ce8-90c3-76ecf2cfbd4c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-777b6f94-c6a0-4a59-b8c1-6eba532c3330 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:14.757125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:14.758670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:14.760069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:14.760069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:14.760069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:14.760069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:14.760069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:14.760069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:14.760069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:14.760069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:14.760069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 321/677] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 563 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:14.766729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b6f94-c6a0-4a59-b8c1-6eba532c3330 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:15.007502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:15.036166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc9bfb-0b3c-4ce8-90c3-76ecf2cfbd4c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:15.063409 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b6f94-c6a0-4a59-b8c1-6eba532c3330 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:15.084390 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:15.108205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51329b50-0d21-48db-90c5-19919aa18eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:15.109861 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51329b50-0d21-48db-90c5-19919aa18eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:15.110582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51329b50-0d21-48db-90c5-19919aa18eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:15.111350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51329b50-0d21-48db-90c5-19919aa18eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:15.112750 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51329b50-0d21-48db-90c5-19919aa18eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:15.113624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51329b50-0d21-48db-90c5-19919aa18eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:15.117653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51329b50-0d21-48db-90c5-19919aa18eb5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:15.135608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333992c0-e78b-46d1-b2b5-dbf2c0c0ea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:15.136762 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333992c0-e78b-46d1-b2b5-dbf2c0c0ea81 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:15.137270 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333992c0-e78b-46d1-b2b5-dbf2c0c0ea81 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:15.137747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333992c0-e78b-46d1-b2b5-dbf2c0c0ea81 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:15.138677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333992c0-e78b-46d1-b2b5-dbf2c0c0ea81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:15.139196 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333992c0-e78b-46d1-b2b5-dbf2c0c0ea81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:15.140894 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333992c0-e78b-46d1-b2b5-dbf2c0c0ea81 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:15.143113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 357/678] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:15.144770 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51329b50-0d21-48db-90c5-19919aa18eb5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:15.157851 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 322/679] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:15.164018 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333992c0-e78b-46d1-b2b5-dbf2c0c0ea81 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:15.302884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333992c0-e78b-46d1-b2b5-dbf2c0c0ea81 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:15.344218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f79d9e-55a9-4549-99e4-c73ce865e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:15.344942 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f79d9e-55a9-4549-99e4-c73ce865e454 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:15.345270 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f79d9e-55a9-4549-99e4-c73ce865e454 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:15.345544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f79d9e-55a9-4549-99e4-c73ce865e454 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:15.355553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f79d9e-55a9-4549-99e4-c73ce865e454 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:15.357365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f79d9e-55a9-4549-99e4-c73ce865e454 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:15.360202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51329b50-0d21-48db-90c5-19919aa18eb5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:15.360668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-93f79d9e-55a9-4549-99e4-c73ce865e454 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:15.372284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:15.373286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:15.374223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:15.374223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:15.374223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:15.374223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:15.374223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:15.374223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:15.374223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:15.374223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:15.377571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 323/680] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:15.378757 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f79d9e-55a9-4549-99e4-c73ce865e454 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:15.422115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63327550-4c09-4070-ad93-6cbfda464772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:15.422786 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63327550-4c09-4070-ad93-6cbfda464772 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:15.423059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63327550-4c09-4070-ad93-6cbfda464772 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:15.423354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63327550-4c09-4070-ad93-6cbfda464772 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:15.441058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63327550-4c09-4070-ad93-6cbfda464772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-63327550-4c09-4070-ad93-6cbfda464772 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:15.448159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:15.449330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:15.450201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:15.450201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:15.450201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:15.450201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:15.450201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:15.450201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:15.450201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:15.450201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:15.450201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:15.450201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:15.450201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:15.450201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:15.450201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 358/681] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:09:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:15.450201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63327550-4c09-4070-ad93-6cbfda464772 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:15.519931 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:15.542030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f79d9e-55a9-4549-99e4-c73ce865e454 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:15.584257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997c445-ddbd-4d47-ac0c-98fbe719c547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:15.585318 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997c445-ddbd-4d47-ac0c-98fbe719c547 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:15.585881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997c445-ddbd-4d47-ac0c-98fbe719c547 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:15.586548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997c445-ddbd-4d47-ac0c-98fbe719c547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:15.587748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997c445-ddbd-4d47-ac0c-98fbe719c547 None admin] RBAC: Adding query filter params (role.id=8e7b3a48a50745adad97c6205aafc562, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=aa61549530e648a0b774a784b0450162) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:15.588518 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997c445-ddbd-4d47-ac0c-98fbe719c547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:15.591038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997c445-ddbd-4d47-ac0c-98fbe719c547 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:15.603545 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63327550-4c09-4070-ad93-6cbfda464772 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:15.604058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 324/682] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:09:15 2022] GET /identity/v3/role_assignments?user.id=aa61549530e648a0b774a784b0450162&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=8e7b3a48a50745adad97c6205aafc562 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:15.605333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997c445-ddbd-4d47-ac0c-98fbe719c547 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:15.649324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d237c4b-0d85-4ad0-b49e-9de249208d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:15.649983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d237c4b-0d85-4ad0-b49e-9de249208d65 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:15.650432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d237c4b-0d85-4ad0-b49e-9de249208d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:15.650710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d237c4b-0d85-4ad0-b49e-9de249208d65 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:15.651430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d237c4b-0d85-4ad0-b49e-9de249208d65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:15.651733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d237c4b-0d85-4ad0-b49e-9de249208d65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:15.653380 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d237c4b-0d85-4ad0-b49e-9de249208d65 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:15.672481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 359/683] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:15.680811 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d237c4b-0d85-4ad0-b49e-9de249208d65 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:15.735823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:15.822647 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d237c4b-0d85-4ad0-b49e-9de249208d65 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:15.827268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:15.830490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997c445-ddbd-4d47-ac0c-98fbe719c547 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:15.872926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed87d1a-ee49-49b1-9657-dfb357fac11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:15.874465 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed87d1a-ee49-49b1-9657-dfb357fac11e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:15.875247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed87d1a-ee49-49b1-9657-dfb357fac11e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:15.876028 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed87d1a-ee49-49b1-9657-dfb357fac11e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:15.877774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed87d1a-ee49-49b1-9657-dfb357fac11e None admin] RBAC: Adding query filter params (role.id=8e7b3a48a50745adad97c6205aafc562, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=d7ff08c990dc41b4811f97fecb7c4c3a) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:15.878736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed87d1a-ee49-49b1-9657-dfb357fac11e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:15.883630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed87d1a-ee49-49b1-9657-dfb357fac11e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:15.898768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 360/684] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:09:15 2022] GET /identity/v3/role_assignments?user.id=d7ff08c990dc41b4811f97fecb7c4c3a&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=8e7b3a48a50745adad97c6205aafc562 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:15.933773 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6d4dd-891d-4571-9300-c0ede206c622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:15.934730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d4dd-891d-4571-9300-c0ede206c622 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:15.935194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d4dd-891d-4571-9300-c0ede206c622 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:15.935642 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d4dd-891d-4571-9300-c0ede206c622 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:15.936791 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6d4dd-891d-4571-9300-c0ede206c622 None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:15.937287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6d4dd-891d-4571-9300-c0ede206c622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:15.939667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6d4dd-891d-4571-9300-c0ede206c622 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:15.960879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 325/685] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:09:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:15.970746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed87d1a-ee49-49b1-9657-dfb357fac11e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:16.126018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed87d1a-ee49-49b1-9657-dfb357fac11e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:16.172238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81151608-8a74-464b-a54c-6610c56f20c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:16.173245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81151608-8a74-464b-a54c-6610c56f20c2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:16.173737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81151608-8a74-464b-a54c-6610c56f20c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:16.174188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81151608-8a74-464b-a54c-6610c56f20c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:16.190899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81151608-8a74-464b-a54c-6610c56f20c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:16.192926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81151608-8a74-464b-a54c-6610c56f20c2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-81151608-8a74-464b-a54c-6610c56f20c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:16.215914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:16.217014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:16.217925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:16.217925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:16.217925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:16.220241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 361/686] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:16.228617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6d4dd-891d-4571-9300-c0ede206c622 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:16.437911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6d4dd-891d-4571-9300-c0ede206c622 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:16.480072 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4266ba-057b-4330-8ed2-e49b86222315 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:16.480797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4266ba-057b-4330-8ed2-e49b86222315 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:16.483063 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4266ba-057b-4330-8ed2-e49b86222315 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:16.485587 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:16.491900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 362/687] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:16 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:16.503616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31859205-1d2c-4e96-bc94-e3e6f4c6caf9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:16.504015 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31859205-1d2c-4e96-bc94-e3e6f4c6caf9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:16.504383 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31859205-1d2c-4e96-bc94-e3e6f4c6caf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:16.512280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18015dc1-2bcd-4cf5-be42-5cb2ba4f6ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:16.513251 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18015dc1-2bcd-4cf5-be42-5cb2ba4f6ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:16.513533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18015dc1-2bcd-4cf5-be42-5cb2ba4f6ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:16.513810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18015dc1-2bcd-4cf5-be42-5cb2ba4f6ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:16.514486 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18015dc1-2bcd-4cf5-be42-5cb2ba4f6ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:16.514792 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18015dc1-2bcd-4cf5-be42-5cb2ba4f6ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:16.516294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18015dc1-2bcd-4cf5-be42-5cb2ba4f6ad5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:16.529546 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-31859205-1d2c-4e96-bc94-e3e6f4c6caf9 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:16.531983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-31859205-1d2c-4e96-bc94-e3e6f4c6caf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:16.534187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 326/688] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:16.539343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18015dc1-2bcd-4cf5-be42-5cb2ba4f6ad5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:16.549902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:16.648476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 363/689] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:09:16.688249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18015dc1-2bcd-4cf5-be42-5cb2ba4f6ad5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:16.737146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccd76a-36f7-4d1e-b885-56d77edc91f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:16.738301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd76a-36f7-4d1e-b885-56d77edc91f1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:16.738802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd76a-36f7-4d1e-b885-56d77edc91f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:16.739113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd76a-36f7-4d1e-b885-56d77edc91f1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:16.748868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccd76a-36f7-4d1e-b885-56d77edc91f1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:16.750382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccd76a-36f7-4d1e-b885-56d77edc91f1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-f3ccd76a-36f7-4d1e-b885-56d77edc91f1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:16.764331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:16.765416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:16.767020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:16.767020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:16.767020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:16.767020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:16.767020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:16.767020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:16.767020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:16.767020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:16.767020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 16:09:16.767020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:16.767020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 327/690] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:09:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:16.775154 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31859205-1d2c-4e96-bc94-e3e6f4c6caf9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:16.874524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47b78-5c3a-4189-9709-d2ecbffd4895 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:16.874944 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47b78-5c3a-4189-9709-d2ecbffd4895 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:16.875065 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47b78-5c3a-4189-9709-d2ecbffd4895 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:16.876912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 328/691] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:16.888725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bab35-c9a5-45ce-809a-9364f05e26b2 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:16.888725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bab35-c9a5-45ce-809a-9364f05e26b2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:16.888725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bab35-c9a5-45ce-809a-9364f05e26b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:16.910656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-498bab35-c9a5-45ce-809a-9364f05e26b2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:16.913001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-498bab35-c9a5-45ce-809a-9364f05e26b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:16.960632 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:16.974344 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31859205-1d2c-4e96-bc94-e3e6f4c6caf9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:17.035686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 329/692] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:09:17.037705 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bab35-c9a5-45ce-809a-9364f05e26b2 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:17.053433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc931e4-61da-4aef-9b21-62f9260da778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:17.054069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc931e4-61da-4aef-9b21-62f9260da778 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:17.054347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc931e4-61da-4aef-9b21-62f9260da778 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:17.054617 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc931e4-61da-4aef-9b21-62f9260da778 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:17.055397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc931e4-61da-4aef-9b21-62f9260da778 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:17.055702 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc931e4-61da-4aef-9b21-62f9260da778 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:17.057216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc931e4-61da-4aef-9b21-62f9260da778 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:17.088021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 364/693] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 21 16:09:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:17.096415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc931e4-61da-4aef-9b21-62f9260da778 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:17.112042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:17.157205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bab35-c9a5-45ce-809a-9364f05e26b2 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:17.198246 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8777aa-2749-4e1a-aac4-a0b07b1f7829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:17.198902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8777aa-2749-4e1a-aac4-a0b07b1f7829 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:17.199178 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8777aa-2749-4e1a-aac4-a0b07b1f7829 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:17.199447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8777aa-2749-4e1a-aac4-a0b07b1f7829 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:17.218657 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8777aa-2749-4e1a-aac4-a0b07b1f7829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-9b8777aa-2749-4e1a-aac4-a0b07b1f7829 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:17.231010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:17.233911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:17.236058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:17.236058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:17.236058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:17.236058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:17.236058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:17.236058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:17.236058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:17.236058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:17.236058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:17.236058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:17.236058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:17.236058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:17.236058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 330/694] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:09:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:17.243290 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8777aa-2749-4e1a-aac4-a0b07b1f7829 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:17.296850 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc931e4-61da-4aef-9b21-62f9260da778 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:17.314144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:17.372181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e140c2-4712-4f6a-ab40-5897776c5cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:17.372838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e140c2-4712-4f6a-ab40-5897776c5cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:17.373378 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e140c2-4712-4f6a-ab40-5897776c5cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:17.373648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e140c2-4712-4f6a-ab40-5897776c5cc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:17.469442 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8777aa-2749-4e1a-aac4-a0b07b1f7829 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:17.529608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e140c2-4712-4f6a-ab40-5897776c5cc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:17.532596 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e140c2-4712-4f6a-ab40-5897776c5cc8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:17.537038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4e657-a0b6-43de-a8d7-a1d8eef171d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:17.538289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4e657-a0b6-43de-a8d7-a1d8eef171d2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:17.538762 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4e657-a0b6-43de-a8d7-a1d8eef171d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:17.539747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4e657-a0b6-43de-a8d7-a1d8eef171d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:17.540791 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4e657-a0b6-43de-a8d7-a1d8eef171d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:17.541235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4e657-a0b6-43de-a8d7-a1d8eef171d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:17.543263 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4e657-a0b6-43de-a8d7-a1d8eef171d2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:17.553889 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:17.559337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 331/695] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:09:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:17.561491 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4e657-a0b6-43de-a8d7-a1d8eef171d2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:17.741171 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 365/696] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:09:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 16:09:17.743350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e140c2-4712-4f6a-ab40-5897776c5cc8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:17.759727 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:17.773029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4e657-a0b6-43de-a8d7-a1d8eef171d2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:17.844546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d8ca-89d1-4636-86f9-d05f840b034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:17.845981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d8ca-89d1-4636-86f9-d05f840b034a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:17.846673 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d8ca-89d1-4636-86f9-d05f840b034a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:17.847389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d8ca-89d1-4636-86f9-d05f840b034a None admin] PATH_INFO: `/v3/services/network` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:17.848712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386d8ca-89d1-4636-86f9-d05f840b034a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:17.851255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386d8ca-89d1-4636-86f9-d05f840b034a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-7386d8ca-89d1-4636-86f9-d05f840b034a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:17.877307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:17.879553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:17.882707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:17.882707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:17.882707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:17.882707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:17.882707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:17.882707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:17.882707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:17.882707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:17.882707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:17.882707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:17.882707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:17.882707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:17.882707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 16:09:17.882707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:17.896090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 332/697] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:17 2022] GET /identity/v3/services/network => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:17.896090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d8ca-89d1-4636-86f9-d05f840b034a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:17.947968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e140c2-4712-4f6a-ab40-5897776c5cc8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:17.969586 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:18.025116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aa4d4-dd55-4b07-8899-9c3381e21099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:18.026316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aa4d4-dd55-4b07-8899-9c3381e21099 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:18.026931 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aa4d4-dd55-4b07-8899-9c3381e21099 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:18.027549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aa4d4-dd55-4b07-8899-9c3381e21099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:18.049602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2aa4d4-dd55-4b07-8899-9c3381e21099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:18.052592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2aa4d4-dd55-4b07-8899-9c3381e21099 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:18.078407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d8ca-89d1-4636-86f9-d05f840b034a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1d2aa4d4-dd55-4b07-8899-9c3381e21099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:18.084988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:18.087488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:18.090623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:18.090623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:18.090623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:18.090623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 366/698] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:18.091452 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aa4d4-dd55-4b07-8899-9c3381e21099 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:18.125763 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9b474-520f-404c-a0c4-b734ad41029d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:18.126401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9b474-520f-404c-a0c4-b734ad41029d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:18.126672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9b474-520f-404c-a0c4-b734ad41029d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:18.126926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9b474-520f-404c-a0c4-b734ad41029d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:18.138394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9b474-520f-404c-a0c4-b734ad41029d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:18.139935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9b474-520f-404c-a0c4-b734ad41029d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-0df9b474-520f-404c-a0c4-b734ad41029d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:18.156120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:18.159897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:18.162549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:18.162549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:18.162549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:18.162549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 333/699] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:18.162549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9b474-520f-404c-a0c4-b734ad41029d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:18.172199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:18.271555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9b474-520f-404c-a0c4-b734ad41029d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:18.305868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aa4d4-dd55-4b07-8899-9c3381e21099 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:18.309305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6f719-3454-493b-b6b1-cb2725e0c626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:18.310096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6f719-3454-493b-b6b1-cb2725e0c626 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:18.310472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6f719-3454-493b-b6b1-cb2725e0c626 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:18.310842 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6f719-3454-493b-b6b1-cb2725e0c626 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:18.311639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6f719-3454-493b-b6b1-cb2725e0c626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:18.313069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6f719-3454-493b-b6b1-cb2725e0c626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:18.313613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6f719-3454-493b-b6b1-cb2725e0c626 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:18.332721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 334/700] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:18.332721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6f719-3454-493b-b6b1-cb2725e0c626 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:18.390760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780f072-9bcb-41eb-9535-a5af73e6ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:18.392249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780f072-9bcb-41eb-9535-a5af73e6ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:18.393114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780f072-9bcb-41eb-9535-a5af73e6ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:18.393866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780f072-9bcb-41eb-9535-a5af73e6ceb8 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:18.395249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780f072-9bcb-41eb-9535-a5af73e6ceb8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:18.396161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780f072-9bcb-41eb-9535-a5af73e6ceb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:18.399819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780f072-9bcb-41eb-9535-a5af73e6ceb8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:18.404835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:18.411093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 367/701] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 21 16:09:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:18.413188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780f072-9bcb-41eb-9535-a5af73e6ceb8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:18.444715 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6f719-3454-493b-b6b1-cb2725e0c626 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:18.463785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:18.489620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543680af-8b52-47cb-9b09-dacd95acfaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:18.490271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543680af-8b52-47cb-9b09-dacd95acfaaa None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:18.490550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543680af-8b52-47cb-9b09-dacd95acfaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:18.490844 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543680af-8b52-47cb-9b09-dacd95acfaaa None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:18.491467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543680af-8b52-47cb-9b09-dacd95acfaaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:18.491770 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543680af-8b52-47cb-9b09-dacd95acfaaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:18.493245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543680af-8b52-47cb-9b09-dacd95acfaaa None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:18.507611 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 335/702] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:18.508557 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543680af-8b52-47cb-9b09-dacd95acfaaa None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:18.625689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780f072-9bcb-41eb-9535-a5af73e6ceb8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:18.637037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543680af-8b52-47cb-9b09-dacd95acfaaa None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:18.685446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:18.697686 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89318f-eba6-4c4a-8b7e-981bb9bb6dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:18.699209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89318f-eba6-4c4a-8b7e-981bb9bb6dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:18.699963 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89318f-eba6-4c4a-8b7e-981bb9bb6dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:18.700727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89318f-eba6-4c4a-8b7e-981bb9bb6dc3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:18.703667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847abebc-015a-4503-809b-81ad722cc77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:18.706780 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847abebc-015a-4503-809b-81ad722cc77a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:18.707216 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847abebc-015a-4503-809b-81ad722cc77a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:18.707628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847abebc-015a-4503-809b-81ad722cc77a None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:18.708467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847abebc-015a-4503-809b-81ad722cc77a None admin] RBAC: Adding query filter params (type=network) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:18.708941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847abebc-015a-4503-809b-81ad722cc77a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:18.710515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847abebc-015a-4503-809b-81ad722cc77a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:18.720434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 336/703] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 21 16:09:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:18.721980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847abebc-015a-4503-809b-81ad722cc77a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:18.725963 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89318f-eba6-4c4a-8b7e-981bb9bb6dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:18.731293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89318f-eba6-4c4a-8b7e-981bb9bb6dc3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4d89318f-eba6-4c4a-8b7e-981bb9bb6dc3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:18.776052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:18.777830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:18.780506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:18.780506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:18.780506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:18.780506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:18.780506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:18.780506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:18.780506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:18.780506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:18.780506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 16:09:18.780506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:18.780506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 368/704] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 21 16:09:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:18.792573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89318f-eba6-4c4a-8b7e-981bb9bb6dc3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:19.016656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847abebc-015a-4503-809b-81ad722cc77a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:19.020001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:19.051766 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89318f-eba6-4c4a-8b7e-981bb9bb6dc3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:19.098675 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea78b3-1317-4da2-939b-d32fe4b243af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:19.100289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea78b3-1317-4da2-939b-d32fe4b243af None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:19.101287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea78b3-1317-4da2-939b-d32fe4b243af None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:19.102658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea78b3-1317-4da2-939b-d32fe4b243af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:19.116330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea78b3-1317-4da2-939b-d32fe4b243af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:19.120763 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea78b3-1317-4da2-939b-d32fe4b243af None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:19.125653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9faf2-ee43-4040-880b-37a727fa8dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:19.126951 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9faf2-ee43-4040-880b-37a727fa8dfd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:19.127535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9faf2-ee43-4040-880b-37a727fa8dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:19.128115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9faf2-ee43-4040-880b-37a727fa8dfd None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:19.129648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9faf2-ee43-4040-880b-37a727fa8dfd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:19.130276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9faf2-ee43-4040-880b-37a727fa8dfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:19.133326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9faf2-ee43-4040-880b-37a727fa8dfd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-f2ea78b3-1317-4da2-939b-d32fe4b243af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:19.146357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:19.147956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:19.150243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:19.150243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:19.150243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:19.150243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:19.150243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:19.150243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:19.150243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:19.150243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:19.153782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 337/705] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:19.163603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea78b3-1317-4da2-939b-d32fe4b243af None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:19.171916 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 369/706] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 21 16:09:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:19.181490 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9faf2-ee43-4040-880b-37a727fa8dfd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:19.288582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:19.396450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9faf2-ee43-4040-880b-37a727fa8dfd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:19.424956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea78b3-1317-4da2-939b-d32fe4b243af None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:19.461658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47faf2-b785-4556-a6bd-05da3653269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:19.462425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47faf2-b785-4556-a6bd-05da3653269f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:19.462715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47faf2-b785-4556-a6bd-05da3653269f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:19.462969 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47faf2-b785-4556-a6bd-05da3653269f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:19.501402 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:19.516483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ae415-0891-483c-9448-398c950f21ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:19.516483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ae415-0891-483c-9448-398c950f21ad None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:19.516483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ae415-0891-483c-9448-398c950f21ad None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:19.516483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ae415-0891-483c-9448-398c950f21ad None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:19.518564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ae415-0891-483c-9448-398c950f21ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:19.518564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ae415-0891-483c-9448-398c950f21ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:19.519291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ae415-0891-483c-9448-398c950f21ad None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:19.555312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 338/707] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:19.562289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ae415-0891-483c-9448-398c950f21ad None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:19.635267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47faf2-b785-4556-a6bd-05da3653269f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:19.636789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47faf2-b785-4556-a6bd-05da3653269f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:19.738156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ae415-0891-483c-9448-398c950f21ad None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:19.754004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:19.779714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff7cfa-a274-4684-8e55-8522c6fe6f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:19.780328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff7cfa-a274-4684-8e55-8522c6fe6f52 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:19.780601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff7cfa-a274-4684-8e55-8522c6fe6f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:19.780916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff7cfa-a274-4684-8e55-8522c6fe6f52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:19.781706 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff7cfa-a274-4684-8e55-8522c6fe6f52 None admin] RBAC: Adding query filter params (role.id=8e7b3a48a50745adad97c6205aafc562, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=0b28aaefcb154b228987362921f6476b) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:19.782015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff7cfa-a274-4684-8e55-8522c6fe6f52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:19.783518 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff7cfa-a274-4684-8e55-8522c6fe6f52 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:19.800719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 339/708] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:09:19 2022] GET /identity/v3/role_assignments?user.id=0b28aaefcb154b228987362921f6476b&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=8e7b3a48a50745adad97c6205aafc562 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:19.800719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c59e2d-3afc-4071-8ff2-4ff0318461eb None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:19.800719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c59e2d-3afc-4071-8ff2-4ff0318461eb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:19.800719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c59e2d-3afc-4071-8ff2-4ff0318461eb None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:19.800719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 340/709] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:19.800719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140063ba-c6f3-40fc-99cd-7cc15d551764 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:19.801603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140063ba-c6f3-40fc-99cd-7cc15d551764 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:19.801603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140063ba-c6f3-40fc-99cd-7cc15d551764 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:19.801603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 341/710] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:19.803709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675d1e8-c7a9-49c8-8303-786243a0b7f5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:19.803709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675d1e8-c7a9-49c8-8303-786243a0b7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:19.803709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675d1e8-c7a9-49c8-8303-786243a0b7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:19.835330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a675d1e8-c7a9-49c8-8303-786243a0b7f5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:19.837451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a675d1e8-c7a9-49c8-8303-786243a0b7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:19.851470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 370/711] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:09:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:09:19.853857 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d68be-b75b-43a8-b587-60bc51358b73 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:19.854361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d68be-b75b-43a8-b587-60bc51358b73 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:19.854816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d68be-b75b-43a8-b587-60bc51358b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:19.880919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-490d68be-b75b-43a8-b587-60bc51358b73 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:19.884485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-490d68be-b75b-43a8-b587-60bc51358b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:19.966200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:19.991680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 342/712] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:09:19.993298 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675d1e8-c7a9-49c8-8303-786243a0b7f5 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:20.058096 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 371/713] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:09:20.160404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675d1e8-c7a9-49c8-8303-786243a0b7f5 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:20.169534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:20.210686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f3977-194c-4dad-a1d5-2052ff72c155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:20.211386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f3977-194c-4dad-a1d5-2052ff72c155 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:20.211663 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f3977-194c-4dad-a1d5-2052ff72c155 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:20.211932 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f3977-194c-4dad-a1d5-2052ff72c155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:20.224232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f3977-194c-4dad-a1d5-2052ff72c155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:20.225723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f3977-194c-4dad-a1d5-2052ff72c155 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-1c5f3977-194c-4dad-a1d5-2052ff72c155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:20.243158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:20.245421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:20.247543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:20.247543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:20.247543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:20.247543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 343/714] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:20.254348 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d68be-b75b-43a8-b587-60bc51358b73 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:20.436981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d68be-b75b-43a8-b587-60bc51358b73 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:20.508886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b46e0-0385-4e57-bea7-f6c179df06a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:20.509514 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b46e0-0385-4e57-bea7-f6c179df06a3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:20.509791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b46e0-0385-4e57-bea7-f6c179df06a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:20.510063 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b46e0-0385-4e57-bea7-f6c179df06a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:20.510724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b46e0-0385-4e57-bea7-f6c179df06a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:20.511026 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b46e0-0385-4e57-bea7-f6c179df06a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:20.512419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b46e0-0385-4e57-bea7-f6c179df06a3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:20.527113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 372/715] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:20.535979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f3977-194c-4dad-a1d5-2052ff72c155 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:20.574190 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b46e0-0385-4e57-bea7-f6c179df06a3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:20.615570 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:20.697541 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b46e0-0385-4e57-bea7-f6c179df06a3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:20.715446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f3977-194c-4dad-a1d5-2052ff72c155 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:20.739820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3b99f-0055-47df-8d5d-05672f42a0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:20.741487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3b99f-0055-47df-8d5d-05672f42a0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:20.742439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3b99f-0055-47df-8d5d-05672f42a0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:20.743232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3b99f-0055-47df-8d5d-05672f42a0c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:20.753645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e44d95-bd74-4d35-8401-b85c40ee7c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:20.754282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e44d95-bd74-4d35-8401-b85c40ee7c72 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:20.754562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e44d95-bd74-4d35-8401-b85c40ee7c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:20.754822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e44d95-bd74-4d35-8401-b85c40ee7c72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:20.762321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e44d95-bd74-4d35-8401-b85c40ee7c72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:20.763812 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e44d95-bd74-4d35-8401-b85c40ee7c72 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:20.765876 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3b99f-0055-47df-8d5d-05672f42a0c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-13b3b99f-0055-47df-8d5d-05672f42a0c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:20.772644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:20.774758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:20.776051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:20.776051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:20.776051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:20.776051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:20.776051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:20.776051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:20.776051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:20.776051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:20.776051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:20.776051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:20.776051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:09:20.776051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-b8e44d95-bd74-4d35-8401-b85c40ee7c72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:20.776898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:20.777781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:20.778835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:20.778835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:20.778835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:20.778835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:20.778835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:20.778835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:20.778835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:20.778835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:20.784741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 344/717] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:20.784741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e44d95-bd74-4d35-8401-b85c40ee7c72 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:20.785084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 373/717] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:09:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:20.786103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3b99f-0055-47df-8d5d-05672f42a0c0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:20.808859 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:20.900867 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e44d95-bd74-4d35-8401-b85c40ee7c72 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:20.939084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6143446-03bd-449f-87ac-7a5d7701ab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:20.939976 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143446-03bd-449f-87ac-7a5d7701ab29 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:20.940458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143446-03bd-449f-87ac-7a5d7701ab29 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:20.940926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143446-03bd-449f-87ac-7a5d7701ab29 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:20.941680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6143446-03bd-449f-87ac-7a5d7701ab29 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:20.943317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6143446-03bd-449f-87ac-7a5d7701ab29 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-e6143446-03bd-449f-87ac-7a5d7701ab29 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:20.953550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:20.954646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:20.955560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:20.955560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:20.955560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:20.955560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:20.955560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:20.955560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:20.955560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:20.955560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:20.955560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:20.955560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:20.955560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:20.955560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:20.955560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 16:09:20.955560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:20.963344 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 345/718] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Sep 21 16:09:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:20.964930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6143446-03bd-449f-87ac-7a5d7701ab29 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:20.971108 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:20.987732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3b99f-0055-47df-8d5d-05672f42a0c0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:21.056005 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daccbf-24f1-42f0-8c18-2b3b49605dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:21.057724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daccbf-24f1-42f0-8c18-2b3b49605dcd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:21.058090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daccbf-24f1-42f0-8c18-2b3b49605dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:21.058691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daccbf-24f1-42f0-8c18-2b3b49605dcd None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:21.059894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daccbf-24f1-42f0-8c18-2b3b49605dcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:21.060576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daccbf-24f1-42f0-8c18-2b3b49605dcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:21.062875 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:21.065735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daccbf-24f1-42f0-8c18-2b3b49605dcd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:21.090505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6143446-03bd-449f-87ac-7a5d7701ab29 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:21.105916 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 374/719] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:21.105916 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daccbf-24f1-42f0-8c18-2b3b49605dcd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:21.142418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703a84f-bbfa-42dd-b834-a5fc82ba07ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:21.143042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a84f-bbfa-42dd-b834-a5fc82ba07ab None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:21.143306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a84f-bbfa-42dd-b834-a5fc82ba07ab None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:21.143638 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a84f-bbfa-42dd-b834-a5fc82ba07ab None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:21.144250 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703a84f-bbfa-42dd-b834-a5fc82ba07ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:21.144552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703a84f-bbfa-42dd-b834-a5fc82ba07ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:21.145984 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703a84f-bbfa-42dd-b834-a5fc82ba07ab None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:21.180987 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 346/720] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:09:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:21.180987 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703a84f-bbfa-42dd-b834-a5fc82ba07ab None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:21.280278 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daccbf-24f1-42f0-8c18-2b3b49605dcd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:21.324210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13074937-ccf0-48ef-9ca5-2ee9ce22bdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:21.329129 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13074937-ccf0-48ef-9ca5-2ee9ce22bdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:21.329719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13074937-ccf0-48ef-9ca5-2ee9ce22bdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:21.330654 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13074937-ccf0-48ef-9ca5-2ee9ce22bdf5 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:21.331557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13074937-ccf0-48ef-9ca5-2ee9ce22bdf5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:21.332071 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13074937-ccf0-48ef-9ca5-2ee9ce22bdf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:21.333714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13074937-ccf0-48ef-9ca5-2ee9ce22bdf5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:21.352948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 375/721] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 21 16:09:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:21.354251 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13074937-ccf0-48ef-9ca5-2ee9ce22bdf5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:21.380063 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:21.427957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703a84f-bbfa-42dd-b834-a5fc82ba07ab None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:21.494890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13074937-ccf0-48ef-9ca5-2ee9ce22bdf5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:21.525410 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777fb71-af50-417d-a8ab-0c1037fadd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:21.526434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777fb71-af50-417d-a8ab-0c1037fadd73 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:21.526930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777fb71-af50-417d-a8ab-0c1037fadd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:21.527212 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777fb71-af50-417d-a8ab-0c1037fadd73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:21.527967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777fb71-af50-417d-a8ab-0c1037fadd73 None admin] RBAC: Adding query filter params (role.id=8e7b3a48a50745adad97c6205aafc562, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=5e20281883414eed9d644e0eaab2ac49) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:21.528299 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777fb71-af50-417d-a8ab-0c1037fadd73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:21.530195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777fb71-af50-417d-a8ab-0c1037fadd73 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:21.548802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 347/722] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:09:21 2022] GET /identity/v3/role_assignments?user.id=5e20281883414eed9d644e0eaab2ac49&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=8e7b3a48a50745adad97c6205aafc562 => generated 259 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:21.548802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777fb71-af50-417d-a8ab-0c1037fadd73 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:21.554185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f5622-26b1-4b9d-87c7-78b0b20ee2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:21.555208 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f5622-26b1-4b9d-87c7-78b0b20ee2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:21.555767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f5622-26b1-4b9d-87c7-78b0b20ee2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:21.564209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f5622-26b1-4b9d-87c7-78b0b20ee2b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:21.584731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:21.588223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f5622-26b1-4b9d-87c7-78b0b20ee2b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:21.602339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f5622-26b1-4b9d-87c7-78b0b20ee2b9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-643f5622-26b1-4b9d-87c7-78b0b20ee2b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:21.644431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:21.658988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:21.661897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:21.661897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:21.661897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:21.661897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 376/723] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:21.661897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900eb7b-cda7-404b-bd98-894062194546 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:21.661897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900eb7b-cda7-404b-bd98-894062194546 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:21.661897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900eb7b-cda7-404b-bd98-894062194546 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:21.661897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 377/724] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:21.661897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900eb7b-cda7-404b-bd98-894062194546 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:21.805968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:21.806645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777fb71-af50-417d-a8ab-0c1037fadd73 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:21.858135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900eb7b-cda7-404b-bd98-894062194546 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:21.893913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4568c1e-113f-435c-8293-41b2626dc30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:21.895964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4568c1e-113f-435c-8293-41b2626dc30d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:21.896455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4568c1e-113f-435c-8293-41b2626dc30d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:21.896966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4568c1e-113f-435c-8293-41b2626dc30d None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:21.899651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4568c1e-113f-435c-8293-41b2626dc30d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:21.900563 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4568c1e-113f-435c-8293-41b2626dc30d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:21.903266 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4568c1e-113f-435c-8293-41b2626dc30d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:21.904613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bd34a-6e20-4a76-a619-47ee0ea03eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:21.905398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bd34a-6e20-4a76-a619-47ee0ea03eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:21.905883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bd34a-6e20-4a76-a619-47ee0ea03eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:21.906311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bd34a-6e20-4a76-a619-47ee0ea03eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:21.907182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bd34a-6e20-4a76-a619-47ee0ea03eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:21.907565 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bd34a-6e20-4a76-a619-47ee0ea03eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:21.909188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bd34a-6e20-4a76-a619-47ee0ea03eb5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:21.918962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 348/725] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 21 16:09:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:21.922399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e914a55-8027-450f-9790-bab6025724d0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:21.923247 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e914a55-8027-450f-9790-bab6025724d0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:21.923722 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e914a55-8027-450f-9790-bab6025724d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:21.925404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 378/726] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:21.937762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bd34a-6e20-4a76-a619-47ee0ea03eb5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:21.985372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2e914a55-8027-450f-9790-bab6025724d0 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:21.988758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2e914a55-8027-450f-9790-bab6025724d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:22.158348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 349/727] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:09:22.178420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bd34a-6e20-4a76-a619-47ee0ea03eb5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:22.213167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:22.228552 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc303772-941a-4079-87c4-6cbb6bf9d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:22.229445 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc303772-941a-4079-87c4-6cbb6bf9d193 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:22.230011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc303772-941a-4079-87c4-6cbb6bf9d193 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:22.230501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc303772-941a-4079-87c4-6cbb6bf9d193 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:22.243904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc303772-941a-4079-87c4-6cbb6bf9d193 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:22.246573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc303772-941a-4079-87c4-6cbb6bf9d193 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fc303772-941a-4079-87c4-6cbb6bf9d193 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:22.270722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:22.271756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:22.272732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:22.272732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:22.272732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:22.272732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:22.272732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:22.272732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:22.272732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:22.272732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:22.272732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:09:22.272732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:22.273289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 379/728] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 21 16:09:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:22.280760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e914a55-8027-450f-9790-bab6025724d0 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:22.284733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:22.464562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e914a55-8027-450f-9790-bab6025724d0 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:22.511694 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e581af-eac6-4a5b-a19e-ad5c1a63c05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:22.512328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e581af-eac6-4a5b-a19e-ad5c1a63c05a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:22.512607 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e581af-eac6-4a5b-a19e-ad5c1a63c05a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:22.512914 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e581af-eac6-4a5b-a19e-ad5c1a63c05a None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:22.513661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e581af-eac6-4a5b-a19e-ad5c1a63c05a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:22.513963 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e581af-eac6-4a5b-a19e-ad5c1a63c05a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:22.515446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e581af-eac6-4a5b-a19e-ad5c1a63c05a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:22.537762 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 350/729] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 21 16:09:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:22.545939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc303772-941a-4079-87c4-6cbb6bf9d193 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:22.690831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc303772-941a-4079-87c4-6cbb6bf9d193 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:22.718778 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e581af-eac6-4a5b-a19e-ad5c1a63c05a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:22.767594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d833fa-7a0a-4210-9dcb-8f720461ca1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:22.769110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d833fa-7a0a-4210-9dcb-8f720461ca1c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:22.772199 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d833fa-7a0a-4210-9dcb-8f720461ca1c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:22.773032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d833fa-7a0a-4210-9dcb-8f720461ca1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:22.853631 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:22.922798 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:22.937894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d833fa-7a0a-4210-9dcb-8f720461ca1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:22.939768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d833fa-7a0a-4210-9dcb-8f720461ca1c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:22.959537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e581af-eac6-4a5b-a19e-ad5c1a63c05a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:23.032773 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5670a68-b0a5-477b-be32-3b4b35ea449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:23.033758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670a68-b0a5-477b-be32-3b4b35ea449e None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:23.034252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670a68-b0a5-477b-be32-3b4b35ea449e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:23.034728 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670a68-b0a5-477b-be32-3b4b35ea449e None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:23.035697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5670a68-b0a5-477b-be32-3b4b35ea449e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:23.040090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5670a68-b0a5-477b-be32-3b4b35ea449e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:23.065173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 351/730] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 21 16:09:22 2022] POST /identity/v3/services => generated 240 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:09:23.067726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c486a2-7e12-4199-8e61-0993e1ab2cfe None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:23.068547 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c486a2-7e12-4199-8e61-0993e1ab2cfe None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:23.069214 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c486a2-7e12-4199-8e61-0993e1ab2cfe None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:23.071764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 352/731] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:23.078731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c6471-2943-4e4d-9263-47055e7e7391 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:23.079414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c6471-2943-4e4d-9263-47055e7e7391 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:23.081357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c6471-2943-4e4d-9263-47055e7e7391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:23.096580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 380/732] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:09:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:09:23.105960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d833fa-7a0a-4210-9dcb-8f720461ca1c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:23.108826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a77c6471-2943-4e4d-9263-47055e7e7391 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:23.110717 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a77c6471-2943-4e4d-9263-47055e7e7391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:23.277832 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 353/733] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:23 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 16:09:23.344168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d833fa-7a0a-4210-9dcb-8f720461ca1c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:23.359557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:23.416785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d65902-7eb9-4fea-86c3-3c9a0235440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:23.417856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d65902-7eb9-4fea-86c3-3c9a0235440f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:23.418335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d65902-7eb9-4fea-86c3-3c9a0235440f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:23.418811 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d65902-7eb9-4fea-86c3-3c9a0235440f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:23.438220 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d65902-7eb9-4fea-86c3-3c9a0235440f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:23.441082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d65902-7eb9-4fea-86c3-3c9a0235440f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d8d65902-7eb9-4fea-86c3-3c9a0235440f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:23.469217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:23.470286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:23.471200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:23.471200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:23.471200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:23.471379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 381/734] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:23.477382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c6471-2943-4e4d-9263-47055e7e7391 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:23.576760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:23.632527 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d65902-7eb9-4fea-86c3-3c9a0235440f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:23.649727 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c6471-2943-4e4d-9263-47055e7e7391 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:23.710010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7130fdc-d2be-4867-81fc-672cbe0d9631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:23.710010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7130fdc-d2be-4867-81fc-672cbe0d9631 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:23.710010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7130fdc-d2be-4867-81fc-672cbe0d9631 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:23.710010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7130fdc-d2be-4867-81fc-672cbe0d9631 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:23.710720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7130fdc-d2be-4867-81fc-672cbe0d9631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:23.710720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7130fdc-d2be-4867-81fc-672cbe0d9631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:23.710720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7130fdc-d2be-4867-81fc-672cbe0d9631 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:23.724765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 354/735] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:23.727835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7130fdc-d2be-4867-81fc-672cbe0d9631 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:23.893627 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d65902-7eb9-4fea-86c3-3c9a0235440f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:23.961750 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14bafa-414d-4ccc-ae1a-372f0e9e6d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:23.962800 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14bafa-414d-4ccc-ae1a-372f0e9e6d72 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:23.963287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14bafa-414d-4ccc-ae1a-372f0e9e6d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:23.963721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14bafa-414d-4ccc-ae1a-372f0e9e6d72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:23.979762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:23.986107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14bafa-414d-4ccc-ae1a-372f0e9e6d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:23.987677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7130fdc-d2be-4867-81fc-672cbe0d9631 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-bf14bafa-414d-4ccc-ae1a-372f0e9e6d72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:23.997393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:23.998433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:23.999280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:23.999280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:23.999280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:23.999280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:23.999280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:23.999280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:23.999280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:23.999280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:23.999280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:23.999280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:23.999280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:09:23.999280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:24.000124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 382/736] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:09:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:24.007035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:24.011759 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14bafa-414d-4ccc-ae1a-372f0e9e6d72 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:24.066205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef4921-0bff-4b4c-8098-fcff0b6f52ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:24.067283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef4921-0bff-4b4c-8098-fcff0b6f52ef None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:24.067810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef4921-0bff-4b4c-8098-fcff0b6f52ef None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:24.068616 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef4921-0bff-4b4c-8098-fcff0b6f52ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:24.082549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef4921-0bff-4b4c-8098-fcff0b6f52ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:24.085187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef4921-0bff-4b4c-8098-fcff0b6f52ef None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-50ef4921-0bff-4b4c-8098-fcff0b6f52ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:24.108967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:24.109964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:24.110874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:24.110874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:24.110874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:24.110874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:24.110874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:24.110874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:24.110874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:24.110874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:24.113517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 355/737] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:24.121856 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef4921-0bff-4b4c-8098-fcff0b6f52ef None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:24.219801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14bafa-414d-4ccc-ae1a-372f0e9e6d72 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:24.268731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625b014-8aa9-4ae3-ae40-b41c168a87c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:24.269849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625b014-8aa9-4ae3-ae40-b41c168a87c8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:24.270331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625b014-8aa9-4ae3-ae40-b41c168a87c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:24.270842 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625b014-8aa9-4ae3-ae40-b41c168a87c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:24.271902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625b014-8aa9-4ae3-ae40-b41c168a87c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:24.272412 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625b014-8aa9-4ae3-ae40-b41c168a87c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:24.274179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625b014-8aa9-4ae3-ae40-b41c168a87c8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:24.274997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef4921-0bff-4b4c-8098-fcff0b6f52ef None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:24.289463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 383/738] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:09:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:24.293350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d824391-4935-43dc-823f-03cded86fb53 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:24.293350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d824391-4935-43dc-823f-03cded86fb53 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:24.293350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d824391-4935-43dc-823f-03cded86fb53 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:24.296784 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 384/739] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:24.298330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d824391-4935-43dc-823f-03cded86fb53 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:24.325546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55585898-8785-4be4-a80f-2a2cda248509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:24.326174 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55585898-8785-4be4-a80f-2a2cda248509 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:24.326453 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55585898-8785-4be4-a80f-2a2cda248509 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:24.326724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55585898-8785-4be4-a80f-2a2cda248509 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:24.327440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55585898-8785-4be4-a80f-2a2cda248509 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:24.327747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55585898-8785-4be4-a80f-2a2cda248509 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:24.329273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55585898-8785-4be4-a80f-2a2cda248509 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:24.348839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 356/740] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:24.350257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb53bf-788e-418c-a0aa-99267733727a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:24.350546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb53bf-788e-418c-a0aa-99267733727a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:24.350819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb53bf-788e-418c-a0aa-99267733727a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:24.371312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-50fb53bf-788e-418c-a0aa-99267733727a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:24.372523 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-50fb53bf-788e-418c-a0aa-99267733727a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:24.389922 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:24.398840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:24.450350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d824391-4935-43dc-823f-03cded86fb53 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:24.465294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 357/741] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:24 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:09:24.466246 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb53bf-788e-418c-a0aa-99267733727a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:24.495022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a15829-438e-4ff8-8f3a-9ed5ff526145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:24.496124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a15829-438e-4ff8-8f3a-9ed5ff526145 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:24.496628 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a15829-438e-4ff8-8f3a-9ed5ff526145 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:24.497147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a15829-438e-4ff8-8f3a-9ed5ff526145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:24.510648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a15829-438e-4ff8-8f3a-9ed5ff526145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:24.512446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a15829-438e-4ff8-8f3a-9ed5ff526145 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-18a15829-438e-4ff8-8f3a-9ed5ff526145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:24.530551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:24.531577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:24.532486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:24.532486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:24.532486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:24.539917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 385/742] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:24.542545 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a15829-438e-4ff8-8f3a-9ed5ff526145 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:24.655418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a15829-438e-4ff8-8f3a-9ed5ff526145 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:24.682081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:24.687703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb53bf-788e-418c-a0aa-99267733727a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:24.697707 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6b9aa-e129-4e5b-b06f-85e93a0078c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:24.701843 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6b9aa-e129-4e5b-b06f-85e93a0078c7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:24.702378 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6b9aa-e129-4e5b-b06f-85e93a0078c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:24.702890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6b9aa-e129-4e5b-b06f-85e93a0078c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:24.703769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6b9aa-e129-4e5b-b06f-85e93a0078c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:24.704340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6b9aa-e129-4e5b-b06f-85e93a0078c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:24.705950 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6b9aa-e129-4e5b-b06f-85e93a0078c7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:24.737182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 386/743] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:24.740005 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6b9aa-e129-4e5b-b06f-85e93a0078c7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:24.773321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56288241-a2d5-4221-b24a-c54e0c14d3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:24.773854 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56288241-a2d5-4221-b24a-c54e0c14d3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:24.774128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56288241-a2d5-4221-b24a-c54e0c14d3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:24.774435 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56288241-a2d5-4221-b24a-c54e0c14d3a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:24.775320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56288241-a2d5-4221-b24a-c54e0c14d3a1 None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=d7ff08c990dc41b4811f97fecb7c4c3a) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:24.775634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56288241-a2d5-4221-b24a-c54e0c14d3a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:24.777117 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56288241-a2d5-4221-b24a-c54e0c14d3a1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:24.790116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 358/744] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:09:24 2022] GET /identity/v3/role_assignments?user.id=d7ff08c990dc41b4811f97fecb7c4c3a&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=beec000223e041209205627bfa0dbed1 => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:24.860249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6b9aa-e129-4e5b-b06f-85e93a0078c7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:24.902676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b650922-511a-46f6-9fcf-29030ef5f974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:24.903720 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b650922-511a-46f6-9fcf-29030ef5f974 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:24.904208 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b650922-511a-46f6-9fcf-29030ef5f974 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:24.904713 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b650922-511a-46f6-9fcf-29030ef5f974 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:24.912565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56288241-a2d5-4221-b24a-c54e0c14d3a1 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:24.917691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b650922-511a-46f6-9fcf-29030ef5f974 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:24.923318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b650922-511a-46f6-9fcf-29030ef5f974 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8b650922-511a-46f6-9fcf-29030ef5f974 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:24.940987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:24.942050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:24.943091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:24.943091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:24.943091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:24.943091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:24.943091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:24.943091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:24.943091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:24.943091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:24.943091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 16:09:24.943091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:24.955895 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 387/745] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:09:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:24.959572 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:24.962448 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b650922-511a-46f6-9fcf-29030ef5f974 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:25.027177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:25.114086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56288241-a2d5-4221-b24a-c54e0c14d3a1 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:25.152342 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b650922-511a-46f6-9fcf-29030ef5f974 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:25.193814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425b9d1-4927-4b8e-ada0-0d10d1835987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:25.194060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b7e0f-db11-41e5-b0ca-e4ee6e36ad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:25.194433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425b9d1-4927-4b8e-ada0-0d10d1835987 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:25.194710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425b9d1-4927-4b8e-ada0-0d10d1835987 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:25.194983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425b9d1-4927-4b8e-ada0-0d10d1835987 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:25.195646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b7e0f-db11-41e5-b0ca-e4ee6e36ad05 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:25.195770 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425b9d1-4927-4b8e-ada0-0d10d1835987 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:25.196056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425b9d1-4927-4b8e-ada0-0d10d1835987 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:25.196441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b7e0f-db11-41e5-b0ca-e4ee6e36ad05 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:25.196932 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b7e0f-db11-41e5-b0ca-e4ee6e36ad05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:25.197557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425b9d1-4927-4b8e-ada0-0d10d1835987 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:25.218917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 388/746] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 21 16:09:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:25.224504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425b9d1-4927-4b8e-ada0-0d10d1835987 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:25.225764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b7e0f-db11-41e5-b0ca-e4ee6e36ad05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-692b7e0f-db11-41e5-b0ca-e4ee6e36ad05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:25.232172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:25.233434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:25.234485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:25.234485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:25.234485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:25.234485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:25.234485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:25.234485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:25.234485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:25.234485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:25.234485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:25.234485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:25.234485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:25.234485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:25.246406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 359/747] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:09:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:25.252532 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b7e0f-db11-41e5-b0ca-e4ee6e36ad05 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:25.331079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:25.343755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425b9d1-4927-4b8e-ada0-0d10d1835987 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:25.348073 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:25.379694 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b7e0f-db11-41e5-b0ca-e4ee6e36ad05 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:25.389513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55c253-1c85-431a-8187-4cd6ab120800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:25.390130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c253-1c85-431a-8187-4cd6ab120800 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:25.390408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c253-1c85-431a-8187-4cd6ab120800 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:25.390693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c253-1c85-431a-8187-4cd6ab120800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:25.424370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973a21-9d27-45bd-9f36-6daa0b3c7362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:25.425490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973a21-9d27-45bd-9f36-6daa0b3c7362 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:25.426261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973a21-9d27-45bd-9f36-6daa0b3c7362 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:25.427732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973a21-9d27-45bd-9f36-6daa0b3c7362 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:25.428634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e973a21-9d27-45bd-9f36-6daa0b3c7362 None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:25.429190 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e973a21-9d27-45bd-9f36-6daa0b3c7362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:25.431348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e973a21-9d27-45bd-9f36-6daa0b3c7362 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:25.454007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 360/748] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:09:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:25.454007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816933dc-2764-4dce-acc4-40c39d0a9df8 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:25.454007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816933dc-2764-4dce-acc4-40c39d0a9df8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:25.454007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816933dc-2764-4dce-acc4-40c39d0a9df8 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:25.454007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 361/749] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:25.455967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816933dc-2764-4dce-acc4-40c39d0a9df8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:25.484528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55c253-1c85-431a-8187-4cd6ab120800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:25.486912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55c253-1c85-431a-8187-4cd6ab120800 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:25.583428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816933dc-2764-4dce-acc4-40c39d0a9df8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:25.604301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:25.617993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 389/750] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:09:25 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 16:09:25.619677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6cb73-59b6-4b55-81e0-7aa55fb217cc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:25.620229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6cb73-59b6-4b55-81e0-7aa55fb217cc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:25.620680 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6cb73-59b6-4b55-81e0-7aa55fb217cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:25.628765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801f5ee-d225-400d-9581-07a88e6a0535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:25.629529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801f5ee-d225-400d-9581-07a88e6a0535 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:25.629882 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801f5ee-d225-400d-9581-07a88e6a0535 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:25.631030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801f5ee-d225-400d-9581-07a88e6a0535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:25.642445 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-20e6cb73-59b6-4b55-81e0-7aa55fb217cc None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:25.642765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801f5ee-d225-400d-9581-07a88e6a0535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:25.644064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-20e6cb73-59b6-4b55-81e0-7aa55fb217cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:25.644463 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801f5ee-d225-400d-9581-07a88e6a0535 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:25.646751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-c801f5ee-d225-400d-9581-07a88e6a0535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:25.666181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:25.667355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:25.668256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:25.668256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:25.668256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:25.672767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 362/751] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:25.673773 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801f5ee-d225-400d-9581-07a88e6a0535 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:25.734197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 390/752] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:25 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 16:09:25.735386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6cb73-59b6-4b55-81e0-7aa55fb217cc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:25.787707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801f5ee-d225-400d-9581-07a88e6a0535 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:25.869285 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a355738-2554-46db-842a-21343bcdc825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:25.869823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a355738-2554-46db-842a-21343bcdc825 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:25.870148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a355738-2554-46db-842a-21343bcdc825 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:25.870418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a355738-2554-46db-842a-21343bcdc825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:25.902392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a355738-2554-46db-842a-21343bcdc825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:25.905171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a355738-2554-46db-842a-21343bcdc825 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:25.908102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6cb73-59b6-4b55-81e0-7aa55fb217cc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:25.946564 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da04f14-b016-4635-becf-2b09dce2bbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:25.947223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da04f14-b016-4635-becf-2b09dce2bbac None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:25.948143 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da04f14-b016-4635-becf-2b09dce2bbac None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:25.948484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da04f14-b016-4635-becf-2b09dce2bbac None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:25.949207 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da04f14-b016-4635-becf-2b09dce2bbac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:25.949522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da04f14-b016-4635-becf-2b09dce2bbac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:25.949999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:25.953668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da04f14-b016-4635-becf-2b09dce2bbac None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:25.967810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 391/753] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-3a355738-2554-46db-842a-21343bcdc825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:25.971682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:25.972745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:25.973650 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:25.973650 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:25.973650 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:25.973836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da04f14-b016-4635-becf-2b09dce2bbac None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:25.982377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 363/754] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:25.990372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a355738-2554-46db-842a-21343bcdc825 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:26.087409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da04f14-b016-4635-becf-2b09dce2bbac None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:26.097638 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:26.131029 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73454f-2a82-4515-976a-0c4982d78516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:26.131830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73454f-2a82-4515-976a-0c4982d78516 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:26.132244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73454f-2a82-4515-976a-0c4982d78516 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:26.132678 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73454f-2a82-4515-976a-0c4982d78516 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:26.143496 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73454f-2a82-4515-976a-0c4982d78516 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:26.145172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73454f-2a82-4515-976a-0c4982d78516 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-af73454f-2a82-4515-976a-0c4982d78516 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:26.160165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:26.161476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:26.162484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:26.162484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:26.162484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:26.162484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:26.162484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:26.162484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:26.162484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:26.162484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:26.162484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 16:09:26.162484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:26.163022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 392/755] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 21 16:09:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:26.166917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a355738-2554-46db-842a-21343bcdc825 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:26.168363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73454f-2a82-4515-976a-0c4982d78516 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:26.206404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ebce4-6237-4460-8aa9-2d1142a9b03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:26.207434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ebce4-6237-4460-8aa9-2d1142a9b03c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:26.207894 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ebce4-6237-4460-8aa9-2d1142a9b03c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:26.208371 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ebce4-6237-4460-8aa9-2d1142a9b03c None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:26.209361 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ebce4-6237-4460-8aa9-2d1142a9b03c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:26.210328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ebce4-6237-4460-8aa9-2d1142a9b03c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:26.212067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ebce4-6237-4460-8aa9-2d1142a9b03c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:26.225633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:26.232188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 364/756] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:26.233476 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ebce4-6237-4460-8aa9-2d1142a9b03c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:26.292289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73454f-2a82-4515-976a-0c4982d78516 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:26.328242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97902d2-e2cc-42c2-b93a-c922919bee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:26.328873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97902d2-e2cc-42c2-b93a-c922919bee37 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:26.329136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97902d2-e2cc-42c2-b93a-c922919bee37 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:26.329406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97902d2-e2cc-42c2-b93a-c922919bee37 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:26.330060 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97902d2-e2cc-42c2-b93a-c922919bee37 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:26.331426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97902d2-e2cc-42c2-b93a-c922919bee37 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:26.353241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 393/757] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 21 16:09:26 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:09:26.360839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ebce4-6237-4460-8aa9-2d1142a9b03c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:26.362172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97902d2-e2cc-42c2-b93a-c922919bee37 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:26.365596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:26.422403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e06c0-5827-4ca4-9240-2c013acf5b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:26.424479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e06c0-5827-4ca4-9240-2c013acf5b71 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:26.425017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e06c0-5827-4ca4-9240-2c013acf5b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:26.425682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e06c0-5827-4ca4-9240-2c013acf5b71 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:26.427992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e06c0-5827-4ca4-9240-2c013acf5b71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:26.428557 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e06c0-5827-4ca4-9240-2c013acf5b71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:26.430322 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e06c0-5827-4ca4-9240-2c013acf5b71 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:26.470679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 365/758] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 21 16:09:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:26.472896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fe4b-15d1-4ced-a3aa-1f0368e696fe None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:26.473366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fe4b-15d1-4ced-a3aa-1f0368e696fe None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:26.473840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fe4b-15d1-4ced-a3aa-1f0368e696fe None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:26.481238 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 366/759] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:26.482839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953fe4b-15d1-4ced-a3aa-1f0368e696fe None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:26.538085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97902d2-e2cc-42c2-b93a-c922919bee37 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:26.541271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:26.615980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540292e2-ca3b-43c3-94a5-8e22dea9a714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:26.617659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540292e2-ca3b-43c3-94a5-8e22dea9a714 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:26.618155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540292e2-ca3b-43c3-94a5-8e22dea9a714 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:26.618626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540292e2-ca3b-43c3-94a5-8e22dea9a714 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:26.632338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540292e2-ca3b-43c3-94a5-8e22dea9a714 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:26.635771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540292e2-ca3b-43c3-94a5-8e22dea9a714 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:26.644293 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953fe4b-15d1-4ced-a3aa-1f0368e696fe None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-540292e2-ca3b-43c3-94a5-8e22dea9a714 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:26.659416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:26.660385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:26.661370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:26.661370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:26.661370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:26.661370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:26.661370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:26.661370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:26.661370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:26.661370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:26.661817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 394/760] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:26.664503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e36fe5-4eb9-4714-a028-51a36b2c6364 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:26.668734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e36fe5-4eb9-4714-a028-51a36b2c6364 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:26.668734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e36fe5-4eb9-4714-a028-51a36b2c6364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:26.690136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-15e36fe5-4eb9-4714-a028-51a36b2c6364 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:26.691719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-15e36fe5-4eb9-4714-a028-51a36b2c6364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:26.698489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21d549-35fa-432e-bfa8-81022533a1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:26.699137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21d549-35fa-432e-bfa8-81022533a1ae None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:26.699420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21d549-35fa-432e-bfa8-81022533a1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:26.699691 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21d549-35fa-432e-bfa8-81022533a1ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:26.713864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21d549-35fa-432e-bfa8-81022533a1ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:26.716160 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21d549-35fa-432e-bfa8-81022533a1ae None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-4f21d549-35fa-432e-bfa8-81022533a1ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:26.736555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:26.737626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:26.739012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:26.739012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:26.739012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:26.739012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 367/761] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:26.739012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21d549-35fa-432e-bfa8-81022533a1ae None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:26.764600 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:26.779889 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 395/762] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:26.781219 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e36fe5-4eb9-4714-a028-51a36b2c6364 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:26.873718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21d549-35fa-432e-bfa8-81022533a1ae None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:26.915729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a31441-2215-4ead-b7fa-25fe9af2489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:26.916378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a31441-2215-4ead-b7fa-25fe9af2489b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:26.916658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a31441-2215-4ead-b7fa-25fe9af2489b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:26.916970 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a31441-2215-4ead-b7fa-25fe9af2489b None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:26.918242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a31441-2215-4ead-b7fa-25fe9af2489b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:26.918559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a31441-2215-4ead-b7fa-25fe9af2489b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:26.920206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a31441-2215-4ead-b7fa-25fe9af2489b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:26.935191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 368/763] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:26.946916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a31441-2215-4ead-b7fa-25fe9af2489b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:27.005456 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:27.029116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e36fe5-4eb9-4714-a028-51a36b2c6364 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:27.048317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:27.085408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bf7e3-fa2e-4f6a-8d3e-d16ef9f18bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:27.086084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bf7e3-fa2e-4f6a-8d3e-d16ef9f18bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:27.086367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bf7e3-fa2e-4f6a-8d3e-d16ef9f18bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:27.086640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bf7e3-fa2e-4f6a-8d3e-d16ef9f18bc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:27.087309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bf7e3-fa2e-4f6a-8d3e-d16ef9f18bc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:27.087616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bf7e3-fa2e-4f6a-8d3e-d16ef9f18bc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:27.089081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bf7e3-fa2e-4f6a-8d3e-d16ef9f18bc6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:27.120036 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 396/764] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:27.127776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bf7e3-fa2e-4f6a-8d3e-d16ef9f18bc6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:27.135569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a31441-2215-4ead-b7fa-25fe9af2489b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:27.206571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aae6fb-e512-4cb1-b469-73812c962780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:27.207179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aae6fb-e512-4cb1-b469-73812c962780 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:27.207456 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aae6fb-e512-4cb1-b469-73812c962780 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:27.207731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aae6fb-e512-4cb1-b469-73812c962780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:27.208602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aae6fb-e512-4cb1-b469-73812c962780 None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=0b28aaefcb154b228987362921f6476b) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:27.208940 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aae6fb-e512-4cb1-b469-73812c962780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:27.210418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aae6fb-e512-4cb1-b469-73812c962780 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:27.222394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 369/765] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:09:26 2022] GET /identity/v3/role_assignments?user.id=0b28aaefcb154b228987362921f6476b&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=beec000223e041209205627bfa0dbed1 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:27.309283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aae6fb-e512-4cb1-b469-73812c962780 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:27.361746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bf7e3-fa2e-4f6a-8d3e-d16ef9f18bc6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:27.437371 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7b8b3-15c4-423c-9ecb-ad4ef3461d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:27.438032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7b8b3-15c4-423c-9ecb-ad4ef3461d28 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:27.438309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7b8b3-15c4-423c-9ecb-ad4ef3461d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:27.438578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7b8b3-15c4-423c-9ecb-ad4ef3461d28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:27.456052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7b8b3-15c4-423c-9ecb-ad4ef3461d28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:27.461728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7b8b3-15c4-423c-9ecb-ad4ef3461d28 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:27.476110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aae6fb-e512-4cb1-b469-73812c962780 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-97c7b8b3-15c4-423c-9ecb-ad4ef3461d28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:27.478392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:27.479395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:27.480322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:27.480322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:27.480322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:27.480322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:27.480322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:27.480322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:27.480322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:27.480322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:27.489338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 397/766] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:27.489338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589736e-12da-4ce8-80a7-e7d4ebc08cfb None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:27.489338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589736e-12da-4ce8-80a7-e7d4ebc08cfb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:27.489338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589736e-12da-4ce8-80a7-e7d4ebc08cfb None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:27.492457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 398/767] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:27.493647 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589736e-12da-4ce8-80a7-e7d4ebc08cfb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:27.526629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:27.549865 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef0750-92db-437f-abbb-f9cdb48a08cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:27.551081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0750-92db-437f-abbb-f9cdb48a08cc None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:27.551516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0750-92db-437f-abbb-f9cdb48a08cc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:27.552500 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0750-92db-437f-abbb-f9cdb48a08cc None admin] PATH_INFO: `/v3/services/network` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:27.553322 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef0750-92db-437f-abbb-f9cdb48a08cc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:27.555257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef0750-92db-437f-abbb-f9cdb48a08cc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:27.559730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-49ef0750-92db-437f-abbb-f9cdb48a08cc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:27.569404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:27.570668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:27.571643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:27.571643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:27.571643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:27.571643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:27.571643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:27.571643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:27.571643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:27.571643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:27.571643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:27.571643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:27.571643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:27.571643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:27.571643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 16:09:27.571643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:27.574284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 370/768] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:27 2022] GET /identity/v3/services/network => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:27.575813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460a0a-c330-4cf8-b556-98b7b27f4a25 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:27.576246 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460a0a-c330-4cf8-b556-98b7b27f4a25 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:27.576656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460a0a-c330-4cf8-b556-98b7b27f4a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:27.599067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c6460a0a-c330-4cf8-b556-98b7b27f4a25 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:27.603239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c6460a0a-c330-4cf8-b556-98b7b27f4a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:27.690981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589736e-12da-4ce8-80a7-e7d4ebc08cfb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:27.735939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 371/769] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:27.735939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6460a0a-c330-4cf8-b556-98b7b27f4a25 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:27.747574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f7af4-450a-4813-853a-913139cb179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:27.748492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f7af4-450a-4813-853a-913139cb179d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:27.748945 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f7af4-450a-4813-853a-913139cb179d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:27.749366 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f7af4-450a-4813-853a-913139cb179d None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:27.750918 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f7af4-450a-4813-853a-913139cb179d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:27.751405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f7af4-450a-4813-853a-913139cb179d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:27.753513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f7af4-450a-4813-853a-913139cb179d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:27.780260 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 399/770] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:27.787605 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f7af4-450a-4813-853a-913139cb179d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:27.949386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:27.950359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6460a0a-c330-4cf8-b556-98b7b27f4a25 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:27.994047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:28.002143 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f7af4-450a-4813-853a-913139cb179d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:28.002489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1047c2-0cec-479e-a1fb-92b081ea3550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:28.003039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1047c2-0cec-479e-a1fb-92b081ea3550 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:28.003319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1047c2-0cec-479e-a1fb-92b081ea3550 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:28.003588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1047c2-0cec-479e-a1fb-92b081ea3550 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:28.004231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1047c2-0cec-479e-a1fb-92b081ea3550 None admin] RBAC: Adding query filter params (name=network) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:28.004531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1047c2-0cec-479e-a1fb-92b081ea3550 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:28.006073 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1047c2-0cec-479e-a1fb-92b081ea3550 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:28.021895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 372/771] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 21 16:09:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:28.027844 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1047c2-0cec-479e-a1fb-92b081ea3550 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:28.049561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dc2f7-0c0b-40a6-a99d-27bc9ab5e943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:28.050995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dc2f7-0c0b-40a6-a99d-27bc9ab5e943 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:28.051481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dc2f7-0c0b-40a6-a99d-27bc9ab5e943 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:28.051954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dc2f7-0c0b-40a6-a99d-27bc9ab5e943 None admin] PATH_INFO: `/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/5e20281883414eed9d644e0eaab2ac49/roles/8e7b3a48a50745adad97c6205aafc562` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:28.070940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58dc2f7-0c0b-40a6-a99d-27bc9ab5e943 None admin] RBAC: Authorizing `identity:create_grant(project_id=78142a67f69a4ba58113cc7c8dc269b1, user_id=5e20281883414eed9d644e0eaab2ac49, role_id=8e7b3a48a50745adad97c6205aafc562)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:28.072849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58dc2f7-0c0b-40a6-a99d-27bc9ab5e943 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:28.094977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 400/772] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:09:27 2022] PUT /identity/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/5e20281883414eed9d644e0eaab2ac49/roles/8e7b3a48a50745adad97c6205aafc562 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:09:28.096094 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dc2f7-0c0b-40a6-a99d-27bc9ab5e943 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:28.253388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dc2f7-0c0b-40a6-a99d-27bc9ab5e943 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:28.283394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:28.305767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151a2c5-9b75-4570-84fe-ab82159040e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:28.306446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151a2c5-9b75-4570-84fe-ab82159040e8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:28.306732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151a2c5-9b75-4570-84fe-ab82159040e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:28.307011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151a2c5-9b75-4570-84fe-ab82159040e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:28.331474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1047c2-0cec-479e-a1fb-92b081ea3550 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:28.337144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151a2c5-9b75-4570-84fe-ab82159040e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5151a2c5-9b75-4570-84fe-ab82159040e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:28.344070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:28.345092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:28.345978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:28.345978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:28.345978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:28.345978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:28.345978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:28.345978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:28.345978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:28.345978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:28.345978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:28.345978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:28.345978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:09:28.345978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:28.348905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 401/773] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:09:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:28.356070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151a2c5-9b75-4570-84fe-ab82159040e8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:28.376568 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bb6c1-070d-4352-9142-74436d94d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:28.376990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bb6c1-070d-4352-9142-74436d94d224 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:28.377267 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bb6c1-070d-4352-9142-74436d94d224 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:28.377539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bb6c1-070d-4352-9142-74436d94d224 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:28.378192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bb6c1-070d-4352-9142-74436d94d224 None admin] RBAC: Adding query filter params (type=network) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:28.378493 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bb6c1-070d-4352-9142-74436d94d224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:28.379969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bb6c1-070d-4352-9142-74436d94d224 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:28.389515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 373/774] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 21 16:09:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:28.400021 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bb6c1-070d-4352-9142-74436d94d224 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:28.498556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151a2c5-9b75-4570-84fe-ab82159040e8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:28.511320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:28.581760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7209d-9312-423b-b188-c99b12c4299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:28.582751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7209d-9312-423b-b188-c99b12c4299d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:28.584057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7209d-9312-423b-b188-c99b12c4299d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:28.584546 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7209d-9312-423b-b188-c99b12c4299d None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:28.585493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7209d-9312-423b-b188-c99b12c4299d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:28.587498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7209d-9312-423b-b188-c99b12c4299d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:28.589200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7209d-9312-423b-b188-c99b12c4299d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:28.605203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bb6c1-070d-4352-9142-74436d94d224 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:28.607401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 402/775] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:09:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:28.613444 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7209d-9312-423b-b188-c99b12c4299d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:28.691531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdc223-8caf-4eb5-9140-cf077bfcedda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:28.692173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdc223-8caf-4eb5-9140-cf077bfcedda None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:28.692455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdc223-8caf-4eb5-9140-cf077bfcedda None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:28.692747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdc223-8caf-4eb5-9140-cf077bfcedda None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:28.693533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdc223-8caf-4eb5-9140-cf077bfcedda None admin] RBAC: Adding query filter params (interface=public, service_id=8b6a1add83bc45c5b8a80102552f0a51, region_id=RegionOne) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:28.693840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdc223-8caf-4eb5-9140-cf077bfcedda None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:28.698770 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdc223-8caf-4eb5-9140-cf077bfcedda None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:28.716937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 374/776] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 21 16:09:28 2022] GET /identity/v3/endpoints?service_id=8b6a1add83bc45c5b8a80102552f0a51&interface=public®ion_id=RegionOne => generated 194 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:28.723255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdc223-8caf-4eb5-9140-cf077bfcedda None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:28.911763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:28.956166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdc223-8caf-4eb5-9140-cf077bfcedda None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:28.987340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7209d-9312-423b-b188-c99b12c4299d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:29.026571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc86c-7627-4268-b0b3-27214d35818e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:29.027413 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc86c-7627-4268-b0b3-27214d35818e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:29.027691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc86c-7627-4268-b0b3-27214d35818e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:29.027956 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc86c-7627-4268-b0b3-27214d35818e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:29.029671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:29.042407 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cc86c-7627-4268-b0b3-27214d35818e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:29.044102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cc86c-7627-4268-b0b3-27214d35818e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d86cc86c-7627-4268-b0b3-27214d35818e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:29.062679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:29.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:29.065092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:29.065092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:29.065092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:29.065092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 403/777] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:29.073502 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc86c-7627-4268-b0b3-27214d35818e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:29.074538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf7403-de25-4eaa-8af8-e2e163c21331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:29.076021 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf7403-de25-4eaa-8af8-e2e163c21331 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:29.079146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf7403-de25-4eaa-8af8-e2e163c21331 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:29.079754 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf7403-de25-4eaa-8af8-e2e163c21331 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:29.080715 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf7403-de25-4eaa-8af8-e2e163c21331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:29.083559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf7403-de25-4eaa-8af8-e2e163c21331 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:29.098238 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 375/778] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 21 16:09:28 2022] GET /identity/v3/services => generated 772 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:29.267026 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:29.278763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc86c-7627-4268-b0b3-27214d35818e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:29.359904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f303c54-933c-46e3-ab7c-77c6a1b8d6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:29.361053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303c54-933c-46e3-ab7c-77c6a1b8d6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:29.361538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303c54-933c-46e3-ab7c-77c6a1b8d6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:29.362009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303c54-933c-46e3-ab7c-77c6a1b8d6f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:29.363192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f303c54-933c-46e3-ab7c-77c6a1b8d6f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:29.363725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f303c54-933c-46e3-ab7c-77c6a1b8d6f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:29.366514 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f303c54-933c-46e3-ab7c-77c6a1b8d6f2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:29.372571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e1ce3-8c70-43a0-81ac-9aa16e772808 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:29.373685 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e1ce3-8c70-43a0-81ac-9aa16e772808 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:29.374372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e1ce3-8c70-43a0-81ac-9aa16e772808 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:29.377138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 376/779] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:29.386136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f761-da96-4313-ad7f-9316ac374b7e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:29.386703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f761-da96-4313-ad7f-9316ac374b7e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:29.387195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f761-da96-4313-ad7f-9316ac374b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:29.391890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 404/780] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:29.401635 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f303c54-933c-46e3-ab7c-77c6a1b8d6f2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:29.429877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d882f761-da96-4313-ad7f-9316ac374b7e None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:29.433592 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d882f761-da96-4313-ad7f-9316ac374b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:29.537946 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f303c54-933c-46e3-ab7c-77c6a1b8d6f2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:29.585579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee9a2a-71fe-4e70-b828-5cba6674bd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:29.587212 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9a2a-71fe-4e70-b828-5cba6674bd22 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:29.587707 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9a2a-71fe-4e70-b828-5cba6674bd22 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:29.588191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9a2a-71fe-4e70-b828-5cba6674bd22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:29.618043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 377/781] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:29.619901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee9a2a-71fe-4e70-b828-5cba6674bd22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:29.622568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee9a2a-71fe-4e70-b828-5cba6674bd22 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b2ee9a2a-71fe-4e70-b828-5cba6674bd22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:29.654206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:29.655213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:29.656158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:29.656158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:29.656158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:29.656158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:29.656158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:29.656158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:29.656158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:29.656158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:29.656158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:09:29.656158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:29.657201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 405/782] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 21 16:09:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:29.667156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882f761-da96-4313-ad7f-9316ac374b7e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:29.917186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882f761-da96-4313-ad7f-9316ac374b7e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:29.949411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:29.981774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fe94b-12b1-483e-83f7-bc2dc9e4b8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:29.982814 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fe94b-12b1-483e-83f7-bc2dc9e4b8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:29.983310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fe94b-12b1-483e-83f7-bc2dc9e4b8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:29.983805 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fe94b-12b1-483e-83f7-bc2dc9e4b8c7 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:29.985175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fe94b-12b1-483e-83f7-bc2dc9e4b8c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:29.985693 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fe94b-12b1-483e-83f7-bc2dc9e4b8c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:29.988434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fe94b-12b1-483e-83f7-bc2dc9e4b8c7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:30.029337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 378/783] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 21 16:09:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:30.037565 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee9a2a-71fe-4e70-b828-5cba6674bd22 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:30.082881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:30.280191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee9a2a-71fe-4e70-b828-5cba6674bd22 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:30.360826 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40258323-7d0e-42bc-9748-69de68bcb211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:30.362254 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258323-7d0e-42bc-9748-69de68bcb211 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:30.362732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258323-7d0e-42bc-9748-69de68bcb211 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:30.363435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258323-7d0e-42bc-9748-69de68bcb211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:30.381704 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fe94b-12b1-483e-83f7-bc2dc9e4b8c7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:30.400140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40258323-7d0e-42bc-9748-69de68bcb211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:30.402924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40258323-7d0e-42bc-9748-69de68bcb211 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-40258323-7d0e-42bc-9748-69de68bcb211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:30.446102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:30.447314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:30.448312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:30.448312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:30.448312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:30.448980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 406/784] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:30.464168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40258323-7d0e-42bc-9748-69de68bcb211 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:30.588106 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fe94b-12b1-483e-83f7-bc2dc9e4b8c7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:30.664776 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a000a-cf2f-49c5-a714-560a0565dbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:30.666224 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a000a-cf2f-49c5-a714-560a0565dbab None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:30.666711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a000a-cf2f-49c5-a714-560a0565dbab None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:30.667148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a000a-cf2f-49c5-a714-560a0565dbab None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:30.668234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a000a-cf2f-49c5-a714-560a0565dbab None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:30.670889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a000a-cf2f-49c5-a714-560a0565dbab None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:30.676300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-1c2a000a-cf2f-49c5-a714-560a0565dbab None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:30.696506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:30.700328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:30.703686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 379/785] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Sep 21 16:09:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:30.712887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a000a-cf2f-49c5-a714-560a0565dbab None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:30.800331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40258323-7d0e-42bc-9748-69de68bcb211 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:30.825234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:30.862171 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062db88-fbc4-4a6c-aa08-83182ea81363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:30.863112 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062db88-fbc4-4a6c-aa08-83182ea81363 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:30.863609 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062db88-fbc4-4a6c-aa08-83182ea81363 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:30.864093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062db88-fbc4-4a6c-aa08-83182ea81363 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:30.865335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062db88-fbc4-4a6c-aa08-83182ea81363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:30.865850 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062db88-fbc4-4a6c-aa08-83182ea81363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:30.868327 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062db88-fbc4-4a6c-aa08-83182ea81363 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:30.889462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 407/786] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:30.889462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb6432-75e4-4c40-ba1a-47fd900f75c2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:30.889462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb6432-75e4-4c40-ba1a-47fd900f75c2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:30.889462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb6432-75e4-4c40-ba1a-47fd900f75c2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:30.890141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 408/787] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:30.896377 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb6432-75e4-4c40-ba1a-47fd900f75c2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:30.958354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a000a-cf2f-49c5-a714-560a0565dbab None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:31.008452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab923ea8-705d-474f-a663-552ae23d76d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:31.009435 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab923ea8-705d-474f-a663-552ae23d76d6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:31.009910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab923ea8-705d-474f-a663-552ae23d76d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:31.010392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab923ea8-705d-474f-a663-552ae23d76d6 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:31.011149 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab923ea8-705d-474f-a663-552ae23d76d6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:31.011724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab923ea8-705d-474f-a663-552ae23d76d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:31.013893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab923ea8-705d-474f-a663-552ae23d76d6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:31.021476 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 380/788] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 21 16:09:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:31.029712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c435ddf-aab2-4edf-8d1e-baed840a0f7b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:31.030082 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c435ddf-aab2-4edf-8d1e-baed840a0f7b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:31.030506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c435ddf-aab2-4edf-8d1e-baed840a0f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:31.054501 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9c435ddf-aab2-4edf-8d1e-baed840a0f7b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:31.056279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9c435ddf-aab2-4edf-8d1e-baed840a0f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:31.091274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb6432-75e4-4c40-ba1a-47fd900f75c2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:31.148721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 381/789] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:31.148721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c435ddf-aab2-4edf-8d1e-baed840a0f7b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:31.157693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:31.194065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe37d15-dbc9-4d74-9755-10a7b9580429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:31.194739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe37d15-dbc9-4d74-9755-10a7b9580429 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:31.195603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe37d15-dbc9-4d74-9755-10a7b9580429 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:31.195859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe37d15-dbc9-4d74-9755-10a7b9580429 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:31.201666 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:31.217555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe37d15-dbc9-4d74-9755-10a7b9580429 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:31.219203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe37d15-dbc9-4d74-9755-10a7b9580429 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2fe37d15-dbc9-4d74-9755-10a7b9580429 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:31.233808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:31.235568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:31.237418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:31.237418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:31.237418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:31.237418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:31.237418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:31.237418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:31.237418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:31.237418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:31.237418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 409/790] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:31.250253 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe37d15-dbc9-4d74-9755-10a7b9580429 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:31.331543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c435ddf-aab2-4edf-8d1e-baed840a0f7b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:31.392555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d30b3e-adc7-47b9-9624-1b7de9141882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:31.393558 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d30b3e-adc7-47b9-9624-1b7de9141882 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:31.394029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d30b3e-adc7-47b9-9624-1b7de9141882 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:31.394494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d30b3e-adc7-47b9-9624-1b7de9141882 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:31.395556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d30b3e-adc7-47b9-9624-1b7de9141882 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:31.396072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d30b3e-adc7-47b9-9624-1b7de9141882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:31.398534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d30b3e-adc7-47b9-9624-1b7de9141882 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:31.407419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 382/791] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 21 16:09:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:31.409521 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd057af-7ebc-41ea-a63d-39734daddfba None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:31.410254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd057af-7ebc-41ea-a63d-39734daddfba None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:31.410506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd057af-7ebc-41ea-a63d-39734daddfba None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:31.413572 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 383/792] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:31.414947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd057af-7ebc-41ea-a63d-39734daddfba None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:31.503709 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe37d15-dbc9-4d74-9755-10a7b9580429 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:31.572200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131573e5-2d04-439e-9dcf-a74d00cc6962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:31.573933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131573e5-2d04-439e-9dcf-a74d00cc6962 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:31.574380 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131573e5-2d04-439e-9dcf-a74d00cc6962 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:31.574826 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131573e5-2d04-439e-9dcf-a74d00cc6962 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:31.575994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131573e5-2d04-439e-9dcf-a74d00cc6962 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:31.576483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131573e5-2d04-439e-9dcf-a74d00cc6962 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:31.579118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131573e5-2d04-439e-9dcf-a74d00cc6962 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:31.608053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:31.608460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 410/793] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:31.610506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaba8b-812b-4975-83fa-9c6b3723be94 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:31.610964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaba8b-812b-4975-83fa-9c6b3723be94 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:31.611496 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaba8b-812b-4975-83fa-9c6b3723be94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:31.620396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd057af-7ebc-41ea-a63d-39734daddfba None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:31.638838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6ebaba8b-812b-4975-83fa-9c6b3723be94 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:31.640714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6ebaba8b-812b-4975-83fa-9c6b3723be94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:31.679138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1544-2d13-4d86-8673-8523fc77f8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:31.680578 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1544-2d13-4d86-8673-8523fc77f8ab None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:31.681062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1544-2d13-4d86-8673-8523fc77f8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:31.681500 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1544-2d13-4d86-8673-8523fc77f8ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:31.682532 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c1544-2d13-4d86-8673-8523fc77f8ab None admin] RBAC: Adding query filter params (interface=public, service_id=b457241b24434134a972c452fde5cdac, region_id=RegionOne) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:31.682893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c1544-2d13-4d86-8673-8523fc77f8ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:31.685222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c1544-2d13-4d86-8673-8523fc77f8ab None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:31.698324 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 384/794] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 21 16:09:31 2022] GET /identity/v3/endpoints?service_id=b457241b24434134a972c452fde5cdac&interface=public®ion_id=RegionOne => generated 194 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:31.698324 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1544-2d13-4d86-8673-8523fc77f8ab None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:31.727352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:31.768883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 411/795] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:31.768883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaba8b-812b-4975-83fa-9c6b3723be94 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:31.867687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1544-2d13-4d86-8673-8523fc77f8ab None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:31.899826 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaba8b-812b-4975-83fa-9c6b3723be94 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:31.915936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7c76f-4e4c-4ad1-b27a-239e44c65b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:31.917201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7c76f-4e4c-4ad1-b27a-239e44c65b42 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:31.918007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7c76f-4e4c-4ad1-b27a-239e44c65b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:31.918527 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7c76f-4e4c-4ad1-b27a-239e44c65b42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:31.932835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7c76f-4e4c-4ad1-b27a-239e44c65b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-22c7c76f-4e4c-4ad1-b27a-239e44c65b42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:31.939868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:31.940910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:31.941761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:31.941761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:31.941761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:31.941761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:31.941761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:31.941761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:31.941761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:31.941761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:31.941761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:31.941761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:31.941761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:09:31.941761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:31.942424 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 385/796] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:09:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:31.943379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7c76f-4e4c-4ad1-b27a-239e44c65b42 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:31.955561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21ccb0-6cc1-485e-b1d2-4e1c0d44ae73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:31.955561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21ccb0-6cc1-485e-b1d2-4e1c0d44ae73 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:31.955561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21ccb0-6cc1-485e-b1d2-4e1c0d44ae73 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:31.955561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21ccb0-6cc1-485e-b1d2-4e1c0d44ae73 None admin] PATH_INFO: `/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/d7ff08c990dc41b4811f97fecb7c4c3a/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:31.956027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21ccb0-6cc1-485e-b1d2-4e1c0d44ae73 None admin] RBAC: Authorizing `identity:create_grant(project_id=78142a67f69a4ba58113cc7c8dc269b1, user_id=d7ff08c990dc41b4811f97fecb7c4c3a, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:31.956027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21ccb0-6cc1-485e-b1d2-4e1c0d44ae73 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:31.975255 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 412/797] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:09:31 2022] PUT /identity/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/d7ff08c990dc41b4811f97fecb7c4c3a/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:09:31.975255 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21ccb0-6cc1-485e-b1d2-4e1c0d44ae73 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:31.978012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:32.038367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:32.140366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7c76f-4e4c-4ad1-b27a-239e44c65b42 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:32.141709 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21ccb0-6cc1-485e-b1d2-4e1c0d44ae73 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:32.189574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635923a-5cea-4872-96b0-53bb05d31664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:32.190083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635923a-5cea-4872-96b0-53bb05d31664 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:32.190359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635923a-5cea-4872-96b0-53bb05d31664 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:32.190627 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635923a-5cea-4872-96b0-53bb05d31664 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:32.191256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635923a-5cea-4872-96b0-53bb05d31664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:32.192792 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635923a-5cea-4872-96b0-53bb05d31664 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:32.199619 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 386/798] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 21 16:09:31 2022] GET /identity/v3/services => generated 772 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:32.200886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635923a-5cea-4872-96b0-53bb05d31664 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:32.209689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8bbe2-1406-4505-8313-7834a36d2848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:32.210365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8bbe2-1406-4505-8313-7834a36d2848 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:32.211206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8bbe2-1406-4505-8313-7834a36d2848 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:32.211481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8bbe2-1406-4505-8313-7834a36d2848 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:32.212165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8bbe2-1406-4505-8313-7834a36d2848 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:32.212467 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8bbe2-1406-4505-8313-7834a36d2848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:32.213934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8bbe2-1406-4505-8313-7834a36d2848 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:32.223984 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 413/799] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:32.236214 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8bbe2-1406-4505-8313-7834a36d2848 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:32.345598 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:32.351946 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:32.355516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8bbe2-1406-4505-8313-7834a36d2848 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:32.368587 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635923a-5cea-4872-96b0-53bb05d31664 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:32.396324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cabc5-b964-4638-890a-fe5f2cd11f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:32.397129 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cabc5-b964-4638-890a-fe5f2cd11f0d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:32.397474 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cabc5-b964-4638-890a-fe5f2cd11f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:32.397814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cabc5-b964-4638-890a-fe5f2cd11f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:32.410331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cabc5-b964-4638-890a-fe5f2cd11f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:32.411914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cabc5-b964-4638-890a-fe5f2cd11f0d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:32.425448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfb846-55ed-4427-9ca8-1424b70dfe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:32.426102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfb846-55ed-4427-9ca8-1424b70dfe95 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:32.426378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfb846-55ed-4427-9ca8-1424b70dfe95 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:32.426646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfb846-55ed-4427-9ca8-1424b70dfe95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f22cabc5-b964-4638-890a-fe5f2cd11f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:32.434209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:32.435227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:32.436124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:32.436124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:32.436124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:32.436124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 414/800] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:32.436124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39ce6c-f3f5-4648-b969-abf434d4b6c7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:32.436422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39ce6c-f3f5-4648-b969-abf434d4b6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:32.436953 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39ce6c-f3f5-4648-b969-abf434d4b6c7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:32.438182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 415/801] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:32.443344 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39ce6c-f3f5-4648-b969-abf434d4b6c7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:32.472212 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfb846-55ed-4427-9ca8-1424b70dfe95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-7cbfb846-55ed-4427-9ca8-1424b70dfe95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:32.479639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:32.480811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:32.481659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:32.481659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:32.481659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:32.481659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:32.481659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:32.481659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:32.481659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:32.481659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:32.481659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:32.481659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:32.481659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:09:32.481659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:32.481659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 387/802] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:09:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:32.482529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56165834-e0be-410a-afff-edbaaf79bc10 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:32.482654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56165834-e0be-410a-afff-edbaaf79bc10 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:32.482930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56165834-e0be-410a-afff-edbaaf79bc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:32.508979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-56165834-e0be-410a-afff-edbaaf79bc10 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:32.512100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-56165834-e0be-410a-afff-edbaaf79bc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:32.633156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 388/803] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:32.635250 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56165834-e0be-410a-afff-edbaaf79bc10 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:32.659455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39ce6c-f3f5-4648-b969-abf434d4b6c7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:32.756758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adec13-31eb-405a-841b-d67e4ebc77d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:32.757677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adec13-31eb-405a-841b-d67e4ebc77d0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:32.758120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adec13-31eb-405a-841b-d67e4ebc77d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:32.758679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adec13-31eb-405a-841b-d67e4ebc77d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:32.759477 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adec13-31eb-405a-841b-d67e4ebc77d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:32.760848 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adec13-31eb-405a-841b-d67e4ebc77d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:32.764016 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adec13-31eb-405a-841b-d67e4ebc77d0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:32.789568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 416/804] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:32.798846 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adec13-31eb-405a-841b-d67e4ebc77d0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:32.818201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:32.829087 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:32.890686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56165834-e0be-410a-afff-edbaaf79bc10 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:32.965672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4063ce-feed-4d01-814b-696e075b932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:32.966317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4063ce-feed-4d01-814b-696e075b932a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:32.966599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4063ce-feed-4d01-814b-696e075b932a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:32.966879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4063ce-feed-4d01-814b-696e075b932a None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:32.967590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4063ce-feed-4d01-814b-696e075b932a None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:32.967897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4063ce-feed-4d01-814b-696e075b932a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:32.969428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4063ce-feed-4d01-814b-696e075b932a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:32.987992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 389/805] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:09:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:32.997187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4063ce-feed-4d01-814b-696e075b932a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:33.004069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adec13-31eb-405a-841b-d67e4ebc77d0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:33.094162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff9ba1-41c5-488e-8deb-aefaf3795380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:33.094717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff9ba1-41c5-488e-8deb-aefaf3795380 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:33.094984 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff9ba1-41c5-488e-8deb-aefaf3795380 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:33.095244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff9ba1-41c5-488e-8deb-aefaf3795380 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:33.107585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff9ba1-41c5-488e-8deb-aefaf3795380 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:33.109133 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff9ba1-41c5-488e-8deb-aefaf3795380 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4dff9ba1-41c5-488e-8deb-aefaf3795380 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:33.130104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:33.131820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:33.133768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:33.133768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:33.133768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:33.133768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:33.133768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:33.133768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:33.133768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:33.133768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:33.133768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 16:09:33.133768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:33.133768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 417/806] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:09:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:33.142109 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff9ba1-41c5-488e-8deb-aefaf3795380 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:33.206333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4063ce-feed-4d01-814b-696e075b932a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:33.239728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:33.284553 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff9ba1-41c5-488e-8deb-aefaf3795380 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:33.297245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d296f-eb80-430e-a383-71b3caa23d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:33.298333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d296f-eb80-430e-a383-71b3caa23d94 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:33.298829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d296f-eb80-430e-a383-71b3caa23d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:33.299297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d296f-eb80-430e-a383-71b3caa23d94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:33.307233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:33.330489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d296f-eb80-430e-a383-71b3caa23d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:33.334237 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d296f-eb80-430e-a383-71b3caa23d94 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:33.343769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f687a-52f6-49e8-8ac3-ca958e6dd7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:33.345018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f687a-52f6-49e8-8ac3-ca958e6dd7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:33.345548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f687a-52f6-49e8-8ac3-ca958e6dd7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:33.346097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f687a-52f6-49e8-8ac3-ca958e6dd7e9 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:33.347524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f687a-52f6-49e8-8ac3-ca958e6dd7e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:33.348439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f687a-52f6-49e8-8ac3-ca958e6dd7e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:33.352189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f687a-52f6-49e8-8ac3-ca958e6dd7e9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-4f6d296f-eb80-430e-a383-71b3caa23d94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:33.367751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:33.369709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:33.371362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:33.371362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:33.371362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:33.371362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 390/807] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:33.371832 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d296f-eb80-430e-a383-71b3caa23d94 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:33.401193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 418/808] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 21 16:09:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:33.402780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f687a-52f6-49e8-8ac3-ca958e6dd7e9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:33.509322 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d296f-eb80-430e-a383-71b3caa23d94 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:33.553969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d94f6-bc3a-4f89-ad52-62e024f7b701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:33.555153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d94f6-bc3a-4f89-ad52-62e024f7b701 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:33.555727 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d94f6-bc3a-4f89-ad52-62e024f7b701 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:33.556232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d94f6-bc3a-4f89-ad52-62e024f7b701 None admin] PATH_INFO: `/v3/services/network` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:33.557110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d94f6-bc3a-4f89-ad52-62e024f7b701 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:33.558911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d94f6-bc3a-4f89-ad52-62e024f7b701 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-902d94f6-bc3a-4f89-ad52-62e024f7b701 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:33.574764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:33.575861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:33.576796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:33.576796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:33.576796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:33.576796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:33.576796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:33.576796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:33.576796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:33.576796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:33.576796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:33.576796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:33.576796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:33.576796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:33.576796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 16:09:33.576796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:33.579799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 391/809] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:33 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:33.581146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d94f6-bc3a-4f89-ad52-62e024f7b701 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:33.623132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f687a-52f6-49e8-8ac3-ca958e6dd7e9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:33.648955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:33.677039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:33.685576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a8277-e6a6-4589-8758-646edeffbc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:33.686203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8277-e6a6-4589-8758-646edeffbc17 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:33.686483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8277-e6a6-4589-8758-646edeffbc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:33.686755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8277-e6a6-4589-8758-646edeffbc17 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:33.687415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a8277-e6a6-4589-8758-646edeffbc17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:33.687838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a8277-e6a6-4589-8758-646edeffbc17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:33.689430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a8277-e6a6-4589-8758-646edeffbc17 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:33.703667 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 419/810] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:33.704592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a8277-e6a6-4589-8758-646edeffbc17 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:33.723452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d94f6-bc3a-4f89-ad52-62e024f7b701 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:33.767116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc729bdd-7516-4800-abfc-19c9a96fb908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:33.768277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc729bdd-7516-4800-abfc-19c9a96fb908 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:33.768902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc729bdd-7516-4800-abfc-19c9a96fb908 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:33.769427 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc729bdd-7516-4800-abfc-19c9a96fb908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:33.784518 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc729bdd-7516-4800-abfc-19c9a96fb908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:33.786674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc729bdd-7516-4800-abfc-19c9a96fb908 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-bc729bdd-7516-4800-abfc-19c9a96fb908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:33.805935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:33.806957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:33.807878 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:33.807878 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:33.807878 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:33.810337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 392/811] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:33.811509 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc729bdd-7516-4800-abfc-19c9a96fb908 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:33.828530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a8277-e6a6-4589-8758-646edeffbc17 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:33.869004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde1d30-a021-4228-a6a4-90ac004d2f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:33.869648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde1d30-a021-4228-a6a4-90ac004d2f7f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:33.869929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde1d30-a021-4228-a6a4-90ac004d2f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:33.870203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde1d30-a021-4228-a6a4-90ac004d2f7f None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:33.870872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde1d30-a021-4228-a6a4-90ac004d2f7f None admin] RBAC: Adding query filter params (name=network) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:33.871313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde1d30-a021-4228-a6a4-90ac004d2f7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:33.872860 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde1d30-a021-4228-a6a4-90ac004d2f7f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:33.883494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 420/812] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 21 16:09:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:33.884647 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde1d30-a021-4228-a6a4-90ac004d2f7f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:33.948823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc729bdd-7516-4800-abfc-19c9a96fb908 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:33.952039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:33.962145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:33.994015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56798708-fb97-4414-8d49-dcb80b8a8405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:33.995213 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798708-fb97-4414-8d49-dcb80b8a8405 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:33.995712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798708-fb97-4414-8d49-dcb80b8a8405 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:33.996222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798708-fb97-4414-8d49-dcb80b8a8405 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:34.004853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde1d30-a021-4228-a6a4-90ac004d2f7f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:34.005694 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56798708-fb97-4414-8d49-dcb80b8a8405 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:34.007954 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56798708-fb97-4414-8d49-dcb80b8a8405 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-56798708-fb97-4414-8d49-dcb80b8a8405 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:34.021817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:34.022947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:34.024472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:34.024472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:34.024472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:34.024472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:34.024472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:34.024472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:34.024472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:34.024472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:34.024472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 16:09:34.024472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:34.027295 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 393/813] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 21 16:09:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:34.028426 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56798708-fb97-4414-8d49-dcb80b8a8405 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:34.044972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d188c-0033-4e2f-9811-1610dd5f76be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:34.045587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d188c-0033-4e2f-9811-1610dd5f76be None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:34.045869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d188c-0033-4e2f-9811-1610dd5f76be None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:34.046144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d188c-0033-4e2f-9811-1610dd5f76be None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:34.046801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d188c-0033-4e2f-9811-1610dd5f76be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:34.047111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d188c-0033-4e2f-9811-1610dd5f76be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:34.048525 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d188c-0033-4e2f-9811-1610dd5f76be None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:34.067178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 421/814] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:34.068059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d188c-0033-4e2f-9811-1610dd5f76be None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:34.155617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56798708-fb97-4414-8d49-dcb80b8a8405 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:34.177749 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d188c-0033-4e2f-9811-1610dd5f76be None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:34.193975 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:34.198950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bec90-91a6-48e5-8b0a-2df1171bc3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:34.199587 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bec90-91a6-48e5-8b0a-2df1171bc3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:34.199865 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bec90-91a6-48e5-8b0a-2df1171bc3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:34.200135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bec90-91a6-48e5-8b0a-2df1171bc3d3 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:34.200814 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bec90-91a6-48e5-8b0a-2df1171bc3d3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:34.201186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bec90-91a6-48e5-8b0a-2df1171bc3d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:34.202826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bec90-91a6-48e5-8b0a-2df1171bc3d3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:34.209173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 394/815] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 21 16:09:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:34.210020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bec90-91a6-48e5-8b0a-2df1171bc3d3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:34.230944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83eb518-447d-469f-88a5-10bfca12d7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:34.230944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eb518-447d-469f-88a5-10bfca12d7fb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:34.230944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eb518-447d-469f-88a5-10bfca12d7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:34.230944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eb518-447d-469f-88a5-10bfca12d7fb None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:34.231460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83eb518-447d-469f-88a5-10bfca12d7fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:34.231460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83eb518-447d-469f-88a5-10bfca12d7fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:34.232277 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83eb518-447d-469f-88a5-10bfca12d7fb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:34.252116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 422/816] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 21 16:09:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:34.252819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83eb518-447d-469f-88a5-10bfca12d7fb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:34.260843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:34.371283 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83eb518-447d-469f-88a5-10bfca12d7fb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:34.414290 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bec90-91a6-48e5-8b0a-2df1171bc3d3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:34.417495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a120a-f50a-452f-b59f-097ffd7ad330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:34.419461 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a120a-f50a-452f-b59f-097ffd7ad330 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:34.419744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a120a-f50a-452f-b59f-097ffd7ad330 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:34.420022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a120a-f50a-452f-b59f-097ffd7ad330 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:34.420745 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a120a-f50a-452f-b59f-097ffd7ad330 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:34.422181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a120a-f50a-452f-b59f-097ffd7ad330 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:34.468865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 423/817] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:09:34 2022] POST /identity/v3/endpoints => generated 337 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:09:34.470216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a120a-f50a-452f-b59f-097ffd7ad330 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:34.495272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee271c0-8243-482a-81cc-17ee3d743e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:34.496442 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee271c0-8243-482a-81cc-17ee3d743e6a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:34.499077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee271c0-8243-482a-81cc-17ee3d743e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:34.499659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee271c0-8243-482a-81cc-17ee3d743e6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:34.519216 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee271c0-8243-482a-81cc-17ee3d743e6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:34.522477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee271c0-8243-482a-81cc-17ee3d743e6a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-dee271c0-8243-482a-81cc-17ee3d743e6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:34.540302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:34.541316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:34.542226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:34.542226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:34.542226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:34.542226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:34.542226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:34.542226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:34.542226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:34.542226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:34.548375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 395/818] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:34.561904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee271c0-8243-482a-81cc-17ee3d743e6a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:34.568980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:34.729023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a120a-f50a-452f-b59f-097ffd7ad330 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:34.771086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:34.793023 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee271c0-8243-482a-81cc-17ee3d743e6a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:34.806613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438acb0f-1b16-41a7-87da-a5ded311a9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:34.807154 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438acb0f-1b16-41a7-87da-a5ded311a9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:34.807492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438acb0f-1b16-41a7-87da-a5ded311a9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:34.807765 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438acb0f-1b16-41a7-87da-a5ded311a9a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:34.849681 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6885c-b35f-4226-afeb-3baa46b6b430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:34.850758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6885c-b35f-4226-afeb-3baa46b6b430 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:34.851401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6885c-b35f-4226-afeb-3baa46b6b430 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:34.851680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6885c-b35f-4226-afeb-3baa46b6b430 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:34.857599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6885c-b35f-4226-afeb-3baa46b6b430 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:34.857599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6885c-b35f-4226-afeb-3baa46b6b430 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:34.858534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6885c-b35f-4226-afeb-3baa46b6b430 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:34.878274 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 396/819] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:34.879437 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18885f2-d3bf-4e41-a72a-6f83a12f4018 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:34.880581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18885f2-d3bf-4e41-a72a-6f83a12f4018 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:34.880581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18885f2-d3bf-4e41-a72a-6f83a12f4018 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:34.881588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 397/820] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:34.884034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18885f2-d3bf-4e41-a72a-6f83a12f4018 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:34.905361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438acb0f-1b16-41a7-87da-a5ded311a9a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:34.906949 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438acb0f-1b16-41a7-87da-a5ded311a9a0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:34.937978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:34.997577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18885f2-d3bf-4e41-a72a-6f83a12f4018 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:35.019583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 424/821] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:09:34 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:09:35.021069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaca0f6-94b3-4b96-9eb4-d22dceae10ec None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:35.021356 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaca0f6-94b3-4b96-9eb4-d22dceae10ec None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:35.021630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaca0f6-94b3-4b96-9eb4-d22dceae10ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:35.034397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba40a11-f1c3-435f-a263-c6554aa74ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:35.035054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba40a11-f1c3-435f-a263-c6554aa74ec9 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:35.035327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba40a11-f1c3-435f-a263-c6554aa74ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:35.035594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba40a11-f1c3-435f-a263-c6554aa74ec9 None admin] PATH_INFO: `/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/0b28aaefcb154b228987362921f6476b/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:35.037498 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba40a11-f1c3-435f-a263-c6554aa74ec9 None admin] RBAC: Authorizing `identity:create_grant(project_id=78142a67f69a4ba58113cc7c8dc269b1, user_id=0b28aaefcb154b228987362921f6476b, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:35.039546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba40a11-f1c3-435f-a263-c6554aa74ec9 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:35.040289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1aaca0f6-94b3-4b96-9eb4-d22dceae10ec None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:35.041534 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1aaca0f6-94b3-4b96-9eb4-d22dceae10ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:35.052818 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 398/822] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:09:34 2022] PUT /identity/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/0b28aaefcb154b228987362921f6476b/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:09:35.054174 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9aa2cc-4191-4fd4-8a85-552ce03cba48 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:35.054458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9aa2cc-4191-4fd4-8a85-552ce03cba48 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:35.054725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9aa2cc-4191-4fd4-8a85-552ce03cba48 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:35.056173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 399/823] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:35.056878 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9aa2cc-4191-4fd4-8a85-552ce03cba48 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:35.063343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:35.138783 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 425/824] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:35.138783 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424402-cdaa-46ea-b308-ac486c7c78b8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:35.138783 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424402-cdaa-46ea-b308-ac486c7c78b8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:35.138783 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424402-cdaa-46ea-b308-ac486c7c78b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:35.161689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-88424402-cdaa-46ea-b308-ac486c7c78b8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:35.163175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-88424402-cdaa-46ea-b308-ac486c7c78b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:35.186697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9aa2cc-4191-4fd4-8a85-552ce03cba48 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:35.235980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c41b26-ead7-4d01-8563-4a13e86edbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:35.236620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c41b26-ead7-4d01-8563-4a13e86edbea None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:35.236935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c41b26-ead7-4d01-8563-4a13e86edbea None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:35.237209 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c41b26-ead7-4d01-8563-4a13e86edbea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:35.242563 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:35.252006 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c41b26-ead7-4d01-8563-4a13e86edbea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:35.253448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c41b26-ead7-4d01-8563-4a13e86edbea None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:35.264386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 426/825] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-10c41b26-ead7-4d01-8563-4a13e86edbea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:35.271913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:35.273223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:35.274177 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:35.274177 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:35.274177 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:35.277835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 400/826] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:35.280279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88424402-cdaa-46ea-b308-ac486c7c78b8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:35.385695 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88424402-cdaa-46ea-b308-ac486c7c78b8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:35.416423 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c41b26-ead7-4d01-8563-4a13e86edbea None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:35.421634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb6d85-ff85-4043-94e2-0ea3e095fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:35.422257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb6d85-ff85-4043-94e2-0ea3e095fea7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:35.422536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb6d85-ff85-4043-94e2-0ea3e095fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:35.422807 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb6d85-ff85-4043-94e2-0ea3e095fea7 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:35.423458 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb6d85-ff85-4043-94e2-0ea3e095fea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:35.423767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb6d85-ff85-4043-94e2-0ea3e095fea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:35.425168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb6d85-ff85-4043-94e2-0ea3e095fea7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:35.438227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 427/827] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:35.446782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb6d85-ff85-4043-94e2-0ea3e095fea7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:35.505467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:35.509543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:35.560748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c41b26-ead7-4d01-8563-4a13e86edbea None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:35.570796 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb6d85-ff85-4043-94e2-0ea3e095fea7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:35.599199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9fb40-53a5-4d21-8f55-855d9f6879e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:35.599840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9fb40-53a5-4d21-8f55-855d9f6879e4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:35.600114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9fb40-53a5-4d21-8f55-855d9f6879e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:35.600381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9fb40-53a5-4d21-8f55-855d9f6879e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:35.615340 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9fb40-53a5-4d21-8f55-855d9f6879e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:35.618810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad21fa-771b-4366-956d-e8002e1cd5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:35.619462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad21fa-771b-4366-956d-e8002e1cd5fe None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:35.619742 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad21fa-771b-4366-956d-e8002e1cd5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:35.620014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad21fa-771b-4366-956d-e8002e1cd5fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-9bd9fb40-53a5-4d21-8f55-855d9f6879e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:35.621245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:35.622173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:35.623049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:35.623049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:35.623049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:35.623049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:35.623049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:35.623049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:35.623049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:35.623049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:35.623049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:35.623049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:35.623049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:09:35.623049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:35.624837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 401/828] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:09:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:35.625950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9fb40-53a5-4d21-8f55-855d9f6879e4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:35.629769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad21fa-771b-4366-956d-e8002e1cd5fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:35.631230 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad21fa-771b-4366-956d-e8002e1cd5fe None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-afad21fa-771b-4366-956d-e8002e1cd5fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:35.644167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:35.645443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:35.646422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:35.646422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:35.646422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:35.646422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:35.646422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:35.646422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:35.646422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:35.646422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:35.650273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 428/829] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:35.651453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad21fa-771b-4366-956d-e8002e1cd5fe None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:35.743750 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9fb40-53a5-4d21-8f55-855d9f6879e4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:35.761278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:35.763424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad21fa-771b-4366-956d-e8002e1cd5fe None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:35.774985 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:35.781218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347e61c-b3ea-47c3-9dcb-a4fac6fefb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:35.781864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347e61c-b3ea-47c3-9dcb-a4fac6fefb09 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:35.782144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347e61c-b3ea-47c3-9dcb-a4fac6fefb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:35.782415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347e61c-b3ea-47c3-9dcb-a4fac6fefb09 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:35.783121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347e61c-b3ea-47c3-9dcb-a4fac6fefb09 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:35.784607 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347e61c-b3ea-47c3-9dcb-a4fac6fefb09 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-e347e61c-b3ea-47c3-9dcb-a4fac6fefb09 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:35.795637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:35.796907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:35.797798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 402/830] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Sep 21 16:09:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:35.798654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347e61c-b3ea-47c3-9dcb-a4fac6fefb09 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:35.804508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0b754-d561-45f4-ace3-7ead10c94725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:35.805164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0b754-d561-45f4-ace3-7ead10c94725 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:35.805432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0b754-d561-45f4-ace3-7ead10c94725 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:35.805696 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0b754-d561-45f4-ace3-7ead10c94725 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:35.806358 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0b754-d561-45f4-ace3-7ead10c94725 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:35.806657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0b754-d561-45f4-ace3-7ead10c94725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:35.808024 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0b754-d561-45f4-ace3-7ead10c94725 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:35.816791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 429/831] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:09:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:35.822288 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0b754-d561-45f4-ace3-7ead10c94725 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:35.907359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347e61c-b3ea-47c3-9dcb-a4fac6fefb09 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:35.937914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0b754-d561-45f4-ace3-7ead10c94725 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:35.946933 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab8511-8a59-4ec4-9c0e-10ace1bce082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:35.947571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab8511-8a59-4ec4-9c0e-10ace1bce082 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:35.947858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab8511-8a59-4ec4-9c0e-10ace1bce082 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:35.948116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab8511-8a59-4ec4-9c0e-10ace1bce082 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:35.948864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab8511-8a59-4ec4-9c0e-10ace1bce082 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:35.949179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab8511-8a59-4ec4-9c0e-10ace1bce082 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:35.950679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab8511-8a59-4ec4-9c0e-10ace1bce082 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:35.963601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 403/832] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:35.964760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab8511-8a59-4ec4-9c0e-10ace1bce082 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:35.986217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e8258-7e5f-463a-bd1a-04f51e242f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:35.987155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e8258-7e5f-463a-bd1a-04f51e242f00 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:35.988065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e8258-7e5f-463a-bd1a-04f51e242f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:35.988540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e8258-7e5f-463a-bd1a-04f51e242f00 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:35.989651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e8258-7e5f-463a-bd1a-04f51e242f00 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:35.990164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e8258-7e5f-463a-bd1a-04f51e242f00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:35.992266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e8258-7e5f-463a-bd1a-04f51e242f00 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:35.997363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 430/833] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 21 16:09:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:35.998194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e8258-7e5f-463a-bd1a-04f51e242f00 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:36.010116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:36.043723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:36.076064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab8511-8a59-4ec4-9c0e-10ace1bce082 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:36.113887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d079e6f-8473-4719-9411-596454fd2958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:36.114527 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d079e6f-8473-4719-9411-596454fd2958 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:36.114813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d079e6f-8473-4719-9411-596454fd2958 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:36.115084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d079e6f-8473-4719-9411-596454fd2958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:36.118894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e8258-7e5f-463a-bd1a-04f51e242f00 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:36.126268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d079e6f-8473-4719-9411-596454fd2958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:36.127727 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d079e6f-8473-4719-9411-596454fd2958 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-2d079e6f-8473-4719-9411-596454fd2958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:36.142618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:36.148949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:36.150108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:36.150108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:36.150108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:36.150108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 404/834] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:36.150108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d079e6f-8473-4719-9411-596454fd2958 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:36.163782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340e6c9-e320-402c-a395-df2508161883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:36.164897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340e6c9-e320-402c-a395-df2508161883 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:36.165333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340e6c9-e320-402c-a395-df2508161883 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:36.165613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340e6c9-e320-402c-a395-df2508161883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:36.166341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340e6c9-e320-402c-a395-df2508161883 None admin] RBAC: Adding query filter params (role.id=8e7b3a48a50745adad97c6205aafc562, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=5e20281883414eed9d644e0eaab2ac49) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:36.166690 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340e6c9-e320-402c-a395-df2508161883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:36.168082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340e6c9-e320-402c-a395-df2508161883 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:36.174105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 431/835] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:09:35 2022] GET /identity/v3/role_assignments?user.id=5e20281883414eed9d644e0eaab2ac49&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=8e7b3a48a50745adad97c6205aafc562 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:36.174926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340e6c9-e320-402c-a395-df2508161883 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:36.267929 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:36.281732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d079e6f-8473-4719-9411-596454fd2958 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:36.286883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:36.290892 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340e6c9-e320-402c-a395-df2508161883 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:36.328527 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e43fa8-6e0c-4344-8ca4-cc428ca32e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:36.329778 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e43fa8-6e0c-4344-8ca4-cc428ca32e12 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:36.330289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e43fa8-6e0c-4344-8ca4-cc428ca32e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:36.330740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e43fa8-6e0c-4344-8ca4-cc428ca32e12 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:36.330865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424910d7-630d-4b1d-a6c0-30af3c1478ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:36.331573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424910d7-630d-4b1d-a6c0-30af3c1478ad None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:36.331853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e43fa8-6e0c-4344-8ca4-cc428ca32e12 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:36.332064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424910d7-630d-4b1d-a6c0-30af3c1478ad None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:36.332436 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424910d7-630d-4b1d-a6c0-30af3c1478ad None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:36.332605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e43fa8-6e0c-4344-8ca4-cc428ca32e12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:36.333335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424910d7-630d-4b1d-a6c0-30af3c1478ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:36.333739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424910d7-630d-4b1d-a6c0-30af3c1478ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:36.334527 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e43fa8-6e0c-4344-8ca4-cc428ca32e12 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:36.336048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424910d7-630d-4b1d-a6c0-30af3c1478ad None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:36.347405 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 405/836] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 21 16:09:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:36.348620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e43fa8-6e0c-4344-8ca4-cc428ca32e12 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:36.350655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 432/837] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:36.357905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424910d7-630d-4b1d-a6c0-30af3c1478ad None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:36.474144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424910d7-630d-4b1d-a6c0-30af3c1478ad None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:36.474380 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e43fa8-6e0c-4344-8ca4-cc428ca32e12 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:36.514977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b44cd5-e77f-404a-b714-45172127c65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:36.515893 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b44cd5-e77f-404a-b714-45172127c65e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:36.516622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b44cd5-e77f-404a-b714-45172127c65e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:36.516933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b44cd5-e77f-404a-b714-45172127c65e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:36.521184 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a19fa-a992-40f1-a510-a154bea3996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:36.522176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a19fa-a992-40f1-a510-a154bea3996f None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:36.522176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a19fa-a992-40f1-a510-a154bea3996f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:36.522370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a19fa-a992-40f1-a510-a154bea3996f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:36.523552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a19fa-a992-40f1-a510-a154bea3996f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:36.525612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a19fa-a992-40f1-a510-a154bea3996f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:36.526841 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b44cd5-e77f-404a-b714-45172127c65e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:36.528597 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b44cd5-e77f-404a-b714-45172127c65e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b8b44cd5-e77f-404a-b714-45172127c65e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:36.543306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:36.544367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:36.545506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:36.545506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:36.545506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:36.545506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:36.545506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:36.545506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:36.545506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:36.545506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:36.545506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:09:36.545506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:36.545506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 433/838] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 21 16:09:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:36.550192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b44cd5-e77f-404a-b714-45172127c65e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:36.556531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 406/839] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:09:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:09:36.574814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:36.738739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b44cd5-e77f-404a-b714-45172127c65e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:36.829069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ef7c6-768c-4d2c-80f7-25592c024d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:36.830426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ef7c6-768c-4d2c-80f7-25592c024d1b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:36.830906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ef7c6-768c-4d2c-80f7-25592c024d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:36.831383 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ef7c6-768c-4d2c-80f7-25592c024d1b None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:36.832740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ef7c6-768c-4d2c-80f7-25592c024d1b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:36.833236 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ef7c6-768c-4d2c-80f7-25592c024d1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:36.835929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ef7c6-768c-4d2c-80f7-25592c024d1b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:36.873803 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 434/840] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 21 16:09:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:36.883169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a19fa-a992-40f1-a510-a154bea3996f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:36.911993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:37.077684 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a19fa-a992-40f1-a510-a154bea3996f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:37.139321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f823373-f4c7-42ec-81e5-51370ea0ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:37.140452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f823373-f4c7-42ec-81e5-51370ea0ccea None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:37.140991 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f823373-f4c7-42ec-81e5-51370ea0ccea None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:37.141539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f823373-f4c7-42ec-81e5-51370ea0ccea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:37.224148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f823373-f4c7-42ec-81e5-51370ea0ccea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:37.225802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f823373-f4c7-42ec-81e5-51370ea0ccea None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:37.248525 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:37.359328 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49519b6f-a6a1-4cc7-90e4-c3592bd6455a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:37.359902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49519b6f-a6a1-4cc7-90e4-c3592bd6455a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:37.359902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49519b6f-a6a1-4cc7-90e4-c3592bd6455a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:37.362611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 435/841] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:09:37.368784 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e037a8-8d47-4b99-b6a7-d3527aba7a15 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:37.369050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e037a8-8d47-4b99-b6a7-d3527aba7a15 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:37.369319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e037a8-8d47-4b99-b6a7-d3527aba7a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:37.394270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b3e037a8-8d47-4b99-b6a7-d3527aba7a15 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:37.395784 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b3e037a8-8d47-4b99-b6a7-d3527aba7a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:37.444037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 407/842] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:09:36 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:09:37.459839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f823373-f4c7-42ec-81e5-51370ea0ccea None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:37.542968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 436/843] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:09:37.598280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f823373-f4c7-42ec-81e5-51370ea0ccea None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:37.626780 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:37.669813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8282600-8e20-4a5d-9722-d3d9231dec34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:37.671390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8282600-8e20-4a5d-9722-d3d9231dec34 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:37.672179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8282600-8e20-4a5d-9722-d3d9231dec34 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:37.672969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8282600-8e20-4a5d-9722-d3d9231dec34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:37.693636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8282600-8e20-4a5d-9722-d3d9231dec34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:37.697288 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8282600-8e20-4a5d-9722-d3d9231dec34 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-e8282600-8e20-4a5d-9722-d3d9231dec34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:37.728141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:37.729838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:37.731514 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:37.731514 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:37.731514 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:37.740680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 408/844] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:37.744129 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e037a8-8d47-4b99-b6a7-d3527aba7a15 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:37.749000 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:37.829898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8282600-8e20-4a5d-9722-d3d9231dec34 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:37.907621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e037a8-8d47-4b99-b6a7-d3527aba7a15 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:37.953682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18476023-d7aa-4045-9499-6b0cc30a3582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:37.954705 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476023-d7aa-4045-9499-6b0cc30a3582 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:37.955616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476023-d7aa-4045-9499-6b0cc30a3582 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:37.955813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476023-d7aa-4045-9499-6b0cc30a3582 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:37.956844 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18476023-d7aa-4045-9499-6b0cc30a3582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:37.957374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18476023-d7aa-4045-9499-6b0cc30a3582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:37.959031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18476023-d7aa-4045-9499-6b0cc30a3582 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:37.981017 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 437/845] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:37.983775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18476023-d7aa-4045-9499-6b0cc30a3582 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:38.040017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8282600-8e20-4a5d-9722-d3d9231dec34 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:38.078440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8e8f1-82dd-4e5e-af77-74e524da9d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:38.079079 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e8f1-82dd-4e5e-af77-74e524da9d8c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:38.079359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e8f1-82dd-4e5e-af77-74e524da9d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:38.079750 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e8f1-82dd-4e5e-af77-74e524da9d8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:38.090483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:38.093668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8e8f1-82dd-4e5e-af77-74e524da9d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-61f8e8f1-82dd-4e5e-af77-74e524da9d8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:38.102254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:38.103387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:38.104283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:38.104283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:38.104283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:38.104283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:38.104283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:38.104283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:38.104283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:38.104283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:38.104283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:38.104283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:38.104283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:09:38.104283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:38.106686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 409/846] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:09:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:38.113747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8e8f1-82dd-4e5e-af77-74e524da9d8c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:38.147499 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18476023-d7aa-4045-9499-6b0cc30a3582 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:38.190102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ed5fb-9146-45dd-abdc-8e4592e6369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:38.190675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ed5fb-9146-45dd-abdc-8e4592e6369a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:38.190952 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ed5fb-9146-45dd-abdc-8e4592e6369a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:38.191221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ed5fb-9146-45dd-abdc-8e4592e6369a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:38.200155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ed5fb-9146-45dd-abdc-8e4592e6369a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:38.201748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ed5fb-9146-45dd-abdc-8e4592e6369a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-711ed5fb-9146-45dd-abdc-8e4592e6369a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:38.215297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:38.216379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:38.217386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:38.217386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:38.217386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:38.217386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:38.217386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:38.217386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:38.217386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:38.217386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:38.221241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 438/847] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:38.223249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ed5fb-9146-45dd-abdc-8e4592e6369a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:38.272000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:38.336886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ed5fb-9146-45dd-abdc-8e4592e6369a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:38.362101 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:38.371422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8e8f1-82dd-4e5e-af77-74e524da9d8c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:38.375951 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563033f-4da2-4a0d-a335-ff759cb971b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:38.376573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563033f-4da2-4a0d-a335-ff759cb971b4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:38.376881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563033f-4da2-4a0d-a335-ff759cb971b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:38.377220 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563033f-4da2-4a0d-a335-ff759cb971b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:38.377975 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563033f-4da2-4a0d-a335-ff759cb971b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:38.378282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563033f-4da2-4a0d-a335-ff759cb971b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:38.379852 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563033f-4da2-4a0d-a335-ff759cb971b4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:38.400419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 439/848] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:38.401356 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563033f-4da2-4a0d-a335-ff759cb971b4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:38.412285 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b061ff4-5a4b-4b6c-a3a6-1e770ae83b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:38.413351 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061ff4-5a4b-4b6c-a3a6-1e770ae83b0d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:38.413782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061ff4-5a4b-4b6c-a3a6-1e770ae83b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:38.414413 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061ff4-5a4b-4b6c-a3a6-1e770ae83b0d None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:38.415238 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b061ff4-5a4b-4b6c-a3a6-1e770ae83b0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:38.415692 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b061ff4-5a4b-4b6c-a3a6-1e770ae83b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:38.417522 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b061ff4-5a4b-4b6c-a3a6-1e770ae83b0d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:38.428151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 410/849] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:38.434497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b061ff4-5a4b-4b6c-a3a6-1e770ae83b0d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:38.539350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563033f-4da2-4a0d-a335-ff759cb971b4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:38.560705 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:38.584543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b061ff4-5a4b-4b6c-a3a6-1e770ae83b0d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:38.592545 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987595f-e0e7-46fa-b2a3-4eb36392f8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:38.595805 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987595f-e0e7-46fa-b2a3-4eb36392f8ed None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:38.596104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987595f-e0e7-46fa-b2a3-4eb36392f8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:38.596378 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987595f-e0e7-46fa-b2a3-4eb36392f8ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:38.597174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987595f-e0e7-46fa-b2a3-4eb36392f8ed None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=d7ff08c990dc41b4811f97fecb7c4c3a) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:38.597486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987595f-e0e7-46fa-b2a3-4eb36392f8ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:38.599655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987595f-e0e7-46fa-b2a3-4eb36392f8ed None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:38.612730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 440/850] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:09:38 2022] GET /identity/v3/role_assignments?user.id=d7ff08c990dc41b4811f97fecb7c4c3a&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=beec000223e041209205627bfa0dbed1 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:38.635316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e650bc-01c1-47f0-9743-1e2d41e67100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:38.635985 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e650bc-01c1-47f0-9743-1e2d41e67100 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:38.636270 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e650bc-01c1-47f0-9743-1e2d41e67100 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:38.636548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e650bc-01c1-47f0-9743-1e2d41e67100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:38.649362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e650bc-01c1-47f0-9743-1e2d41e67100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:38.650886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e650bc-01c1-47f0-9743-1e2d41e67100 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-24e650bc-01c1-47f0-9743-1e2d41e67100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:38.667580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:38.668654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:38.669591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:38.669591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:38.669591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:38.669591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 411/851] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:38.676708 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987595f-e0e7-46fa-b2a3-4eb36392f8ed None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:38.741179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:38.802594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987595f-e0e7-46fa-b2a3-4eb36392f8ed None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:38.841952 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381bdfc-9784-4555-ae03-5cc9d46a86c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:38.842574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381bdfc-9784-4555-ae03-5cc9d46a86c3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:38.842854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381bdfc-9784-4555-ae03-5cc9d46a86c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:38.843127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381bdfc-9784-4555-ae03-5cc9d46a86c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:38.843818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381bdfc-9784-4555-ae03-5cc9d46a86c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:38.844115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381bdfc-9784-4555-ae03-5cc9d46a86c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:38.845577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381bdfc-9784-4555-ae03-5cc9d46a86c3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:38.859763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 441/852] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:38.868383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e650bc-01c1-47f0-9743-1e2d41e67100 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:38.991981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e650bc-01c1-47f0-9743-1e2d41e67100 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:39.040059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bded0-fe6a-46a4-bdeb-8eccac0e7006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:39.041151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bded0-fe6a-46a4-bdeb-8eccac0e7006 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:39.041602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bded0-fe6a-46a4-bdeb-8eccac0e7006 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:39.042081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bded0-fe6a-46a4-bdeb-8eccac0e7006 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:39.051891 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bded0-fe6a-46a4-bdeb-8eccac0e7006 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:39.054367 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bded0-fe6a-46a4-bdeb-8eccac0e7006 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:39.056640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-874bded0-fe6a-46a4-bdeb-8eccac0e7006 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:39.072528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:39.074581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:39.076729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:39.076729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:39.076729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:39.076729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:39.076729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:39.076729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:39.076729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:39.076729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:39.076729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 16:09:39.076729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:39.080586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 412/853] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:09:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:39.087287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381bdfc-9784-4555-ae03-5cc9d46a86c3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:39.223731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381bdfc-9784-4555-ae03-5cc9d46a86c3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:39.232235 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:39.244998 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d479b-0985-42d8-b57c-b09ca13979cc None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:39.245186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d479b-0985-42d8-b57c-b09ca13979cc None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:39.245448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d479b-0985-42d8-b57c-b09ca13979cc None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:39.248235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 413/854] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:09:39.252845 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a857e4-dd21-497a-93fe-4dc4681b56c5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:39.253215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a857e4-dd21-497a-93fe-4dc4681b56c5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:39.253375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a857e4-dd21-497a-93fe-4dc4681b56c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:39.278601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a5a857e4-dd21-497a-93fe-4dc4681b56c5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:39.280947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a5a857e4-dd21-497a-93fe-4dc4681b56c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:39.281766 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eadd6f-2651-4c23-af59-bf6a5251c73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:39.282625 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eadd6f-2651-4c23-af59-bf6a5251c73d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:39.283097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eadd6f-2651-4c23-af59-bf6a5251c73d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:39.283571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eadd6f-2651-4c23-af59-bf6a5251c73d None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:39.284636 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eadd6f-2651-4c23-af59-bf6a5251c73d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:39.285178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eadd6f-2651-4c23-af59-bf6a5251c73d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:39.286936 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eadd6f-2651-4c23-af59-bf6a5251c73d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:39.309986 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 442/855] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 21 16:09:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:39.315705 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eadd6f-2651-4c23-af59-bf6a5251c73d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:39.392811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 414/856] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:39.474481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eadd6f-2651-4c23-af59-bf6a5251c73d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:39.522941 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3564493-690a-451f-bb04-d882c86c469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:39.524078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3564493-690a-451f-bb04-d882c86c469b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:39.524640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3564493-690a-451f-bb04-d882c86c469b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:39.525135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3564493-690a-451f-bb04-d882c86c469b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:39.565356 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:39.618690 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3564493-690a-451f-bb04-d882c86c469b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:39.620501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3564493-690a-451f-bb04-d882c86c469b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:39.690283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e448d-83f4-48bc-9201-919ef4c21b4a None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:39.690864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e448d-83f4-48bc-9201-919ef4c21b4a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:39.690864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e448d-83f4-48bc-9201-919ef4c21b4a None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:39.692591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 415/857] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:39.699052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ba26d-fd1e-4aa7-aa2b-c57c0b580f55 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:39.699328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ba26d-fd1e-4aa7-aa2b-c57c0b580f55 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:39.699599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ba26d-fd1e-4aa7-aa2b-c57c0b580f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:39.719537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-896ba26d-fd1e-4aa7-aa2b-c57c0b580f55 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:39.720897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-896ba26d-fd1e-4aa7-aa2b-c57c0b580f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:39.745060 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 443/858] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:09:39 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 16:09:39.745949 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3564493-690a-451f-bb04-d882c86c469b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:39.818172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 416/859] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:09:39.819117 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ba26d-fd1e-4aa7-aa2b-c57c0b580f55 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:39.841514 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:39.884042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3564493-690a-451f-bb04-d882c86c469b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:39.922803 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659e2ed-5c06-462c-9e8b-b0f2ec26c302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:39.923454 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659e2ed-5c06-462c-9e8b-b0f2ec26c302 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:39.923718 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659e2ed-5c06-462c-9e8b-b0f2ec26c302 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:39.923971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659e2ed-5c06-462c-9e8b-b0f2ec26c302 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:39.930190 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:39.939008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659e2ed-5c06-462c-9e8b-b0f2ec26c302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6659e2ed-5c06-462c-9e8b-b0f2ec26c302 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:39.944090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:39.946737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:39.948782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:39.948782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:39.948782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:39.948782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:39.948782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:39.948782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:39.948782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:39.948782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:39.948782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:39.948782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:39.948782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 16:09:39.948782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:39.948782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 444/860] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 21 16:09:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:39.951800 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659e2ed-5c06-462c-9e8b-b0f2ec26c302 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:40.032784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ba26d-fd1e-4aa7-aa2b-c57c0b580f55 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:40.065704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659e2ed-5c06-462c-9e8b-b0f2ec26c302 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:40.092159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:40.105195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03d968-473e-44cd-a82e-19c2d12c9667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:40.105482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa71248-fbf9-4499-9831-ba9753897b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:40.105943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa71248-fbf9-4499-9831-ba9753897b86 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:40.106218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa71248-fbf9-4499-9831-ba9753897b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:40.106485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa71248-fbf9-4499-9831-ba9753897b86 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:40.107188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa71248-fbf9-4499-9831-ba9753897b86 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:40.107487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa71248-fbf9-4499-9831-ba9753897b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:40.107888 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03d968-473e-44cd-a82e-19c2d12c9667 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:40.108389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03d968-473e-44cd-a82e-19c2d12c9667 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:40.108873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa71248-fbf9-4499-9831-ba9753897b86 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:40.108979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03d968-473e-44cd-a82e-19c2d12c9667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:40.118600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 445/861] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 21 16:09:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:40.120809 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa71248-fbf9-4499-9831-ba9753897b86 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:40.131330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03d968-473e-44cd-a82e-19c2d12c9667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:40.134483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03d968-473e-44cd-a82e-19c2d12c9667 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-df03d968-473e-44cd-a82e-19c2d12c9667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:40.157054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:40.158119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:40.159066 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:40.159066 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:40.159066 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:40.159066 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 417/862] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:40.159066 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03d968-473e-44cd-a82e-19c2d12c9667 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:40.266023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa71248-fbf9-4499-9831-ba9753897b86 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:40.319201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03d968-473e-44cd-a82e-19c2d12c9667 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:40.322759 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ce64e-2d0e-41fc-a5b1-8f3d39250242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:40.323570 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ce64e-2d0e-41fc-a5b1-8f3d39250242 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:40.323982 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ce64e-2d0e-41fc-a5b1-8f3d39250242 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:40.324424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ce64e-2d0e-41fc-a5b1-8f3d39250242 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:40.325444 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ce64e-2d0e-41fc-a5b1-8f3d39250242 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:40.327808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ce64e-2d0e-41fc-a5b1-8f3d39250242 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:40.338568 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d18ce64e-2d0e-41fc-a5b1-8f3d39250242 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:40.346386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:40.348296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:40.350020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 446/863] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:09:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:40.351562 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ce64e-2d0e-41fc-a5b1-8f3d39250242 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:40.384914 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06ec6f-0c48-4a7e-9abf-e5cec9e97f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:40.385803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06ec6f-0c48-4a7e-9abf-e5cec9e97f54 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:40.386261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06ec6f-0c48-4a7e-9abf-e5cec9e97f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:40.386696 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06ec6f-0c48-4a7e-9abf-e5cec9e97f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:40.404312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06ec6f-0c48-4a7e-9abf-e5cec9e97f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:40.406642 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06ec6f-0c48-4a7e-9abf-e5cec9e97f54 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-4b06ec6f-0c48-4a7e-9abf-e5cec9e97f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:40.431577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:40.433682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:40.435451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:40.435451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:40.435451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:40.435451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 418/864] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:40.435451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06ec6f-0c48-4a7e-9abf-e5cec9e97f54 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:40.465357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:40.567536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ce64e-2d0e-41fc-a5b1-8f3d39250242 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:40.607204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06ec6f-0c48-4a7e-9abf-e5cec9e97f54 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:40.628936 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76175e37-ad14-479e-bcbb-b5f2a36de3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:40.629901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76175e37-ad14-479e-bcbb-b5f2a36de3df None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:40.630325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76175e37-ad14-479e-bcbb-b5f2a36de3df None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:40.630761 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76175e37-ad14-479e-bcbb-b5f2a36de3df None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:40.631792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76175e37-ad14-479e-bcbb-b5f2a36de3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:40.632863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76175e37-ad14-479e-bcbb-b5f2a36de3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:40.635279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76175e37-ad14-479e-bcbb-b5f2a36de3df None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:40.663430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 447/865] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:40.663430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76175e37-ad14-479e-bcbb-b5f2a36de3df None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:40.675123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6d98f-2e0e-4e98-914c-4cb103e45f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:40.675935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6d98f-2e0e-4e98-914c-4cb103e45f86 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:40.676289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6d98f-2e0e-4e98-914c-4cb103e45f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:40.676620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6d98f-2e0e-4e98-914c-4cb103e45f86 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:40.677660 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6d98f-2e0e-4e98-914c-4cb103e45f86 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:40.678157 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6d98f-2e0e-4e98-914c-4cb103e45f86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:40.680639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6d98f-2e0e-4e98-914c-4cb103e45f86 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:40.696361 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 419/866] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:09:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:40.696361 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6d98f-2e0e-4e98-914c-4cb103e45f86 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:40.739429 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:40.829446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6d98f-2e0e-4e98-914c-4cb103e45f86 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:40.856579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76175e37-ad14-479e-bcbb-b5f2a36de3df None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:40.870247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:40.879997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd57745-f7e2-46c8-99ab-1995b0fff8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:40.882217 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd57745-f7e2-46c8-99ab-1995b0fff8ef None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:40.883864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd57745-f7e2-46c8-99ab-1995b0fff8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:40.884400 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd57745-f7e2-46c8-99ab-1995b0fff8ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:40.898207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd57745-f7e2-46c8-99ab-1995b0fff8ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:40.900237 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa278f-5671-4e94-bf85-753c99f24929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:40.900895 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa278f-5671-4e94-bf85-753c99f24929 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:40.901062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd57745-f7e2-46c8-99ab-1995b0fff8ef None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:40.901231 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa278f-5671-4e94-bf85-753c99f24929 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:40.901520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa278f-5671-4e94-bf85-753c99f24929 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:40.902071 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa278f-5671-4e94-bf85-753c99f24929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:40.902368 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa278f-5671-4e94-bf85-753c99f24929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:40.904113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa278f-5671-4e94-bf85-753c99f24929 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:40.925947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 448/867] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:40.925947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa278f-5671-4e94-bf85-753c99f24929 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-5fd57745-f7e2-46c8-99ab-1995b0fff8ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:40.926373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:40.927997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:40.930407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:40.930407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:40.930407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:40.930407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:40.930407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:40.930407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:40.930407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:40.930407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:40.930407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 420/868] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:40.930407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd57745-f7e2-46c8-99ab-1995b0fff8ef None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:41.083706 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:41.091744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa278f-5671-4e94-bf85-753c99f24929 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:41.110701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd57745-f7e2-46c8-99ab-1995b0fff8ef None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:41.130756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7757e4-08d4-48e5-b066-43e8ec9a1b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:41.131372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7757e4-08d4-48e5-b066-43e8ec9a1b98 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:41.131648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7757e4-08d4-48e5-b066-43e8ec9a1b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:41.131914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7757e4-08d4-48e5-b066-43e8ec9a1b98 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:41.133141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7757e4-08d4-48e5-b066-43e8ec9a1b98 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:41.133458 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7757e4-08d4-48e5-b066-43e8ec9a1b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:41.134815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7757e4-08d4-48e5-b066-43e8ec9a1b98 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:41.140856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 449/869] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:09:40 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:41.141701 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7757e4-08d4-48e5-b066-43e8ec9a1b98 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:41.166176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d5e8c-bfdd-4154-bbf4-de74b37070e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:41.166900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d5e8c-bfdd-4154-bbf4-de74b37070e1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:41.167176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d5e8c-bfdd-4154-bbf4-de74b37070e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:41.167447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d5e8c-bfdd-4154-bbf4-de74b37070e1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:41.176584 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d5e8c-bfdd-4154-bbf4-de74b37070e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:41.178279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d5e8c-bfdd-4154-bbf4-de74b37070e1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-419d5e8c-bfdd-4154-bbf4-de74b37070e1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:41.191530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:41.193236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:41.195488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:41.195488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:41.195488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:41.195488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:41.195488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:41.195488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:41.195488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:41.195488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:41.195488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 16:09:41.195488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:41.195488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 421/870] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 21 16:09:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:41.195488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba8ccb-7a71-44ce-a443-a2592f2d6acf None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:41.195488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba8ccb-7a71-44ce-a443-a2592f2d6acf None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:41.197776 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba8ccb-7a71-44ce-a443-a2592f2d6acf None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:41.197776 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 422/871] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:41.202353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec4e57-68d2-4f13-806b-d82b46e5917d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:41.202729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec4e57-68d2-4f13-806b-d82b46e5917d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:41.202920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec4e57-68d2-4f13-806b-d82b46e5917d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:41.212444 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:41.227009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b8ec4e57-68d2-4f13-806b-d82b46e5917d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:41.228721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b8ec4e57-68d2-4f13-806b-d82b46e5917d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:41.332409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7757e4-08d4-48e5-b066-43e8ec9a1b98 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:41.337608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 423/872] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:09:41.338983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec4e57-68d2-4f13-806b-d82b46e5917d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:41.412426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d182e3-dfeb-40b1-a788-a7df0a593834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:41.413736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d182e3-dfeb-40b1-a788-a7df0a593834 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:41.414142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d182e3-dfeb-40b1-a788-a7df0a593834 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:41.414539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d182e3-dfeb-40b1-a788-a7df0a593834 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:41.416155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d182e3-dfeb-40b1-a788-a7df0a593834 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:41.416638 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d182e3-dfeb-40b1-a788-a7df0a593834 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:41.418381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d182e3-dfeb-40b1-a788-a7df0a593834 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:41.438697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 450/873] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:41.453112 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d182e3-dfeb-40b1-a788-a7df0a593834 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:41.520412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:41.573886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec4e57-68d2-4f13-806b-d82b46e5917d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:41.637102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:41.648176 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d182e3-dfeb-40b1-a788-a7df0a593834 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:41.649344 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff0381-1b99-4a9b-bee2-33c0326373ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:41.650247 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff0381-1b99-4a9b-bee2-33c0326373ee None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:41.650670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff0381-1b99-4a9b-bee2-33c0326373ee None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:41.651169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff0381-1b99-4a9b-bee2-33c0326373ee None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:41.652343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff0381-1b99-4a9b-bee2-33c0326373ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:41.652723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff0381-1b99-4a9b-bee2-33c0326373ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:41.654279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff0381-1b99-4a9b-bee2-33c0326373ee None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:41.676777 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 424/874] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 21 16:09:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:41.678126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff0381-1b99-4a9b-bee2-33c0326373ee None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:41.703869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fce33e-8e66-472d-9ff0-7f11205e3a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:41.705095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fce33e-8e66-472d-9ff0-7f11205e3a99 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:41.705553 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fce33e-8e66-472d-9ff0-7f11205e3a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:41.705994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fce33e-8e66-472d-9ff0-7f11205e3a99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:41.707236 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fce33e-8e66-472d-9ff0-7f11205e3a99 None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=0b28aaefcb154b228987362921f6476b) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:41.707738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fce33e-8e66-472d-9ff0-7f11205e3a99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:41.710833 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fce33e-8e66-472d-9ff0-7f11205e3a99 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:41.721503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 451/875] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:09:41 2022] GET /identity/v3/role_assignments?user.id=0b28aaefcb154b228987362921f6476b&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=beec000223e041209205627bfa0dbed1 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:41.722944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fce33e-8e66-472d-9ff0-7f11205e3a99 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:41.858057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff0381-1b99-4a9b-bee2-33c0326373ee None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:41.907868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fce33e-8e66-472d-9ff0-7f11205e3a99 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:41.931559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd059f5-6bb3-4d88-bf91-165c0da296bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:41.933221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd059f5-6bb3-4d88-bf91-165c0da296bb None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:41.933221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd059f5-6bb3-4d88-bf91-165c0da296bb None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:41.933522 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd059f5-6bb3-4d88-bf91-165c0da296bb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:41.934763 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd059f5-6bb3-4d88-bf91-165c0da296bb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:41.937214 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd059f5-6bb3-4d88-bf91-165c0da296bb None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:41.942085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-cbd059f5-6bb3-4d88-bf91-165c0da296bb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:41.954320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:41.955430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:41.956350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 425/876] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Sep 21 16:09:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:41.960881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd059f5-6bb3-4d88-bf91-165c0da296bb None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:41.966215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892d33b-92e2-4dfa-bd5e-160354379cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:41.966447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892d33b-92e2-4dfa-bd5e-160354379cbe None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:41.966731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892d33b-92e2-4dfa-bd5e-160354379cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:41.967145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892d33b-92e2-4dfa-bd5e-160354379cbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:42.017544 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:42.107352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892d33b-92e2-4dfa-bd5e-160354379cbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:42.111671 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892d33b-92e2-4dfa-bd5e-160354379cbe None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:42.172623 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd059f5-6bb3-4d88-bf91-165c0da296bb None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:42.242115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b6c96-cb10-4708-8a5f-f2e6b2b76dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:42.243175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b6c96-cb10-4708-8a5f-f2e6b2b76dca None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:42.243664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b6c96-cb10-4708-8a5f-f2e6b2b76dca None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:42.244144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b6c96-cb10-4708-8a5f-f2e6b2b76dca None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:42.245398 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b6c96-cb10-4708-8a5f-f2e6b2b76dca None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:42.245930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b6c96-cb10-4708-8a5f-f2e6b2b76dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:42.249277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b6c96-cb10-4708-8a5f-f2e6b2b76dca None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:42.262249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 426/877] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 21 16:09:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:42.267601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b6c96-cb10-4708-8a5f-f2e6b2b76dca None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:42.352210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 452/878] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:09:41 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:09:42.357910 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892d33b-92e2-4dfa-bd5e-160354379cbe None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:42.402768 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:42.424827 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:42.473064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892d33b-92e2-4dfa-bd5e-160354379cbe None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:42.486482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b6c96-cb10-4708-8a5f-f2e6b2b76dca None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:42.512880 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a0f7d-970d-4c6b-a5af-6cd4b2366910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:42.513345 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0f7d-970d-4c6b-a5af-6cd4b2366910 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:42.513626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0f7d-970d-4c6b-a5af-6cd4b2366910 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:42.513898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0f7d-970d-4c6b-a5af-6cd4b2366910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:42.526186 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a0f7d-970d-4c6b-a5af-6cd4b2366910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:42.527648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a0f7d-970d-4c6b-a5af-6cd4b2366910 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-437a0f7d-970d-4c6b-a5af-6cd4b2366910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:42.544658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:42.546516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:42.548343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:42.548343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:42.548343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:42.550535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 453/879] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:42.552023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a0f7d-970d-4c6b-a5af-6cd4b2366910 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:42.568723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5f4b3-e73f-46c3-b778-1251f5bc0704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:42.568723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5f4b3-e73f-46c3-b778-1251f5bc0704 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:42.568723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5f4b3-e73f-46c3-b778-1251f5bc0704 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:42.568723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5f4b3-e73f-46c3-b778-1251f5bc0704 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:42.569395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5f4b3-e73f-46c3-b778-1251f5bc0704 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:42.569395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5f4b3-e73f-46c3-b778-1251f5bc0704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:42.569395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5f4b3-e73f-46c3-b778-1251f5bc0704 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:42.577348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 427/880] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 21 16:09:42 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:42.730165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a0f7d-970d-4c6b-a5af-6cd4b2366910 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:42.751999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:42.800496 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b3fe3-a0c1-43be-9ccb-70ad25f5a724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:42.801528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b3fe3-a0c1-43be-9ccb-70ad25f5a724 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:42.801996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b3fe3-a0c1-43be-9ccb-70ad25f5a724 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:42.802448 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b3fe3-a0c1-43be-9ccb-70ad25f5a724 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:42.803540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b3fe3-a0c1-43be-9ccb-70ad25f5a724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:42.804706 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b3fe3-a0c1-43be-9ccb-70ad25f5a724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:42.807150 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b3fe3-a0c1-43be-9ccb-70ad25f5a724 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:42.830660 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 454/881] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:42.838022 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5f4b3-e73f-46c3-b778-1251f5bc0704 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:43.041461 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5f4b3-e73f-46c3-b778-1251f5bc0704 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:43.091407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:43.110435 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f3f37-105d-4a4f-91c5-4716ecc4774d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:43.111593 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f3f37-105d-4a4f-91c5-4716ecc4774d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:43.112078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f3f37-105d-4a4f-91c5-4716ecc4774d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:43.112552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f3f37-105d-4a4f-91c5-4716ecc4774d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:43.127503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f3f37-105d-4a4f-91c5-4716ecc4774d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:43.130362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f3f37-105d-4a4f-91c5-4716ecc4774d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-ea8f3f37-105d-4a4f-91c5-4716ecc4774d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:43.153904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:43.155604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:43.157365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:43.157365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:43.157365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:43.157365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:43.157365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:43.157365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:43.157365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:43.157365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:43.160823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 428/882] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:43.166397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b3fe3-a0c1-43be-9ccb-70ad25f5a724 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:43.356395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b3fe3-a0c1-43be-9ccb-70ad25f5a724 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:43.418736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb04b8-643b-4e10-806c-f27f1e6dbd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:43.419751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb04b8-643b-4e10-806c-f27f1e6dbd9f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:43.420231 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb04b8-643b-4e10-806c-f27f1e6dbd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:43.420719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb04b8-643b-4e10-806c-f27f1e6dbd9f None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:43.421980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb04b8-643b-4e10-806c-f27f1e6dbd9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:43.422519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb04b8-643b-4e10-806c-f27f1e6dbd9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:43.425188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb04b8-643b-4e10-806c-f27f1e6dbd9f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:43.447964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 455/883] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:43.457517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f3f37-105d-4a4f-91c5-4716ecc4774d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:43.647599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f3f37-105d-4a4f-91c5-4716ecc4774d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:43.717362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d0bdc-645c-461a-be5c-e86caaee519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:43.718876 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d0bdc-645c-461a-be5c-e86caaee519a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:43.719719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d0bdc-645c-461a-be5c-e86caaee519a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:43.720476 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d0bdc-645c-461a-be5c-e86caaee519a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:43.722152 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d0bdc-645c-461a-be5c-e86caaee519a None admin] RBAC: Adding query filter params (role.id=ac5c4a11a0f94428ac80cfb9130336f0, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=5e20281883414eed9d644e0eaab2ac49) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:43.723001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d0bdc-645c-461a-be5c-e86caaee519a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:43.726078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d0bdc-645c-461a-be5c-e86caaee519a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:43.744763 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 429/884] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:09:43 2022] GET /identity/v3/role_assignments?user.id=5e20281883414eed9d644e0eaab2ac49&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=ac5c4a11a0f94428ac80cfb9130336f0 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:44.671489 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260e98c-8340-475b-bc8c-1ab015c0db06 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:44.673088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260e98c-8340-475b-bc8c-1ab015c0db06 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:44.673870 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260e98c-8340-475b-bc8c-1ab015c0db06 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:44.676839 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 456/885] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:44.689284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301887e7-c20e-4a8a-b861-063830cd6b44 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:44.690926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301887e7-c20e-4a8a-b861-063830cd6b44 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:44.691699 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301887e7-c20e-4a8a-b861-063830cd6b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:44.728310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-301887e7-c20e-4a8a-b861-063830cd6b44 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:44.730677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-301887e7-c20e-4a8a-b861-063830cd6b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:44.805909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc68b7f-8478-4c29-a903-271b1426d95f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:44.806827 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc68b7f-8478-4c29-a903-271b1426d95f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:44.807583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc68b7f-8478-4c29-a903-271b1426d95f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:44.810652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 457/886] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:44.815854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06235929-3283-41ac-bd98-b998885c4672 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:44.816435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06235929-3283-41ac-bd98-b998885c4672 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:44.816942 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06235929-3283-41ac-bd98-b998885c4672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:44.817490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:44.839498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-06235929-3283-41ac-bd98-b998885c4672 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:44.841145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-06235929-3283-41ac-bd98-b998885c4672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:44.858101 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 430/887] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:44.877695 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:44.924370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 458/888] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:45.211906 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301887e7-c20e-4a8a-b861-063830cd6b44 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:45.328913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301887e7-c20e-4a8a-b861-063830cd6b44 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:45.369058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06235929-3283-41ac-bd98-b998885c4672 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:45.372067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad106c-63a1-4eaf-b5ce-20ba31ef38c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:45.373185 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad106c-63a1-4eaf-b5ce-20ba31ef38c6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:45.373677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad106c-63a1-4eaf-b5ce-20ba31ef38c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:45.374154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad106c-63a1-4eaf-b5ce-20ba31ef38c6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:45.375208 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad106c-63a1-4eaf-b5ce-20ba31ef38c6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:45.377805 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad106c-63a1-4eaf-b5ce-20ba31ef38c6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-5aad106c-63a1-4eaf-b5ce-20ba31ef38c6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:45.401620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:45.402725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:45.403591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:45.403591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:45.403591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:45.403591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:45.403591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:45.403591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:45.403591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:45.403591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:45.403591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:45.403591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:45.403591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:45.403591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:45.403591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:09:45.403591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:45.405069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 431/889] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 21 16:09:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:45.414979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad106c-63a1-4eaf-b5ce-20ba31ef38c6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:45.483534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:45.508422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06235929-3283-41ac-bd98-b998885c4672 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:45.555029 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb794-da1c-40d3-aa71-60d5cac8edd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:45.556034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb794-da1c-40d3-aa71-60d5cac8edd8 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:45.556854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb794-da1c-40d3-aa71-60d5cac8edd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:45.557420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb794-da1c-40d3-aa71-60d5cac8edd8 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:45.558314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffb794-da1c-40d3-aa71-60d5cac8edd8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:45.559945 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffb794-da1c-40d3-aa71-60d5cac8edd8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:45.572726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad106c-63a1-4eaf-b5ce-20ba31ef38c6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:45.581984 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 459/890] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 21 16:09:45 2022] POST /identity/v3/services => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:09:45.657939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244d143-cd7c-4b29-9989-5eadb002c4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:45.659740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244d143-cd7c-4b29-9989-5eadb002c4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:45.660544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244d143-cd7c-4b29-9989-5eadb002c4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:45.661387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244d143-cd7c-4b29-9989-5eadb002c4e1 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:45.662797 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244d143-cd7c-4b29-9989-5eadb002c4e1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:45.664204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244d143-cd7c-4b29-9989-5eadb002c4e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:45.667479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244d143-cd7c-4b29-9989-5eadb002c4e1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:45.677583 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 432/891] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 21 16:09:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:45.688483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb794-da1c-40d3-aa71-60d5cac8edd8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:45.718401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:45.812922 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb794-da1c-40d3-aa71-60d5cac8edd8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:45.855078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb30204-9dd5-414e-a04b-c28f5b3e6f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:45.856113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb30204-9dd5-414e-a04b-c28f5b3e6f45 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:45.856643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb30204-9dd5-414e-a04b-c28f5b3e6f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:45.857196 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb30204-9dd5-414e-a04b-c28f5b3e6f45 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:45.858175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb30204-9dd5-414e-a04b-c28f5b3e6f45 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:45.858746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb30204-9dd5-414e-a04b-c28f5b3e6f45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:45.860605 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb30204-9dd5-414e-a04b-c28f5b3e6f45 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:45.867549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 460/892] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 21 16:09:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:46.147943 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc88511-c56a-4c3b-8942-4be81816eb74 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:46.148758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc88511-c56a-4c3b-8942-4be81816eb74 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:46.148989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc88511-c56a-4c3b-8942-4be81816eb74 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:46.151896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 433/893] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:46.160175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b96bb1-804e-40be-bcc8-21e7694271fe None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:46.160836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b96bb1-804e-40be-bcc8-21e7694271fe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:46.161483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b96bb1-804e-40be-bcc8-21e7694271fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:46.188831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b9b96bb1-804e-40be-bcc8-21e7694271fe None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:46.191381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b9b96bb1-804e-40be-bcc8-21e7694271fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:46.312236 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 461/894] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:09:46.630693 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e9bb-4b9d-4682-9345-d8c0be8961c7 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:46.631054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e9bb-4b9d-4682-9345-d8c0be8961c7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:46.631271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e9bb-4b9d-4682-9345-d8c0be8961c7 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:46.633538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 434/895] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:46.639293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0cd5e-17ee-4b7f-a511-085575336afc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:46.639590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0cd5e-17ee-4b7f-a511-085575336afc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:46.639886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0cd5e-17ee-4b7f-a511-085575336afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:46.659806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a1a0cd5e-17ee-4b7f-a511-085575336afc None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:46.661070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a1a0cd5e-17ee-4b7f-a511-085575336afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:46.673203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:46.744887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 462/896] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:46.794196 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e9bb-4b9d-4682-9345-d8c0be8961c7 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:46.991568 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e9bb-4b9d-4682-9345-d8c0be8961c7 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:46.996203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:47.018916 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0cd5e-17ee-4b7f-a511-085575336afc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:47.052900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a767ce-93a5-4b7f-8722-991c0e2752a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:47.053992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a767ce-93a5-4b7f-8722-991c0e2752a3 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:47.054277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a767ce-93a5-4b7f-8722-991c0e2752a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:47.054702 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a767ce-93a5-4b7f-8722-991c0e2752a3 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:47.055477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a767ce-93a5-4b7f-8722-991c0e2752a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:47.057164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a767ce-93a5-4b7f-8722-991c0e2752a3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:47.077028 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 435/897] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 21 16:09:46 2022] POST /identity/v3/services => generated 269 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:09:47.163835 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0cd5e-17ee-4b7f-a511-085575336afc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:47.214961 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ea565-0f85-4d92-819b-0c3c819ccc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:47.215628 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea565-0f85-4d92-819b-0c3c819ccc08 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:47.215900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea565-0f85-4d92-819b-0c3c819ccc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:47.216170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea565-0f85-4d92-819b-0c3c819ccc08 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:47.226716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:47.231172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ea565-0f85-4d92-819b-0c3c819ccc08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-631ea565-0f85-4d92-819b-0c3c819ccc08 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:47.236285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:47.237386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:47.238238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:47.238238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:47.238238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:47.238238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:47.238238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:47.238238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:47.238238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:47.238238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:47.238238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:47.238238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:47.238238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 16:09:47.238238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:47.238238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 463/898] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 21 16:09:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:47.246312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a767ce-93a5-4b7f-8722-991c0e2752a3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:47.437909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a767ce-93a5-4b7f-8722-991c0e2752a3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:47.496790 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904a2cd-4705-46f7-b758-6866448992e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:47.497644 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904a2cd-4705-46f7-b758-6866448992e4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:47.498153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904a2cd-4705-46f7-b758-6866448992e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:47.498639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904a2cd-4705-46f7-b758-6866448992e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:47.499869 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904a2cd-4705-46f7-b758-6866448992e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:47.500417 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904a2cd-4705-46f7-b758-6866448992e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:47.502940 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904a2cd-4705-46f7-b758-6866448992e4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:47.519625 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 436/899] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 21 16:09:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:47.525691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ea565-0f85-4d92-819b-0c3c819ccc08 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:47.708082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ea565-0f85-4d92-819b-0c3c819ccc08 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:47.775649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbef9f-5c2d-44be-8b33-326c5ed1be9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:47.776718 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbef9f-5c2d-44be-8b33-326c5ed1be9d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:47.777226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbef9f-5c2d-44be-8b33-326c5ed1be9d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:47.777715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbef9f-5c2d-44be-8b33-326c5ed1be9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:47.798248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbef9f-5c2d-44be-8b33-326c5ed1be9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:47.801207 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbef9f-5c2d-44be-8b33-326c5ed1be9d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a1dbef9f-5c2d-44be-8b33-326c5ed1be9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:47.830725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:47.833019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:47.835551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:47.835551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:47.835551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:47.835551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 464/900] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:47.839870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904a2cd-4705-46f7-b758-6866448992e4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:47.893005 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:48.034297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904a2cd-4705-46f7-b758-6866448992e4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:48.108067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42d450-1651-4a2e-b8d5-4d66b24f10d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:48.109206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42d450-1651-4a2e-b8d5-4d66b24f10d5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:48.109723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42d450-1651-4a2e-b8d5-4d66b24f10d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:48.110219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42d450-1651-4a2e-b8d5-4d66b24f10d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:48.111167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42d450-1651-4a2e-b8d5-4d66b24f10d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:48.111728 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42d450-1651-4a2e-b8d5-4d66b24f10d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:48.114493 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42d450-1651-4a2e-b8d5-4d66b24f10d5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:48.139378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 437/901] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:48.144999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbef9f-5c2d-44be-8b33-326c5ed1be9d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:48.187495 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca54f96-3151-457f-bf1c-8dc51a845438 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:48.187849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca54f96-3151-457f-bf1c-8dc51a845438 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:48.188028 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca54f96-3151-457f-bf1c-8dc51a845438 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:48.189842 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 438/902] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:48.195707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcf8ad-f2be-4372-9d5b-c218a20ef4c6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:48.196034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcf8ad-f2be-4372-9d5b-c218a20ef4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:48.196238 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcf8ad-f2be-4372-9d5b-c218a20ef4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:48.217738 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-64dcf8ad-f2be-4372-9d5b-c218a20ef4c6 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:48.218991 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-64dcf8ad-f2be-4372-9d5b-c218a20ef4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:48.256547 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:48.312835 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbef9f-5c2d-44be-8b33-326c5ed1be9d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:48.335533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 439/903] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:09:48.337735 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359fc5-618d-4bad-bcf7-a6db4a698469 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:48.338064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359fc5-618d-4bad-bcf7-a6db4a698469 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:48.338337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359fc5-618d-4bad-bcf7-a6db4a698469 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:48.340087 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 440/904] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:48.351081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16662971-d39f-45d8-a11e-f58849b94d5a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:48.351526 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16662971-d39f-45d8-a11e-f58849b94d5a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:48.351785 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16662971-d39f-45d8-a11e-f58849b94d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:48.371619 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-16662971-d39f-45d8-a11e-f58849b94d5a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:48.372939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-16662971-d39f-45d8-a11e-f58849b94d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:48.374391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db98866-0229-4c6c-9b1f-906fab3ac611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:48.375386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db98866-0229-4c6c-9b1f-906fab3ac611 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:48.375644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db98866-0229-4c6c-9b1f-906fab3ac611 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:48.376079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db98866-0229-4c6c-9b1f-906fab3ac611 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:48.386529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db98866-0229-4c6c-9b1f-906fab3ac611 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:48.388330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db98866-0229-4c6c-9b1f-906fab3ac611 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4db98866-0229-4c6c-9b1f-906fab3ac611 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:48.401971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:48.403819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:48.405675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:48.405675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:48.405675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:48.405675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:48.405675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:48.405675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:48.405675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:48.405675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:48.405675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 16:09:48.405675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:48.405675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 465/905] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 21 16:09:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:48.409072 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db98866-0229-4c6c-9b1f-906fab3ac611 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:48.441119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:48.528113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db98866-0229-4c6c-9b1f-906fab3ac611 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:48.531670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 441/906] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:48.552853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:48.580418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23eda6-698c-4e3f-b305-7aa8b295f534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:48.580994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23eda6-698c-4e3f-b305-7aa8b295f534 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:48.581276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23eda6-698c-4e3f-b305-7aa8b295f534 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:48.581546 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23eda6-698c-4e3f-b305-7aa8b295f534 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:48.582302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23eda6-698c-4e3f-b305-7aa8b295f534 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:48.582611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23eda6-698c-4e3f-b305-7aa8b295f534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:48.584099 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23eda6-698c-4e3f-b305-7aa8b295f534 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:48.605285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 466/907] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 21 16:09:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:48.611067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16662971-d39f-45d8-a11e-f58849b94d5a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:48.624375 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23eda6-698c-4e3f-b305-7aa8b295f534 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:48.740373 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23eda6-698c-4e3f-b305-7aa8b295f534 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:48.760292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16662971-d39f-45d8-a11e-f58849b94d5a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:48.786776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c6150-ace2-4b95-a7d3-fab839397bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:48.787415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c6150-ace2-4b95-a7d3-fab839397bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:48.787808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c6150-ace2-4b95-a7d3-fab839397bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:48.788718 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c6150-ace2-4b95-a7d3-fab839397bd0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:48.793222 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c6150-ace2-4b95-a7d3-fab839397bd0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:48.796715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c6150-ace2-4b95-a7d3-fab839397bd0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-576c6150-ace2-4b95-a7d3-fab839397bd0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:48.808479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:48.809655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:48.810509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 467/908] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:09:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:48.811343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c6150-ace2-4b95-a7d3-fab839397bd0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:48.816052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34609a83-b8b9-44c3-8f38-71e979e6fc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:48.816813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34609a83-b8b9-44c3-8f38-71e979e6fc35 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:48.817147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34609a83-b8b9-44c3-8f38-71e979e6fc35 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:48.817424 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34609a83-b8b9-44c3-8f38-71e979e6fc35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:48.830072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34609a83-b8b9-44c3-8f38-71e979e6fc35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:48.831598 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34609a83-b8b9-44c3-8f38-71e979e6fc35 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:48.841124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-34609a83-b8b9-44c3-8f38-71e979e6fc35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:48.849835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:48.851474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:48.852372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:48.852372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:48.852372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:48.852372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 442/909] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:48.853446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:48.854269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34609a83-b8b9-44c3-8f38-71e979e6fc35 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:48.932823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c6150-ace2-4b95-a7d3-fab839397bd0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:48.970598 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34609a83-b8b9-44c3-8f38-71e979e6fc35 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:48.974578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da46e9-17c1-4c62-9657-3cfe033b473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:48.975202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da46e9-17c1-4c62-9657-3cfe033b473e None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:48.976016 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da46e9-17c1-4c62-9657-3cfe033b473e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:48.976290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da46e9-17c1-4c62-9657-3cfe033b473e None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:48.976986 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da46e9-17c1-4c62-9657-3cfe033b473e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:48.978366 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da46e9-17c1-4c62-9657-3cfe033b473e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:48.994971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 468/910] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 21 16:09:48 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:09:49.002124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da46e9-17c1-4c62-9657-3cfe033b473e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:49.020918 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b742c4-65ce-4795-b9ac-00d048fd68e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:49.022183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b742c4-65ce-4795-b9ac-00d048fd68e9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:49.022183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b742c4-65ce-4795-b9ac-00d048fd68e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:49.022183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b742c4-65ce-4795-b9ac-00d048fd68e9 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:49.023741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b742c4-65ce-4795-b9ac-00d048fd68e9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:49.024215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b742c4-65ce-4795-b9ac-00d048fd68e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:49.026185 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b742c4-65ce-4795-b9ac-00d048fd68e9 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:49.032622 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 443/911] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:09:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:49.038591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b742c4-65ce-4795-b9ac-00d048fd68e9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:49.131554 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:49.159044 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:49.172215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da46e9-17c1-4c62-9657-3cfe033b473e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:49.217323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca65c71-3c59-4622-9026-96097ef4afc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:49.218370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca65c71-3c59-4622-9026-96097ef4afc9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:49.219070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca65c71-3c59-4622-9026-96097ef4afc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:49.219351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca65c71-3c59-4622-9026-96097ef4afc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:49.220024 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca65c71-3c59-4622-9026-96097ef4afc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:49.220328 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca65c71-3c59-4622-9026-96097ef4afc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:49.221825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca65c71-3c59-4622-9026-96097ef4afc9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:49.224893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b742c4-65ce-4795-b9ac-00d048fd68e9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:49.236028 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 469/912] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:49.242427 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca65c71-3c59-4622-9026-96097ef4afc9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:49.291329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7d4a8-ce98-48e0-8aee-aaf061da433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:49.291960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7d4a8-ce98-48e0-8aee-aaf061da433f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:49.292238 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7d4a8-ce98-48e0-8aee-aaf061da433f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:49.292507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7d4a8-ce98-48e0-8aee-aaf061da433f None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:49.293275 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7d4a8-ce98-48e0-8aee-aaf061da433f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:49.293581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7d4a8-ce98-48e0-8aee-aaf061da433f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:49.294982 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7d4a8-ce98-48e0-8aee-aaf061da433f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:49.300708 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 444/913] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:09:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:49.307253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7d4a8-ce98-48e0-8aee-aaf061da433f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:49.364851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca65c71-3c59-4622-9026-96097ef4afc9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:49.406926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97999ccc-fd7c-4fce-9805-a08235ee1308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:49.407912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97999ccc-fd7c-4fce-9805-a08235ee1308 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:49.408398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97999ccc-fd7c-4fce-9805-a08235ee1308 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:49.408917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97999ccc-fd7c-4fce-9805-a08235ee1308 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:49.418760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97999ccc-fd7c-4fce-9805-a08235ee1308 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:49.420544 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97999ccc-fd7c-4fce-9805-a08235ee1308 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-97999ccc-fd7c-4fce-9805-a08235ee1308 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:49.435069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:49.436048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:49.437035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:49.437035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:49.437035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:49.437035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:49.437035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:49.437035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:49.437035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:49.437035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:49.444116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 470/914] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:49.446875 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97999ccc-fd7c-4fce-9805-a08235ee1308 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:49.479435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:49.497574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7d4a8-ce98-48e0-8aee-aaf061da433f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:49.527156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:49.553094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780957f0-9183-4680-a54f-8b7a7f03769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:49.554454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780957f0-9183-4680-a54f-8b7a7f03769b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:49.555134 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780957f0-9183-4680-a54f-8b7a7f03769b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:49.555930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780957f0-9183-4680-a54f-8b7a7f03769b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:49.557669 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780957f0-9183-4680-a54f-8b7a7f03769b None admin] RBAC: Adding query filter params (interface=public, service_id=8d12a9d403b44bff87cb12d632c22873, region_id=RegionOne) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:49.558489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780957f0-9183-4680-a54f-8b7a7f03769b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:49.561629 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780957f0-9183-4680-a54f-8b7a7f03769b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:49.573227 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 445/915] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 21 16:09:49 2022] GET /identity/v3/endpoints?service_id=8d12a9d403b44bff87cb12d632c22873&interface=public®ion_id=RegionOne => generated 194 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:49.580854 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780957f0-9183-4680-a54f-8b7a7f03769b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:49.610405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97999ccc-fd7c-4fce-9805-a08235ee1308 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:49.650057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc73b21-53fc-4272-bb37-7d87a9c21f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:49.650681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc73b21-53fc-4272-bb37-7d87a9c21f31 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:49.650960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc73b21-53fc-4272-bb37-7d87a9c21f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:49.651249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc73b21-53fc-4272-bb37-7d87a9c21f31 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:49.653856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc73b21-53fc-4272-bb37-7d87a9c21f31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:49.654416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc73b21-53fc-4272-bb37-7d87a9c21f31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:49.657877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc73b21-53fc-4272-bb37-7d87a9c21f31 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:49.684988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 471/916] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:49.690884 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc73b21-53fc-4272-bb37-7d87a9c21f31 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:49.719664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780957f0-9183-4680-a54f-8b7a7f03769b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:49.758221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa829659-fe25-4669-81d6-95608fd9f8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:49.758849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa829659-fe25-4669-81d6-95608fd9f8ae None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:49.759129 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa829659-fe25-4669-81d6-95608fd9f8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:49.759398 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa829659-fe25-4669-81d6-95608fd9f8ae None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:49.760132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa829659-fe25-4669-81d6-95608fd9f8ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:49.761687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa829659-fe25-4669-81d6-95608fd9f8ae None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:49.770150 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:49.773109 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 446/917] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 21 16:09:49 2022] GET /identity/v3/services => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:09:49.775652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130eac88-6d79-4461-b1b3-0f446e9b5b42 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:49.775909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130eac88-6d79-4461-b1b3-0f446e9b5b42 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:49.776180 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130eac88-6d79-4461-b1b3-0f446e9b5b42 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:49.778278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 447/918] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:49.784198 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093df3d6-fc92-4f0f-af59-e760255becb2 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:49.784486 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093df3d6-fc92-4f0f-af59-e760255becb2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:49.784801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093df3d6-fc92-4f0f-af59-e760255becb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:49.810871 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc73b21-53fc-4272-bb37-7d87a9c21f31 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:49.812649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-093df3d6-fc92-4f0f-af59-e760255becb2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:49.814205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-093df3d6-fc92-4f0f-af59-e760255becb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:49.856579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a925e51-a44b-4e52-8635-9a511f3eebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:49.857630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a925e51-a44b-4e52-8635-9a511f3eebe1 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:49.858141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a925e51-a44b-4e52-8635-9a511f3eebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:49.858569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a925e51-a44b-4e52-8635-9a511f3eebe1 None admin] PATH_INFO: `/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/5e20281883414eed9d644e0eaab2ac49/roles/ac5c4a11a0f94428ac80cfb9130336f0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:49.862154 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a925e51-a44b-4e52-8635-9a511f3eebe1 None admin] RBAC: Authorizing `identity:create_grant(project_id=78142a67f69a4ba58113cc7c8dc269b1, user_id=5e20281883414eed9d644e0eaab2ac49, role_id=ac5c4a11a0f94428ac80cfb9130336f0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:49.863956 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a925e51-a44b-4e52-8635-9a511f3eebe1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:49.884788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:49.887379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 472/919] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:09:49 2022] PUT /identity/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/5e20281883414eed9d644e0eaab2ac49/roles/ac5c4a11a0f94428ac80cfb9130336f0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:09:49.917037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 448/920] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:09:50.205793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a925e51-a44b-4e52-8635-9a511f3eebe1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:50.313179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a925e51-a44b-4e52-8635-9a511f3eebe1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:50.351776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a8842-2993-4b36-b693-a35484b1b858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:50.352762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a8842-2993-4b36-b693-a35484b1b858 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:50.353294 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a8842-2993-4b36-b693-a35484b1b858 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:50.353719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a8842-2993-4b36-b693-a35484b1b858 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:50.354493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a8842-2993-4b36-b693-a35484b1b858 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:50.356086 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a8842-2993-4b36-b693-a35484b1b858 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:50.358664 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-712a8842-2993-4b36-b693-a35484b1b858 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:50.367689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:50.368970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:50.370311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 473/921] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Sep 21 16:09:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:50.375700 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093df3d6-fc92-4f0f-af59-e760255becb2 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:50.487771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093df3d6-fc92-4f0f-af59-e760255becb2 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:50.526639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0a87c-3ad0-4910-aa47-2455c65fc266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:50.527287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0a87c-3ad0-4910-aa47-2455c65fc266 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:50.527528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0a87c-3ad0-4910-aa47-2455c65fc266 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:50.527796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0a87c-3ad0-4910-aa47-2455c65fc266 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:50.528436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0a87c-3ad0-4910-aa47-2455c65fc266 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:50.528764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0a87c-3ad0-4910-aa47-2455c65fc266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:50.530229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0a87c-3ad0-4910-aa47-2455c65fc266 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:50.536075 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 449/922] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 21 16:09:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:50.541939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a8842-2993-4b36-b693-a35484b1b858 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:50.654207 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a8842-2993-4b36-b693-a35484b1b858 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:50.690253 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b474ce4-a192-47e5-8154-cad6176a4b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:50.690866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b474ce4-a192-47e5-8154-cad6176a4b43 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:50.691139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b474ce4-a192-47e5-8154-cad6176a4b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:50.691405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b474ce4-a192-47e5-8154-cad6176a4b43 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:50.692100 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b474ce4-a192-47e5-8154-cad6176a4b43 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:50.692401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b474ce4-a192-47e5-8154-cad6176a4b43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:50.693791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b474ce4-a192-47e5-8154-cad6176a4b43 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:50.699943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 474/923] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 21 16:09:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:50.706596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0a87c-3ad0-4910-aa47-2455c65fc266 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:50.761300 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:50.819348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0a87c-3ad0-4910-aa47-2455c65fc266 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:50.856052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d5907-b646-4acf-97bc-7c1e0c19d22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:50.857035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5907-b646-4acf-97bc-7c1e0c19d22b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:50.857464 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5907-b646-4acf-97bc-7c1e0c19d22b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:50.857885 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5907-b646-4acf-97bc-7c1e0c19d22b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:50.858830 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5907-b646-4acf-97bc-7c1e0c19d22b None admin] RBAC: Adding query filter params (interface=public, service_id=41d28ccda6ad4e758615c948b73c6fdb, region_id=RegionOne) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:50.859368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5907-b646-4acf-97bc-7c1e0c19d22b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:50.861010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5907-b646-4acf-97bc-7c1e0c19d22b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:50.867726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 450/924] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 21 16:09:50 2022] GET /identity/v3/endpoints?service_id=41d28ccda6ad4e758615c948b73c6fdb&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:50.874310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b474ce4-a192-47e5-8154-cad6176a4b43 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:50.941393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:50.988659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b474ce4-a192-47e5-8154-cad6176a4b43 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:51.031262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea625ee2-f636-4727-961d-fd7f08e5f633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:51.032184 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea625ee2-f636-4727-961d-fd7f08e5f633 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:51.032673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea625ee2-f636-4727-961d-fd7f08e5f633 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:51.033209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea625ee2-f636-4727-961d-fd7f08e5f633 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:51.034049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea625ee2-f636-4727-961d-fd7f08e5f633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:51.035632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea625ee2-f636-4727-961d-fd7f08e5f633 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:51.043085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 475/925] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 21 16:09:50 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:09:52.210462 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4af1-a408-434f-a706-2c477e433eae None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:52.210991 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4af1-a408-434f-a706-2c477e433eae None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:52.210991 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4af1-a408-434f-a706-2c477e433eae None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:52.212783 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 451/926] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:52.218978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bfae8-1d3f-4588-bd16-b288cf17af6d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:52.219501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bfae8-1d3f-4588-bd16-b288cf17af6d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:52.219501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bfae8-1d3f-4588-bd16-b288cf17af6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:52.239894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-356bfae8-1d3f-4588-bd16-b288cf17af6d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:52.241695 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-356bfae8-1d3f-4588-bd16-b288cf17af6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:52.324066 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 476/927] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:52.507523 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94271d53-6841-45f0-94e3-f3adfdd58ec6 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:52.507703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94271d53-6841-45f0-94e3-f3adfdd58ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:52.507982 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94271d53-6841-45f0-94e3-f3adfdd58ec6 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:52.509829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 452/928] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:52.515706 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf78fe-4ea6-406c-ac2f-27b9268f897b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:52.516373 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf78fe-4ea6-406c-ac2f-27b9268f897b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:52.516889 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf78fe-4ea6-406c-ac2f-27b9268f897b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:52.534852 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073a23-207e-4d79-bc5f-383c37a2e318 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:52.535197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073a23-207e-4d79-bc5f-383c37a2e318 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:52.535399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073a23-207e-4d79-bc5f-383c37a2e318 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:52.537064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 453/929] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:09:52.539138 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9faf78fe-4ea6-406c-ac2f-27b9268f897b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:52.540635 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9faf78fe-4ea6-406c-ac2f-27b9268f897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:52.543700 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9b23-c867-45be-b1dc-d97e8be902b5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:52.543987 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9b23-c867-45be-b1dc-d97e8be902b5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:52.544259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9b23-c867-45be-b1dc-d97e8be902b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:52.570230 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-053a9b23-c867-45be-b1dc-d97e8be902b5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:52.571760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-053a9b23-c867-45be-b1dc-d97e8be902b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:52.601727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:52.622557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 477/930] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:09:52.623353 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf78fe-4ea6-406c-ac2f-27b9268f897b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:52.680859 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 454/931] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:09:52.740396 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf78fe-4ea6-406c-ac2f-27b9268f897b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:52.790192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2fb2c-45ab-4199-b893-fe051be9d4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:52.791248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2fb2c-45ab-4199-b893-fe051be9d4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:52.791729 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2fb2c-45ab-4199-b893-fe051be9d4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:52.792286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2fb2c-45ab-4199-b893-fe051be9d4e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:52.807361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2fb2c-45ab-4199-b893-fe051be9d4e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-18e2fb2c-45ab-4199-b893-fe051be9d4e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:09:52.813256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:52.814585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:52.816675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:52.816675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:52.816675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:52.816675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:52.816675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:09:52.816675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:09:52.816675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:09:52.816675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:09:52.816675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:09:52.816675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:09:52.816675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 16:09:52.816675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:52.824856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 478/932] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 21 16:09:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:52.830980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a9b23-c867-45be-b1dc-d97e8be902b5 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:52.897770 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:52.905763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2fb2c-45ab-4199-b893-fe051be9d4e8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:53.001622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:53.007908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a9b23-c867-45be-b1dc-d97e8be902b5 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:53.075065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2fb2c-45ab-4199-b893-fe051be9d4e8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:53.085353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a4b31-0dfc-411e-b18b-ea366af10b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:53.085995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a4b31-0dfc-411e-b18b-ea366af10b27 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:53.086291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a4b31-0dfc-411e-b18b-ea366af10b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:53.087130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a4b31-0dfc-411e-b18b-ea366af10b27 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:53.087874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a4b31-0dfc-411e-b18b-ea366af10b27 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:53.088175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a4b31-0dfc-411e-b18b-ea366af10b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:53.090817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a4b31-0dfc-411e-b18b-ea366af10b27 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:53.107473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 455/933] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 21 16:09:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:53.109327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a4b31-0dfc-411e-b18b-ea366af10b27 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:53.121110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecf3bf-30b1-4e85-8503-544434ab1819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:53.121753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf3bf-30b1-4e85-8503-544434ab1819 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:53.122027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf3bf-30b1-4e85-8503-544434ab1819 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:53.122291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf3bf-30b1-4e85-8503-544434ab1819 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:53.122933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecf3bf-30b1-4e85-8503-544434ab1819 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:53.124366 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecf3bf-30b1-4e85-8503-544434ab1819 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d3ecf3bf-30b1-4e85-8503-544434ab1819 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:53.134497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:53.135569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:53.137195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 479/934] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 21 16:09:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:53.138134 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecf3bf-30b1-4e85-8503-544434ab1819 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:53.238139 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:53.242709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a4b31-0dfc-411e-b18b-ea366af10b27 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:53.280613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecf3bf-30b1-4e85-8503-544434ab1819 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:53.288376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddde25-0fa7-46c9-a99c-cbb78ded5f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:53.289326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddde25-0fa7-46c9-a99c-cbb78ded5f5f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:53.289924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddde25-0fa7-46c9-a99c-cbb78ded5f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:53.290320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddde25-0fa7-46c9-a99c-cbb78ded5f5f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:53.291116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddde25-0fa7-46c9-a99c-cbb78ded5f5f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:53.292951 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddde25-0fa7-46c9-a99c-cbb78ded5f5f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:53.294491 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-9eddde25-0fa7-46c9-a99c-cbb78ded5f5f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:53.309441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:53.311229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:53.312138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:53.312138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:53.312138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:53.312138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:53.312138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:53.312138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:53.312138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:53.312138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:53.312138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:53.312138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:53.312138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:53.312138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:53.312138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 16:09:53.312138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:53.313822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 456/935] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:09:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:53.315806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddde25-0fa7-46c9-a99c-cbb78ded5f5f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:53.331481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda61ac-3c17-43cb-8161-814f83a2c0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:53.331890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda61ac-3c17-43cb-8161-814f83a2c0ac None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:53.332202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda61ac-3c17-43cb-8161-814f83a2c0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:53.332462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda61ac-3c17-43cb-8161-814f83a2c0ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:53.345928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda61ac-3c17-43cb-8161-814f83a2c0ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:53.347405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda61ac-3c17-43cb-8161-814f83a2c0ac None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3fda61ac-3c17-43cb-8161-814f83a2c0ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:53.365317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:53.367734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:53.369825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:53.369825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:53.369825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:53.371947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 480/936] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:53.373163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda61ac-3c17-43cb-8161-814f83a2c0ac None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:53.447955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddde25-0fa7-46c9-a99c-cbb78ded5f5f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:53.493428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d4637-397b-4810-832e-01fb49136f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:53.494153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d4637-397b-4810-832e-01fb49136f18 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:53.497174 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d4637-397b-4810-832e-01fb49136f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:53.497474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d4637-397b-4810-832e-01fb49136f18 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:53.498273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d4637-397b-4810-832e-01fb49136f18 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:53.498580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d4637-397b-4810-832e-01fb49136f18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:53.500021 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d4637-397b-4810-832e-01fb49136f18 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:53.513970 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 457/937] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 21 16:09:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:53.513970 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d4637-397b-4810-832e-01fb49136f18 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:53.519513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda61ac-3c17-43cb-8161-814f83a2c0ac None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:53.559237 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:53.560085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1b4f3-d36a-49ab-91b0-475f7c837ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:53.560480 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1b4f3-d36a-49ab-91b0-475f7c837ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:53.560791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1b4f3-d36a-49ab-91b0-475f7c837ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:53.561313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1b4f3-d36a-49ab-91b0-475f7c837ff7 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:53.562095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1b4f3-d36a-49ab-91b0-475f7c837ff7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:53.562491 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1b4f3-d36a-49ab-91b0-475f7c837ff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:53.563823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1b4f3-d36a-49ab-91b0-475f7c837ff7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:53.569822 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 481/938] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:09:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:53.570807 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1b4f3-d36a-49ab-91b0-475f7c837ff7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:53.611532 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:53.680541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d4637-397b-4810-832e-01fb49136f18 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:53.708938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1b4f3-d36a-49ab-91b0-475f7c837ff7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:53.719130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb7628-87f7-4538-a27e-0b70726b459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:53.719753 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb7628-87f7-4538-a27e-0b70726b459a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:53.720032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb7628-87f7-4538-a27e-0b70726b459a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:53.720302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb7628-87f7-4538-a27e-0b70726b459a None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:53.721006 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb7628-87f7-4538-a27e-0b70726b459a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:53.721311 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb7628-87f7-4538-a27e-0b70726b459a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:53.722712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb7628-87f7-4538-a27e-0b70726b459a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:53.743331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 458/939] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:53.743331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb7628-87f7-4538-a27e-0b70726b459a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:53.779042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfb23c-17e8-419d-a8e6-6983589a6e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:53.780129 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfb23c-17e8-419d-a8e6-6983589a6e88 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:53.780569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfb23c-17e8-419d-a8e6-6983589a6e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:53.781077 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfb23c-17e8-419d-a8e6-6983589a6e88 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:53.782090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfb23c-17e8-419d-a8e6-6983589a6e88 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:53.782588 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfb23c-17e8-419d-a8e6-6983589a6e88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:53.784932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfb23c-17e8-419d-a8e6-6983589a6e88 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:53.798815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 482/940] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 21 16:09:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:53.798815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfb23c-17e8-419d-a8e6-6983589a6e88 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:53.917950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:53.936015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb7628-87f7-4538-a27e-0b70726b459a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:53.960512 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:53.981037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfb23c-17e8-419d-a8e6-6983589a6e88 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:53.983744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cbc7c-160e-4417-bb98-18f0cc7f69d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:53.984467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cbc7c-160e-4417-bb98-18f0cc7f69d4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:53.984851 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cbc7c-160e-4417-bb98-18f0cc7f69d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:53.985187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cbc7c-160e-4417-bb98-18f0cc7f69d4 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:53.985925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cbc7c-160e-4417-bb98-18f0cc7f69d4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:53.986354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cbc7c-160e-4417-bb98-18f0cc7f69d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:53.988357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cbc7c-160e-4417-bb98-18f0cc7f69d4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:53.994859 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 459/941] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 21 16:09:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:53.996297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cbc7c-160e-4417-bb98-18f0cc7f69d4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:54.055717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf165e-fe58-497a-9101-7e3c844f2ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:54.057161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf165e-fe58-497a-9101-7e3c844f2ecd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:54.057919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf165e-fe58-497a-9101-7e3c844f2ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:54.058602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf165e-fe58-497a-9101-7e3c844f2ecd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:54.073338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf165e-fe58-497a-9101-7e3c844f2ecd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:54.075846 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf165e-fe58-497a-9101-7e3c844f2ecd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-78bf165e-fe58-497a-9101-7e3c844f2ecd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:09:54.097349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:54.099311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:54.105249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:54.105249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:54.105249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:09:54.105249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:09:54.105249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:09:54.105249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:09:54.105249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:09:54.105249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:09:54.105249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 16:09:54.105249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:54.105249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 483/942] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 21 16:09:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:54.105249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf165e-fe58-497a-9101-7e3c844f2ecd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:54.156093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cbc7c-160e-4417-bb98-18f0cc7f69d4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:54.228025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6781a9e-5881-43c3-ac27-99696aea7098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:54.229004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6781a9e-5881-43c3-ac27-99696aea7098 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:54.229498 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6781a9e-5881-43c3-ac27-99696aea7098 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:54.229981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6781a9e-5881-43c3-ac27-99696aea7098 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:54.231328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6781a9e-5881-43c3-ac27-99696aea7098 None admin] RBAC: Adding query filter params (interface=public, service_id=f8b6a62b337f41ab8833e7ad3d392ead, region_id=RegionOne) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:54.231871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6781a9e-5881-43c3-ac27-99696aea7098 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:54.234601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6781a9e-5881-43c3-ac27-99696aea7098 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:54.244736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 460/943] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 21 16:09:53 2022] GET /identity/v3/endpoints?service_id=f8b6a62b337f41ab8833e7ad3d392ead&interface=public®ion_id=RegionOne => generated 194 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:54.246287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6781a9e-5881-43c3-ac27-99696aea7098 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:54.260140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf165e-fe58-497a-9101-7e3c844f2ecd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:54.278472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:54.310657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fc381-3aa3-450f-a41b-acbbc0beffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:54.311804 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fc381-3aa3-450f-a41b-acbbc0beffb8 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:54.312278 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fc381-3aa3-450f-a41b-acbbc0beffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:54.312775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fc381-3aa3-450f-a41b-acbbc0beffb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:54.313490 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fc381-3aa3-450f-a41b-acbbc0beffb8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:54.315693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fc381-3aa3-450f-a41b-acbbc0beffb8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:54.346781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 484/944] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:09:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:09:54.348435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958c3fe-5df1-4661-8e7b-de81bff49b1c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:54.348950 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958c3fe-5df1-4661-8e7b-de81bff49b1c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:54.349364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958c3fe-5df1-4661-8e7b-de81bff49b1c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:54.351270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 485/945] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:54.354344 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958c3fe-5df1-4661-8e7b-de81bff49b1c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:54.370621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:54.423084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6781a9e-5881-43c3-ac27-99696aea7098 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:54.500148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979a3be-1190-471d-b0ec-0da6d7c32b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:54.500723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979a3be-1190-471d-b0ec-0da6d7c32b9d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:54.501003 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979a3be-1190-471d-b0ec-0da6d7c32b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:54.501263 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979a3be-1190-471d-b0ec-0da6d7c32b9d None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:54.502027 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979a3be-1190-471d-b0ec-0da6d7c32b9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:54.502328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979a3be-1190-471d-b0ec-0da6d7c32b9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:54.503833 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979a3be-1190-471d-b0ec-0da6d7c32b9d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:54.530477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 461/946] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 21 16:09:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:54.531815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f74cd-4e88-4472-933b-2c2b36a0ee53 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:54.532103 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f74cd-4e88-4472-933b-2c2b36a0ee53 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:54.532345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f74cd-4e88-4472-933b-2c2b36a0ee53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:54.548064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958c3fe-5df1-4661-8e7b-de81bff49b1c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:54.552560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-139f74cd-4e88-4472-933b-2c2b36a0ee53 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:54.554069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-139f74cd-4e88-4472-933b-2c2b36a0ee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:54.616275 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6394732-5d73-4856-8d3d-472c0f1e28cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:54.617290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394732-5d73-4856-8d3d-472c0f1e28cf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:54.617695 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394732-5d73-4856-8d3d-472c0f1e28cf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:54.618084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394732-5d73-4856-8d3d-472c0f1e28cf None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:54.618951 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6394732-5d73-4856-8d3d-472c0f1e28cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:54.620837 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6394732-5d73-4856-8d3d-472c0f1e28cf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:54.629246 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 486/947] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 21 16:09:54 2022] GET /identity/v3/services => generated 1497 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:09:54.630490 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6394732-5d73-4856-8d3d-472c0f1e28cf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:54.643538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:54.651405 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 462/948] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:54.725800 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:54.760071 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6394732-5d73-4856-8d3d-472c0f1e28cf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:54.805834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6500e90-5c79-47f5-92b4-12801e8dda52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:54.807200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6500e90-5c79-47f5-92b4-12801e8dda52 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:54.807851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6500e90-5c79-47f5-92b4-12801e8dda52 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:54.808519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6500e90-5c79-47f5-92b4-12801e8dda52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:54.943429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6500e90-5c79-47f5-92b4-12801e8dda52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:54.946980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6500e90-5c79-47f5-92b4-12801e8dda52 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:55.049832 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:55.088146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 487/949] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:09:54 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:09:55.096732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f74cd-4e88-4472-933b-2c2b36a0ee53 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:55.121418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6500e90-5c79-47f5-92b4-12801e8dda52 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:55.239588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f74cd-4e88-4472-933b-2c2b36a0ee53 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:55.281751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe19bc-106c-4124-a7ca-8543e48d43b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:55.282797 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe19bc-106c-4124-a7ca-8543e48d43b0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:55.282797 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe19bc-106c-4124-a7ca-8543e48d43b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:55.283141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe19bc-106c-4124-a7ca-8543e48d43b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:55.296166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe19bc-106c-4124-a7ca-8543e48d43b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:55.297800 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe19bc-106c-4124-a7ca-8543e48d43b0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-dabe19bc-106c-4124-a7ca-8543e48d43b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:09:55.316314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:55.318412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:09:55.320672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:09:55.320672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:09:55.320672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:55.324166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 463/950] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:55.325623 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe19bc-106c-4124-a7ca-8543e48d43b0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:55.327332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6500e90-5c79-47f5-92b4-12801e8dda52 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:55.392294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:55.395021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384a482-c660-4caa-b880-d2469974847c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:55.395682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384a482-c660-4caa-b880-d2469974847c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:55.396035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384a482-c660-4caa-b880-d2469974847c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:55.396616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384a482-c660-4caa-b880-d2469974847c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:55.397359 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384a482-c660-4caa-b880-d2469974847c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:55.398783 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384a482-c660-4caa-b880-d2469974847c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9384a482-c660-4caa-b880-d2469974847c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:55.409447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:55.411497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:55.419735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 488/951] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Sep 21 16:09:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:55.423764 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384a482-c660-4caa-b880-d2469974847c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:55.483088 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe19bc-106c-4124-a7ca-8543e48d43b0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:55.505495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:55.527037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575f17b-145d-4177-8b68-20d0aeef4293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:55.528157 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575f17b-145d-4177-8b68-20d0aeef4293 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:55.528676 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575f17b-145d-4177-8b68-20d0aeef4293 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:55.529144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575f17b-145d-4177-8b68-20d0aeef4293 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:55.529950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575f17b-145d-4177-8b68-20d0aeef4293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:55.530405 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575f17b-145d-4177-8b68-20d0aeef4293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:55.532026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575f17b-145d-4177-8b68-20d0aeef4293 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:55.550757 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 464/952] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:55.552560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575f17b-145d-4177-8b68-20d0aeef4293 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:55.629479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384a482-c660-4caa-b880-d2469974847c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:55.674262 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575f17b-145d-4177-8b68-20d0aeef4293 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:55.691432 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:55.694738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd5e9d-c482-4163-bdeb-d373cfa40e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:55.695880 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd5e9d-c482-4163-bdeb-d373cfa40e06 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:55.696287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd5e9d-c482-4163-bdeb-d373cfa40e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:55.696820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd5e9d-c482-4163-bdeb-d373cfa40e06 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:55.698009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd5e9d-c482-4163-bdeb-d373cfa40e06 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:55.698580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd5e9d-c482-4163-bdeb-d373cfa40e06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:55.701232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd5e9d-c482-4163-bdeb-d373cfa40e06 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:55.716392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 489/953] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 21 16:09:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:55.719227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd5e9d-c482-4163-bdeb-d373cfa40e06 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:55.736667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0e4ce-f693-406d-a004-61ddde3ca90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:55.738420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0e4ce-f693-406d-a004-61ddde3ca90d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:55.739093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0e4ce-f693-406d-a004-61ddde3ca90d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:55.739929 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0e4ce-f693-406d-a004-61ddde3ca90d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:55.759389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0e4ce-f693-406d-a004-61ddde3ca90d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:55.763487 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0e4ce-f693-406d-a004-61ddde3ca90d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-50e0e4ce-f693-406d-a004-61ddde3ca90d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:55.797039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:55.798104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:55.799159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:55.799159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:55.799159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:55.799159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:55.799159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:55.799159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:55.799159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:55.799159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:09:55.804786 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 465/954] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:55.810381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0e4ce-f693-406d-a004-61ddde3ca90d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:55.861595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:55.869144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd5e9d-c482-4163-bdeb-d373cfa40e06 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:55.915664 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e7355-b5d8-48ef-acc9-acfdacea9249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:55.916148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e7355-b5d8-48ef-acc9-acfdacea9249 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:55.916432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e7355-b5d8-48ef-acc9-acfdacea9249 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:55.916772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e7355-b5d8-48ef-acc9-acfdacea9249 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:55.917511 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e7355-b5d8-48ef-acc9-acfdacea9249 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:55.917794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e7355-b5d8-48ef-acc9-acfdacea9249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:55.919187 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e7355-b5d8-48ef-acc9-acfdacea9249 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:55.930478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 490/955] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 21 16:09:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:55.934979 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e7355-b5d8-48ef-acc9-acfdacea9249 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:55.999837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0e4ce-f693-406d-a004-61ddde3ca90d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:56.048286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d444bd-1a09-4090-829a-72408ad26d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:56.049321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d444bd-1a09-4090-829a-72408ad26d6f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:56.049788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d444bd-1a09-4090-829a-72408ad26d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:56.050588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d444bd-1a09-4090-829a-72408ad26d6f None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:56.051565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d444bd-1a09-4090-829a-72408ad26d6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:56.052709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d444bd-1a09-4090-829a-72408ad26d6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:56.055887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d444bd-1a09-4090-829a-72408ad26d6f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:56.072593 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 466/956] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:09:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:56.082190 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d444bd-1a09-4090-829a-72408ad26d6f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:56.124838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e7355-b5d8-48ef-acc9-acfdacea9249 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:56.125106 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:56.189006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eca69c-c1ce-4482-b22d-f0424d6f3e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:56.190490 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eca69c-c1ce-4482-b22d-f0424d6f3e59 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:56.191269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eca69c-c1ce-4482-b22d-f0424d6f3e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:56.192037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eca69c-c1ce-4482-b22d-f0424d6f3e59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:56.193545 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eca69c-c1ce-4482-b22d-f0424d6f3e59 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:56.197072 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eca69c-c1ce-4482-b22d-f0424d6f3e59 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:56.220082 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d444bd-1a09-4090-829a-72408ad26d6f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:56.232871 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 491/957] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:09:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:09:56.301071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60fdc6-988f-4a76-afbd-659b8f2c9d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:56.302143 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60fdc6-988f-4a76-afbd-659b8f2c9d87 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:56.302628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60fdc6-988f-4a76-afbd-659b8f2c9d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:56.303309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60fdc6-988f-4a76-afbd-659b8f2c9d87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:56.305304 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60fdc6-988f-4a76-afbd-659b8f2c9d87 None admin] RBAC: Adding query filter params (role.id=ac5c4a11a0f94428ac80cfb9130336f0, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=5e20281883414eed9d644e0eaab2ac49) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:56.305849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60fdc6-988f-4a76-afbd-659b8f2c9d87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:56.308837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60fdc6-988f-4a76-afbd-659b8f2c9d87 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:56.321927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 467/958] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:09:56 2022] GET /identity/v3/role_assignments?user.id=5e20281883414eed9d644e0eaab2ac49&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=ac5c4a11a0f94428ac80cfb9130336f0 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:57.366283 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d648b6b-8f29-4b97-95c8-f257fb9673dd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:57.366820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d648b6b-8f29-4b97-95c8-f257fb9673dd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:57.366820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d648b6b-8f29-4b97-95c8-f257fb9673dd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:57.368342 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 492/959] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:57.374403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef0ef3-55d9-423e-85e2-60818632c2e6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:57.375331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef0ef3-55d9-423e-85e2-60818632c2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:57.375799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef0ef3-55d9-423e-85e2-60818632c2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:57.395360 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-4aef0ef3-55d9-423e-85e2-60818632c2e6 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:57.397549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4aef0ef3-55d9-423e-85e2-60818632c2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:57.476763 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 468/960] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:09:57.849266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697def9-b6ae-434e-9a62-ebc8a0347833 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:57.849647 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697def9-b6ae-434e-9a62-ebc8a0347833 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:57.849846 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697def9-b6ae-434e-9a62-ebc8a0347833 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:57.851959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 493/961] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:57.857801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24e0a4-fabc-44e7-ac01-30eae255b8d2 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:57.858078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24e0a4-fabc-44e7-ac01-30eae255b8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:57.858358 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24e0a4-fabc-44e7-ac01-30eae255b8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:57.881963 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-4d24e0a4-fabc-44e7-ac01-30eae255b8d2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:57.883276 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4d24e0a4-fabc-44e7-ac01-30eae255b8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:57.906179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:57.911049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697def9-b6ae-434e-9a62-ebc8a0347833 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:57.935997 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:57.982040 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 469/962] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:58.051795 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697def9-b6ae-434e-9a62-ebc8a0347833 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:58.093099 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840efbc-31a8-4dd7-82e4-cd201d0e5eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:58.093753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840efbc-31a8-4dd7-82e4-cd201d0e5eaf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:58.094032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840efbc-31a8-4dd7-82e4-cd201d0e5eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:58.094302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840efbc-31a8-4dd7-82e4-cd201d0e5eaf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:58.094892 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840efbc-31a8-4dd7-82e4-cd201d0e5eaf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:58.096304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840efbc-31a8-4dd7-82e4-cd201d0e5eaf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0840efbc-31a8-4dd7-82e4-cd201d0e5eaf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:58.106853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:58.108006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:58.108938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 494/963] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 21 16:09:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:58.114433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24e0a4-fabc-44e7-ac01-30eae255b8d2 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:58.232667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24e0a4-fabc-44e7-ac01-30eae255b8d2 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:58.262441 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840efbc-31a8-4dd7-82e4-cd201d0e5eaf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:58.275782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba081f97-e993-431d-9036-58745b29c483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:58.276865 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba081f97-e993-431d-9036-58745b29c483 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:58.277143 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba081f97-e993-431d-9036-58745b29c483 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:58.277410 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba081f97-e993-431d-9036-58745b29c483 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:58.278401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba081f97-e993-431d-9036-58745b29c483 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:58.278708 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba081f97-e993-431d-9036-58745b29c483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:58.280407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba081f97-e993-431d-9036-58745b29c483 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:58.287313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 470/964] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 21 16:09:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:58.293192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba081f97-e993-431d-9036-58745b29c483 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:58.312821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:58.364904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:58.392229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840efbc-31a8-4dd7-82e4-cd201d0e5eaf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:58.419323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba081f97-e993-431d-9036-58745b29c483 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:58.436070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734399fc-0672-4e82-bc83-1c55942b5a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:58.437394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734399fc-0672-4e82-bc83-1c55942b5a7d None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:58.437777 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734399fc-0672-4e82-bc83-1c55942b5a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:58.438414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734399fc-0672-4e82-bc83-1c55942b5a7d None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:58.439199 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734399fc-0672-4e82-bc83-1c55942b5a7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:58.440945 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734399fc-0672-4e82-bc83-1c55942b5a7d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:58.444522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: WARNING keystone.server.flask.common [None req-734399fc-0672-4e82-bc83-1c55942b5a7d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 21 16:09:58.468999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.sql.core [None req-734399fc-0672-4e82-bc83-1c55942b5a7d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 16:09:58.468999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 21 16:09:58.468999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [parameters: {'id': '0a74faab34f94e80abb5f241c008ac4c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 21 16:09:58.468999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81472) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 21 16:09:58.474256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ca05-244c-433f-a257-54a90de4bb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:58.475915 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ca05-244c-433f-a257-54a90de4bb99 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:58.476472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ca05-244c-433f-a257-54a90de4bb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:58.476996 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ca05-244c-433f-a257-54a90de4bb99 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:58.477888 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998ca05-244c-433f-a257-54a90de4bb99 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:58.478441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998ca05-244c-433f-a257-54a90de4bb99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:58.479247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-734399fc-0672-4e82-bc83-1c55942b5a7d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0a74faab34f94e80abb5f241c008ac4c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0a74faab34f94e80abb5f241c008ac4c. Sep 21 16:09:58.479247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:58.479247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 16:09:58.479247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 16:09:58.479247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 16:09:58.479247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 16:09:58.479247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 16:09:58.479247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 16:09:58.479247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 16:09:58.479247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 21 16:09:58.479247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 16:09:58.479247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 16:09:58.479247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 21 16:09:58.480061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application yield resource Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.rollback() Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.force_reraise() Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise self.value Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application session.commit() Sep 21 16:09:58.481459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._prepare_impl() Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.flush() Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._flush(objects) Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application compat.raise_( Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application flush_context.execute() Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 21 16:09:58.482400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rec.execute(self) Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 21 16:09:58.483321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 16:09:58.484135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [parameters: {'id': '0a74faab34f94e80abb5f241c008ac4c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:58.485098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:58.488057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:58.491711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:58.491711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 21 16:09:58.491711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 21 16:09:58.491711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:58.491711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:58.491711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 21 16:09:58.491711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 21 16:09:58.491711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0a74faab34f94e80abb5f241c008ac4c. Sep 21 16:09:58.491711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:58.491711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 495/965] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Sep 21 16:09:58 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:58.491711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734399fc-0672-4e82-bc83-1c55942b5a7d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:58.497478 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998ca05-244c-433f-a257-54a90de4bb99 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:58.512895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 471/966] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 21 16:09:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:58.516475 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ca05-244c-433f-a257-54a90de4bb99 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:58.636385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734399fc-0672-4e82-bc83-1c55942b5a7d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:58.650894 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:58.671949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ca05-244c-433f-a257-54a90de4bb99 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:58.697564 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250a550-88b4-46b9-9df0-1f7b3100f18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:58.698618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250a550-88b4-46b9-9df0-1f7b3100f18b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:58.699096 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250a550-88b4-46b9-9df0-1f7b3100f18b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:58.699572 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250a550-88b4-46b9-9df0-1f7b3100f18b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:58.711816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5b321-4be9-41d2-b8a3-4718ba40a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:58.712793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b321-4be9-41d2-b8a3-4718ba40a530 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:58.713213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250a550-88b4-46b9-9df0-1f7b3100f18b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:58.713459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b321-4be9-41d2-b8a3-4718ba40a530 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:58.713894 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b321-4be9-41d2-b8a3-4718ba40a530 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:58.714992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5b321-4be9-41d2-b8a3-4718ba40a530 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:58.716488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250a550-88b4-46b9-9df0-1f7b3100f18b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:58.716710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5b321-4be9-41d2-b8a3-4718ba40a530 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:58.720175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:58.748805 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 472/967] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:09:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9250a550-88b4-46b9-9df0-1f7b3100f18b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:09:58.749004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:58.749868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:58.750797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:09:58.750797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:09:58.750797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:09:58.750797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:09:58.750797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:09:58.750797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:09:58.750797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:09:58.750797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:58.751260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde80d5-841b-42a4-bacb-3d7fbaeb959d None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:58.751260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde80d5-841b-42a4-bacb-3d7fbaeb959d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:58.751260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde80d5-841b-42a4-bacb-3d7fbaeb959d None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:58.751462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 496/968] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:09:58.751541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 473/969] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:58.751620 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f12c8-4d85-4ad0-9281-b26c97d2ce74 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:58.751620 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f12c8-4d85-4ad0-9281-b26c97d2ce74 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:58.751620 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f12c8-4d85-4ad0-9281-b26c97d2ce74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:58.757058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde80d5-841b-42a4-bacb-3d7fbaeb959d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:58.784452 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5e1f12c8-4d85-4ad0-9281-b26c97d2ce74 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:58.786420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5e1f12c8-4d85-4ad0-9281-b26c97d2ce74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:09:58.913773 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 497/970] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:09:58.978704 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde80d5-841b-42a4-bacb-3d7fbaeb959d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:59.051812 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3381039-e73f-460a-aae3-df4cbf9d9849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:59.051812 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3381039-e73f-460a-aae3-df4cbf9d9849 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:59.052250 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3381039-e73f-460a-aae3-df4cbf9d9849 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:59.052628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3381039-e73f-460a-aae3-df4cbf9d9849 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:59.053794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3381039-e73f-460a-aae3-df4cbf9d9849 None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:59.054347 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3381039-e73f-460a-aae3-df4cbf9d9849 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:59.057148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3381039-e73f-460a-aae3-df4cbf9d9849 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:59.064287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:59.093440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 474/971] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 21 16:09:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:59.180359 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f12c8-4d85-4ad0-9281-b26c97d2ce74 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:59.301785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f12c8-4d85-4ad0-9281-b26c97d2ce74 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:59.332432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:09:59.346615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf8b33-7d1c-48ac-9b09-7eaf4956ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:59.347336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf8b33-7d1c-48ac-9b09-7eaf4956ae7a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:59.347614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf8b33-7d1c-48ac-9b09-7eaf4956ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:59.347883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf8b33-7d1c-48ac-9b09-7eaf4956ae7a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:59.348493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf8b33-7d1c-48ac-9b09-7eaf4956ae7a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:59.350126 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf8b33-7d1c-48ac-9b09-7eaf4956ae7a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-50cf8b33-7d1c-48ac-9b09-7eaf4956ae7a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:09:59.360613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:09:59.362642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:09:59.364374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 498/972] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:09:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:09:59.368189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3381039-e73f-460a-aae3-df4cbf9d9849 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:59.513303 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3381039-e73f-460a-aae3-df4cbf9d9849 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:59.572333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a2582-3758-494a-9767-d1f147606423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:59.572993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2582-3758-494a-9767-d1f147606423 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:59.573278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2582-3758-494a-9767-d1f147606423 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:59.573531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2582-3758-494a-9767-d1f147606423 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:59.574182 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a2582-3758-494a-9767-d1f147606423 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:59.574485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a2582-3758-494a-9767-d1f147606423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:59.575886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a2582-3758-494a-9767-d1f147606423 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:59.581738 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 475/973] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 21 16:09:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:09:59.587820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf8b33-7d1c-48ac-9b09-7eaf4956ae7a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:09:59.708124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf8b33-7d1c-48ac-9b09-7eaf4956ae7a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:09:59.750861 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88810a-a54d-441b-be5b-2351ebecd3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:09:59.751382 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88810a-a54d-441b-be5b-2351ebecd3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:59.751661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88810a-a54d-441b-be5b-2351ebecd3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:59.751934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88810a-a54d-441b-be5b-2351ebecd3c3 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:59.752574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88810a-a54d-441b-be5b-2351ebecd3c3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:09:59.752912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88810a-a54d-441b-be5b-2351ebecd3c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:09:59.754287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88810a-a54d-441b-be5b-2351ebecd3c3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:09:59.760501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 499/974] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 21 16:09:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:09:59.909711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebc8b0-152b-4b18-aed7-694f130e1da3 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:59.910699 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebc8b0-152b-4b18-aed7-694f130e1da3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:59.911469 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebc8b0-152b-4b18-aed7-694f130e1da3 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:59.914823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 476/975] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:09:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:09:59.924656 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fba60-e037-400b-b343-cae856b89e52 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:09:59.925733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fba60-e037-400b-b343-cae856b89e52 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:09:59.926497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fba60-e037-400b-b343-cae856b89e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:09:59.960364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-024fba60-e037-400b-b343-cae856b89e52 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:09:59.962470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-024fba60-e037-400b-b343-cae856b89e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:00.056634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:00.094318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 500/976] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:09:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:00.596085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebc8b0-152b-4b18-aed7-694f130e1da3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:00.682605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:00.759572 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebc8b0-152b-4b18-aed7-694f130e1da3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:00.820947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d7dd7-77c6-4fc3-afc8-920e94a52fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:00.821981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d7dd7-77c6-4fc3-afc8-920e94a52fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:00.822461 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d7dd7-77c6-4fc3-afc8-920e94a52fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:00.822891 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d7dd7-77c6-4fc3-afc8-920e94a52fc2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:00.823942 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d7dd7-77c6-4fc3-afc8-920e94a52fc2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:00.826467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d7dd7-77c6-4fc3-afc8-920e94a52fc2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-7d5d7dd7-77c6-4fc3-afc8-920e94a52fc2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:00.843083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:00.844153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:00.845116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:00.845116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:00.845116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:00.845116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:00.845116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:00.845116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:00.845116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:00.845116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:00.845116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:00.845116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:00.845116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:10:00.845116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:10:00.845116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 16:10:00.845116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:00.845852 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 477/977] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Sep 21 16:10:00 2022] GET /identity/v3/services/image => generated 86 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:00.852979 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fba60-e037-400b-b343-cae856b89e52 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:00.964531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fba60-e037-400b-b343-cae856b89e52 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:01.002041 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f3483-55c9-4ff6-9d4c-e893702b2d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:01.002665 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f3483-55c9-4ff6-9d4c-e893702b2d5b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:01.002944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f3483-55c9-4ff6-9d4c-e893702b2d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:01.003217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f3483-55c9-4ff6-9d4c-e893702b2d5b None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:01.003855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f3483-55c9-4ff6-9d4c-e893702b2d5b None admin] RBAC: Adding query filter params (name=image) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:01.004160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f3483-55c9-4ff6-9d4c-e893702b2d5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:01.005566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f3483-55c9-4ff6-9d4c-e893702b2d5b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:01.012047 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 501/978] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:01.018177 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d7dd7-77c6-4fc3-afc8-920e94a52fc2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:01.180665 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d7dd7-77c6-4fc3-afc8-920e94a52fc2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:01.227585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:01.249482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136b908-7d8e-4881-b1c8-72a314870e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:01.250582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136b908-7d8e-4881-b1c8-72a314870e98 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:01.251083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136b908-7d8e-4881-b1c8-72a314870e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:01.251579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136b908-7d8e-4881-b1c8-72a314870e98 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:01.252788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136b908-7d8e-4881-b1c8-72a314870e98 None admin] RBAC: Adding query filter params (type=image) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:01.253339 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136b908-7d8e-4881-b1c8-72a314870e98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:01.255917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136b908-7d8e-4881-b1c8-72a314870e98 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:01.265582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 478/979] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:01.517349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f4f26-0224-4eb1-9646-f66417926316 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:01.517619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f4f26-0224-4eb1-9646-f66417926316 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:01.517787 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f4f26-0224-4eb1-9646-f66417926316 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:01.519476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 502/980] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:01.525962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd59bb-c718-43ba-8eff-8486a20bc395 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:01.526300 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd59bb-c718-43ba-8eff-8486a20bc395 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:01.526513 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd59bb-c718-43ba-8eff-8486a20bc395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:01.553390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-83dd59bb-c718-43ba-8eff-8486a20bc395 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:01.555353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-83dd59bb-c718-43ba-8eff-8486a20bc395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:01.661618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 479/981] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:10:01.939885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f4f26-0224-4eb1-9646-f66417926316 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:01.977050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bb55f-598a-4e3a-b58a-ba6769d66d1c None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:01.977685 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bb55f-598a-4e3a-b58a-ba6769d66d1c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:01.978150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bb55f-598a-4e3a-b58a-ba6769d66d1c None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:01.980827 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 480/982] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:10:01.987119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc069837-9fa1-49d4-8c24-cb905d8601b0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:01.988026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc069837-9fa1-49d4-8c24-cb905d8601b0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:01.988845 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc069837-9fa1-49d4-8c24-cb905d8601b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:02.007267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:02.026126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-cc069837-9fa1-49d4-8c24-cb905d8601b0 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:02.028104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cc069837-9fa1-49d4-8c24-cb905d8601b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:02.083207 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f4f26-0224-4eb1-9646-f66417926316 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:02.125236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 481/983] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:10:02.130526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0cec6-2737-4b49-a95c-fa0dcb2191de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:02.131598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0cec6-2737-4b49-a95c-fa0dcb2191de None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:02.132131 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0cec6-2737-4b49-a95c-fa0dcb2191de None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:02.132741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0cec6-2737-4b49-a95c-fa0dcb2191de None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:02.133673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0cec6-2737-4b49-a95c-fa0dcb2191de None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:02.135585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0cec6-2737-4b49-a95c-fa0dcb2191de None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-86f0cec6-2737-4b49-a95c-fa0dcb2191de None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:02.148125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:02.150301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:02.152226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:02.152226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:02.152226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:02.152226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:02.152226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:02.152226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:02.152226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:02.152226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:02.152226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:02.152226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:02.152226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:10:02.152226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:10:02.152226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:10:02.152226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:02.158007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 503/984] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 21 16:10:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:02.168454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc069837-9fa1-49d4-8c24-cb905d8601b0 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:02.250922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:02.329202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc069837-9fa1-49d4-8c24-cb905d8601b0 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:02.381199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2cd54-7038-4298-a63e-a4c888ae13f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:02.381826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2cd54-7038-4298-a63e-a4c888ae13f6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:02.382130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2cd54-7038-4298-a63e-a4c888ae13f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:02.382409 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2cd54-7038-4298-a63e-a4c888ae13f6 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:02.382994 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2cd54-7038-4298-a63e-a4c888ae13f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:02.383296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2cd54-7038-4298-a63e-a4c888ae13f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:02.384713 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2cd54-7038-4298-a63e-a4c888ae13f6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:02.390498 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 482/985] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 21 16:10:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:02.400148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0cec6-2737-4b49-a95c-fa0dcb2191de None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:02.427747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2cd54-7038-4298-a63e-a4c888ae13f6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:02.554480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2cd54-7038-4298-a63e-a4c888ae13f6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:02.573193 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:02.597969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586af508-89ac-4bcd-9855-159aded00d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:02.598701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586af508-89ac-4bcd-9855-159aded00d2b None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:02.599086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586af508-89ac-4bcd-9855-159aded00d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:02.599343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586af508-89ac-4bcd-9855-159aded00d2b None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:02.600164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586af508-89ac-4bcd-9855-159aded00d2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:02.602581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586af508-89ac-4bcd-9855-159aded00d2b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:02.605343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: WARNING keystone.server.flask.common [None req-586af508-89ac-4bcd-9855-159aded00d2b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 21 16:10:02.605963 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0cec6-2737-4b49-a95c-fa0dcb2191de None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:02.621067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:02.622271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.sql.core [None req-586af508-89ac-4bcd-9855-159aded00d2b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 16:10:02.622271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 21 16:10:02.622271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [parameters: {'user_id': '7501b861445a4c90a22ac7376ec400cb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 21 16:10:02.622271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81471) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-586af508-89ac-4bcd-9855-159aded00d2b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application conn.query(q) Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application result.read() Sep 21 16:10:02.641815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 16:10:02.642861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application next(self.gen) Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application yield resource Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application next(self.gen) Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self.session.rollback() Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self.force_reraise() Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise self.value Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application session.commit() Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 21 16:10:02.645505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._prepare_impl() Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self.session.flush() Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._flush(objects) Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application compat.raise_( Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application flush_context.execute() Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rec.execute(self) Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 21 16:10:02.646679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 16:10:02.647804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application conn.query(q) Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application result.read() Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 16:10:02.648979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [parameters: {'user_id': '7501b861445a4c90a22ac7376ec400cb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:02.652999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 21 16:10:02.654116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 21 16:10:02.655084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 21 16:10:02.655084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 21 16:10:02.655084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 21 16:10:02.655084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 21 16:10:02.655084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 21 16:10:02.655084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:02.655084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 483/986] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 21 16:10:02 2022] POST /identity/v3/users => generated 160 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:02.655084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67932d-c8d5-4319-a2be-20d660030a10 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:02.655084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67932d-c8d5-4319-a2be-20d660030a10 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:02.655084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67932d-c8d5-4319-a2be-20d660030a10 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:02.655687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 484/987] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:02.658086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67932d-c8d5-4319-a2be-20d660030a10 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:02.670282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bdaf6-caf1-48c7-a3c7-9b9241c2b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:02.671091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bdaf6-caf1-48c7-a3c7-9b9241c2b5cc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:02.671536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bdaf6-caf1-48c7-a3c7-9b9241c2b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:02.672019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bdaf6-caf1-48c7-a3c7-9b9241c2b5cc None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:02.672973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bdaf6-caf1-48c7-a3c7-9b9241c2b5cc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:02.673436 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bdaf6-caf1-48c7-a3c7-9b9241c2b5cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:02.675201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bdaf6-caf1-48c7-a3c7-9b9241c2b5cc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:02.682252 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 504/988] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 21 16:10:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:02.683562 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501092ca-cf2b-4d3b-b80c-6dd972ec78d8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:02.683844 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501092ca-cf2b-4d3b-b80c-6dd972ec78d8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:02.684105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501092ca-cf2b-4d3b-b80c-6dd972ec78d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:02.706061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-501092ca-cf2b-4d3b-b80c-6dd972ec78d8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:02.707330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-501092ca-cf2b-4d3b-b80c-6dd972ec78d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:02.810240 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67932d-c8d5-4319-a2be-20d660030a10 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:02.824142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 505/989] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:02.825356 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501092ca-cf2b-4d3b-b80c-6dd972ec78d8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:02.881910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9d6ab-edc6-411e-a308-0613ec5d6a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:02.882891 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9d6ab-edc6-411e-a308-0613ec5d6a13 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:02.883375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9d6ab-edc6-411e-a308-0613ec5d6a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:02.884039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9d6ab-edc6-411e-a308-0613ec5d6a13 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:02.900162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9d6ab-edc6-411e-a308-0613ec5d6a13 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:02.903206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9d6ab-edc6-411e-a308-0613ec5d6a13 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-d7d9d6ab-edc6-411e-a308-0613ec5d6a13 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:10:02.926701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:02.929093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:02.932199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:02.932199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:02.932199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:10:02.932199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:10:02.932199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:10:02.932199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:10:02.932199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:10:02.932199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:10:02.932199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 16:10:02.932199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:02.936799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 485/990] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:10:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:02.939451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9d6ab-edc6-411e-a308-0613ec5d6a13 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:03.008004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:03.047125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501092ca-cf2b-4d3b-b80c-6dd972ec78d8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:03.055261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:03.116805 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b902f-afb9-4d01-9a92-9ca50fa04fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:03.117593 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b902f-afb9-4d01-9a92-9ca50fa04fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:03.118301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b902f-afb9-4d01-9a92-9ca50fa04fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:03.118702 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b902f-afb9-4d01-9a92-9ca50fa04fc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:03.119542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b902f-afb9-4d01-9a92-9ca50fa04fc5 None admin] RBAC: Adding query filter params (interface=admin, service_id=f8b6a62b337f41ab8833e7ad3d392ead, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:03.120082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b902f-afb9-4d01-9a92-9ca50fa04fc5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:03.122159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9d6ab-edc6-411e-a308-0613ec5d6a13 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:03.122523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b902f-afb9-4d01-9a92-9ca50fa04fc5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:03.136963 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 506/991] 10.222.0.16 () {56 vars in 1249 bytes} [Wed Sep 21 16:10:02 2022] GET /identity/v3/endpoints?service_id=f8b6a62b337f41ab8833e7ad3d392ead&interface=admin®ion_id=RegionOne => generated 193 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:03.142025 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b902f-afb9-4d01-9a92-9ca50fa04fc5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:03.184172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e3132-6991-4b76-8170-63ab80cd646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:03.185222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3132-6991-4b76-8170-63ab80cd646e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:03.185506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3132-6991-4b76-8170-63ab80cd646e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:03.185869 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3132-6991-4b76-8170-63ab80cd646e None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:03.187189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e3132-6991-4b76-8170-63ab80cd646e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:03.187730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e3132-6991-4b76-8170-63ab80cd646e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:03.190214 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e3132-6991-4b76-8170-63ab80cd646e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:03.237114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 486/992] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 21 16:10:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:03.244617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e3132-6991-4b76-8170-63ab80cd646e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:03.291002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b902f-afb9-4d01-9a92-9ca50fa04fc5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:03.361425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44968c9f-86c3-458f-979e-cd3d49053b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:03.362905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968c9f-86c3-458f-979e-cd3d49053b81 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:03.363481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968c9f-86c3-458f-979e-cd3d49053b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:03.364629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968c9f-86c3-458f-979e-cd3d49053b81 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:03.368033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44968c9f-86c3-458f-979e-cd3d49053b81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:03.371387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44968c9f-86c3-458f-979e-cd3d49053b81 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:03.386058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 507/993] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 21 16:10:03 2022] GET /identity/v3/services => generated 1497 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:10:03.417430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:03.431648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e3132-6991-4b76-8170-63ab80cd646e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:03.499658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e55e42-9c02-4083-a6ef-2ec28c19a0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:03.501185 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55e42-9c02-4083-a6ef-2ec28c19a0f7 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:03.501927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55e42-9c02-4083-a6ef-2ec28c19a0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:03.502606 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55e42-9c02-4083-a6ef-2ec28c19a0f7 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:03.504155 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e55e42-9c02-4083-a6ef-2ec28c19a0f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:03.507354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e55e42-9c02-4083-a6ef-2ec28c19a0f7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:03.528399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 487/994] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 21 16:10:03 2022] POST /identity/v3/services => generated 242 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:10:03.757840 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4097a-bf4a-489b-b8da-7358baf7bab4 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:03.758226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4097a-bf4a-489b-b8da-7358baf7bab4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:03.758427 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4097a-bf4a-489b-b8da-7358baf7bab4 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:03.759903 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 508/995] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:03.765574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e44f2d-6d4d-45ea-b194-f6afca25789a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:03.765889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e44f2d-6d4d-45ea-b194-f6afca25789a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:03.766133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e44f2d-6d4d-45ea-b194-f6afca25789a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:03.792402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-98e44f2d-6d4d-45ea-b194-f6afca25789a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:03.795236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-98e44f2d-6d4d-45ea-b194-f6afca25789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:03.899417 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 488/996] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:04.217898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4097a-bf4a-489b-b8da-7358baf7bab4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:04.251858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:04.337011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4097a-bf4a-489b-b8da-7358baf7bab4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:04.385448 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9b2c0-090b-49f9-a918-57f647481200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:04.386118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9b2c0-090b-49f9-a918-57f647481200 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:04.386397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9b2c0-090b-49f9-a918-57f647481200 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:04.386679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9b2c0-090b-49f9-a918-57f647481200 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:04.387325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9b2c0-090b-49f9-a918-57f647481200 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:04.388721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9b2c0-090b-49f9-a918-57f647481200 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:04.410960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 509/997] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 21 16:10:04 2022] POST /identity/v3/services => generated 242 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:10:05.903707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50130a-d0a7-46b6-8eec-79957731149b None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:05.904352 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50130a-d0a7-46b6-8eec-79957731149b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:05.904352 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50130a-d0a7-46b6-8eec-79957731149b None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:05.905788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 489/998] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:05.911588 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f22e50-15f8-44e0-9281-439191da6d0b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:05.912216 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5b365-7e2d-4eed-849e-3874d3e71b5c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:05.912304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f22e50-15f8-44e0-9281-439191da6d0b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:05.912377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5b365-7e2d-4eed-849e-3874d3e71b5c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:05.912479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f22e50-15f8-44e0-9281-439191da6d0b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:05.912647 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5b365-7e2d-4eed-849e-3874d3e71b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:05.913789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 510/999] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:05.919124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21287dcc-85cd-4a8a-aef5-c41818980efd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:05.919399 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21287dcc-85cd-4a8a-aef5-c41818980efd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:05.919674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21287dcc-85cd-4a8a-aef5-c41818980efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:05.933988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3fb5b365-7e2d-4eed-849e-3874d3e71b5c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:05.935387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3fb5b365-7e2d-4eed-849e-3874d3e71b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:05.938518 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-21287dcc-85cd-4a8a-aef5-c41818980efd None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:05.939694 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-21287dcc-85cd-4a8a-aef5-c41818980efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:06.020740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 490/1000] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:05 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:10:06.035548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 511/1001] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:05 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:10:06.295304 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5b365-7e2d-4eed-849e-3874d3e71b5c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:06.298617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:06.428247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21287dcc-85cd-4a8a-aef5-c41818980efd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:06.437883 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5b365-7e2d-4eed-849e-3874d3e71b5c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:06.463134 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:06.507168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78ec1b-71bf-4651-a8a1-222745b8213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:06.508215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78ec1b-71bf-4651-a8a1-222745b8213e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:06.508716 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78ec1b-71bf-4651-a8a1-222745b8213e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:06.509231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78ec1b-71bf-4651-a8a1-222745b8213e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:06.510270 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78ec1b-71bf-4651-a8a1-222745b8213e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:06.512815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78ec1b-71bf-4651-a8a1-222745b8213e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-9c78ec1b-71bf-4651-a8a1-222745b8213e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:06.529661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:06.530781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:06.531628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:06.531628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:06.531628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:06.531628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:06.531628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:06.531628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:06.531628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:06.531628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:06.531628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:06.531628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:06.531628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:10:06.531628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:10:06.531628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 16:10:06.531628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:06.533153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 491/1002] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:10:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:06.539718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78ec1b-71bf-4651-a8a1-222745b8213e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:06.580181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21287dcc-85cd-4a8a-aef5-c41818980efd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:06.622927 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06174ca6-bedd-46a0-85e7-dcbb6bcd8093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:06.623561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06174ca6-bedd-46a0-85e7-dcbb6bcd8093 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:06.623877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06174ca6-bedd-46a0-85e7-dcbb6bcd8093 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:06.624145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06174ca6-bedd-46a0-85e7-dcbb6bcd8093 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:06.624810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06174ca6-bedd-46a0-85e7-dcbb6bcd8093 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:06.626181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06174ca6-bedd-46a0-85e7-dcbb6bcd8093 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-06174ca6-bedd-46a0-85e7-dcbb6bcd8093 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:06.636162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:06.637269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:06.639102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 512/1003] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 21 16:10:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:10:06.643476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06174ca6-bedd-46a0-85e7-dcbb6bcd8093 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:06.653641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:06.703931 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78ec1b-71bf-4651-a8a1-222745b8213e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:06.740184 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f35b31-807a-4cc3-83d8-5d620da242b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:06.741929 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f35b31-807a-4cc3-83d8-5d620da242b0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:06.742396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f35b31-807a-4cc3-83d8-5d620da242b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:06.742752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f35b31-807a-4cc3-83d8-5d620da242b0 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:06.743813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f35b31-807a-4cc3-83d8-5d620da242b0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:06.744225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:06.744349 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f35b31-807a-4cc3-83d8-5d620da242b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:06.747001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f35b31-807a-4cc3-83d8-5d620da242b0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:06.755333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 492/1004] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 21 16:10:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:06.757355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e361a8-909e-4e84-8fb0-f589d0e041b3 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:06.757780 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e361a8-909e-4e84-8fb0-f589d0e041b3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:06.758238 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e361a8-909e-4e84-8fb0-f589d0e041b3 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:06.760731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 493/1005] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:06.761434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e361a8-909e-4e84-8fb0-f589d0e041b3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:06.769813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06174ca6-bedd-46a0-85e7-dcbb6bcd8093 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:06.807290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89070638-df73-41c9-8172-2418e7c50329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:06.807894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89070638-df73-41c9-8172-2418e7c50329 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:06.808170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89070638-df73-41c9-8172-2418e7c50329 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:06.808440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89070638-df73-41c9-8172-2418e7c50329 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:06.809113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89070638-df73-41c9-8172-2418e7c50329 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:06.809401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89070638-df73-41c9-8172-2418e7c50329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:06.810764 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89070638-df73-41c9-8172-2418e7c50329 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:06.816243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 513/1006] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 21 16:10:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:06.818515 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544b9bb-1075-43eb-83e5-7437e6a50025 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:06.819007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544b9bb-1075-43eb-83e5-7437e6a50025 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:06.819485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544b9bb-1075-43eb-83e5-7437e6a50025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:06.841618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3544b9bb-1075-43eb-83e5-7437e6a50025 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:06.842856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3544b9bb-1075-43eb-83e5-7437e6a50025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:06.882186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e361a8-909e-4e84-8fb0-f589d0e041b3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:06.914820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 514/1007] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:06 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:06.915796 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544b9bb-1075-43eb-83e5-7437e6a50025 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:06.924627 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:06.935178 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2237038-4fcd-4c47-8a6c-363a2c6a901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:06.936179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2237038-4fcd-4c47-8a6c-363a2c6a901a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:06.936622 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2237038-4fcd-4c47-8a6c-363a2c6a901a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:06.937088 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2237038-4fcd-4c47-8a6c-363a2c6a901a None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:06.938106 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2237038-4fcd-4c47-8a6c-363a2c6a901a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:06.938680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2237038-4fcd-4c47-8a6c-363a2c6a901a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:06.941111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2237038-4fcd-4c47-8a6c-363a2c6a901a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:06.951270 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 494/1008] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 21 16:10:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:06.961238 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2237038-4fcd-4c47-8a6c-363a2c6a901a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:07.019431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:07.048127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544b9bb-1075-43eb-83e5-7437e6a50025 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:07.087677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba08dd3-d1bb-4383-8da3-133819d46f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:07.088299 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba08dd3-d1bb-4383-8da3-133819d46f1b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:07.088639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba08dd3-d1bb-4383-8da3-133819d46f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:07.089215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba08dd3-d1bb-4383-8da3-133819d46f1b None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:07.089905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba08dd3-d1bb-4383-8da3-133819d46f1b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:07.090209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba08dd3-d1bb-4383-8da3-133819d46f1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:07.092763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba08dd3-d1bb-4383-8da3-133819d46f1b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:07.098247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 515/1009] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 21 16:10:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:07.104857 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba08dd3-d1bb-4383-8da3-133819d46f1b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:07.137347 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2237038-4fcd-4c47-8a6c-363a2c6a901a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:07.189443 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133d74f-271c-4024-8349-e451806249de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:07.190258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133d74f-271c-4024-8349-e451806249de None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:07.190670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133d74f-271c-4024-8349-e451806249de None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:07.191118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133d74f-271c-4024-8349-e451806249de None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:07.192271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133d74f-271c-4024-8349-e451806249de None admin] RBAC: Adding query filter params (interface=public, service_id=6e295746b39f49a6b13681fa60adb45e, region_id=RegionOne) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:07.192751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133d74f-271c-4024-8349-e451806249de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:07.194601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133d74f-271c-4024-8349-e451806249de None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:07.201944 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 495/1010] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 21 16:10:06 2022] GET /identity/v3/endpoints?service_id=6e295746b39f49a6b13681fa60adb45e&interface=public®ion_id=RegionOne => generated 194 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:07.209436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133d74f-271c-4024-8349-e451806249de None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:07.253975 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba08dd3-d1bb-4383-8da3-133819d46f1b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:07.281127 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:07.292205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26694ed-3881-4583-ac0d-a7fd65ae9d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:07.292863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26694ed-3881-4583-ac0d-a7fd65ae9d96 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:07.293133 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26694ed-3881-4583-ac0d-a7fd65ae9d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:07.293403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26694ed-3881-4583-ac0d-a7fd65ae9d96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:07.294076 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26694ed-3881-4583-ac0d-a7fd65ae9d96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:07.295437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26694ed-3881-4583-ac0d-a7fd65ae9d96 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:07.312758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 516/1011] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:10:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:10:07.313604 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26694ed-3881-4583-ac0d-a7fd65ae9d96 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:07.317555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:07.328023 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133d74f-271c-4024-8349-e451806249de None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:07.381806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae0bfa-9dd2-4d15-b9c2-ad65628a43e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:07.383584 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae0bfa-9dd2-4d15-b9c2-ad65628a43e1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:07.384059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae0bfa-9dd2-4d15-b9c2-ad65628a43e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:07.384516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae0bfa-9dd2-4d15-b9c2-ad65628a43e1 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:07.385477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae0bfa-9dd2-4d15-b9c2-ad65628a43e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:07.387175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae0bfa-9dd2-4d15-b9c2-ad65628a43e1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:07.396198 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 496/1012] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 21 16:10:07 2022] GET /identity/v3/services => generated 1957 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:10:07.465489 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26694ed-3881-4583-ac0d-a7fd65ae9d96 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:07.508837 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c572a-e498-48b4-ba88-21d4d2ec7565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:07.509502 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c572a-e498-48b4-ba88-21d4d2ec7565 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:07.509779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c572a-e498-48b4-ba88-21d4d2ec7565 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:07.510130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c572a-e498-48b4-ba88-21d4d2ec7565 None admin] PATH_INFO: `/v3/services/image` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:07.510745 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c572a-e498-48b4-ba88-21d4d2ec7565 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:07.512183 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c572a-e498-48b4-ba88-21d4d2ec7565 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1f7c572a-e498-48b4-ba88-21d4d2ec7565 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:07.523067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:07.524227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:07.525621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 517/1013] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Sep 21 16:10:07 2022] GET /identity/v3/services/image => generated 86 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:07.534960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae0bfa-9dd2-4d15-b9c2-ad65628a43e1 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:07.698505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae0bfa-9dd2-4d15-b9c2-ad65628a43e1 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:07.735348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:07.761893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373551c-f3c9-4f91-920f-76f1990e2599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:07.762843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373551c-f3c9-4f91-920f-76f1990e2599 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:07.763270 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373551c-f3c9-4f91-920f-76f1990e2599 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:07.763698 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373551c-f3c9-4f91-920f-76f1990e2599 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:07.764784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373551c-f3c9-4f91-920f-76f1990e2599 None admin] RBAC: Adding query filter params (name=image) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:07.765252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373551c-f3c9-4f91-920f-76f1990e2599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:07.767603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373551c-f3c9-4f91-920f-76f1990e2599 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:07.776849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 497/1014] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:07.783113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c572a-e498-48b4-ba88-21d4d2ec7565 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:07.869329 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:07.914454 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c572a-e498-48b4-ba88-21d4d2ec7565 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:07.955276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb6a2a-509e-464f-bc38-98c16ede47f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:07.956182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb6a2a-509e-464f-bc38-98c16ede47f0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:07.956182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb6a2a-509e-464f-bc38-98c16ede47f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:07.956413 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb6a2a-509e-464f-bc38-98c16ede47f0 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:07.957082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb6a2a-509e-464f-bc38-98c16ede47f0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:07.957390 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb6a2a-509e-464f-bc38-98c16ede47f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:07.959640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb6a2a-509e-464f-bc38-98c16ede47f0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:07.972933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 518/1015] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:07.975699 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373551c-f3c9-4f91-920f-76f1990e2599 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:08.132745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373551c-f3c9-4f91-920f-76f1990e2599 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:08.171546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbd48d-877b-47b0-b6b5-e41150a09933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:08.172184 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbd48d-877b-47b0-b6b5-e41150a09933 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:08.172462 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbd48d-877b-47b0-b6b5-e41150a09933 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:08.172750 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbd48d-877b-47b0-b6b5-e41150a09933 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:08.173454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbd48d-877b-47b0-b6b5-e41150a09933 None admin] RBAC: Adding query filter params (interface=public, service_id=0e54be19144e4a0c8ad97a3dc40397ea, region_id=RegionOne) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:08.173760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbd48d-877b-47b0-b6b5-e41150a09933 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:08.175169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbd48d-877b-47b0-b6b5-e41150a09933 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:08.182172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 498/1016] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 21 16:10:07 2022] GET /identity/v3/endpoints?service_id=0e54be19144e4a0c8ad97a3dc40397ea&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:08.188581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb6a2a-509e-464f-bc38-98c16ede47f0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:08.366904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb6a2a-509e-464f-bc38-98c16ede47f0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:08.417810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:08.426952 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9caae-beef-4dc1-b42a-32b59110bba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:08.428631 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9caae-beef-4dc1-b42a-32b59110bba4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:08.429146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9caae-beef-4dc1-b42a-32b59110bba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:08.429617 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9caae-beef-4dc1-b42a-32b59110bba4 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:08.430687 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9caae-beef-4dc1-b42a-32b59110bba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:08.433186 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9caae-beef-4dc1-b42a-32b59110bba4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:08.452717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 519/1017] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 21 16:10:08 2022] GET /identity/v3/services => generated 1957 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:10:09.662873 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eb928-e1ed-46a5-8c71-b541e7f17f44 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:09.663637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eb928-e1ed-46a5-8c71-b541e7f17f44 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:09.663637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eb928-e1ed-46a5-8c71-b541e7f17f44 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:09.664765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 499/1018] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:09.671801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438a95f-d4a3-45e8-94b3-1d397c8fb60b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:09.672339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438a95f-d4a3-45e8-94b3-1d397c8fb60b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:09.672880 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438a95f-d4a3-45e8-94b3-1d397c8fb60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:09.698889 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2438a95f-d4a3-45e8-94b3-1d397c8fb60b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:09.700309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2438a95f-d4a3-45e8-94b3-1d397c8fb60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:09.786569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 520/1019] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:09 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:10:09.866106 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711a772-2664-4125-bb47-ce2cd61bff9b None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:09.866632 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711a772-2664-4125-bb47-ce2cd61bff9b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:09.867105 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711a772-2664-4125-bb47-ce2cd61bff9b None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:09.869892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 500/1020] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:09.878278 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29def-1acc-487b-ac25-7a301671d952 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:09.878775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29def-1acc-487b-ac25-7a301671d952 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:09.879259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29def-1acc-487b-ac25-7a301671d952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:09.908968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e1c29def-1acc-487b-ac25-7a301671d952 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:09.910951 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e1c29def-1acc-487b-ac25-7a301671d952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:10.032785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 521/1021] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:09 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:10.060955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711a772-2664-4125-bb47-ce2cd61bff9b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:10.150588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:10.247845 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711a772-2664-4125-bb47-ce2cd61bff9b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:10.297875 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c29def-1acc-487b-ac25-7a301671d952 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:10.308887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2071eb-1fd8-4643-b8f0-9aedc7ed4890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:10.309980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2071eb-1fd8-4643-b8f0-9aedc7ed4890 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:10.310546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2071eb-1fd8-4643-b8f0-9aedc7ed4890 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:10.311088 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2071eb-1fd8-4643-b8f0-9aedc7ed4890 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:10.312108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2071eb-1fd8-4643-b8f0-9aedc7ed4890 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:10.314812 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2071eb-1fd8-4643-b8f0-9aedc7ed4890 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-ea2071eb-1fd8-4643-b8f0-9aedc7ed4890 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:10.332515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:10.333995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:10.337733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 501/1022] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:10:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:10.341939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2071eb-1fd8-4643-b8f0-9aedc7ed4890 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:10.374149 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:10.447252 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c29def-1acc-487b-ac25-7a301671d952 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:10.479676 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2071eb-1fd8-4643-b8f0-9aedc7ed4890 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:10.487551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e2911-2873-4b35-9751-27b5e294b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:10.488403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e2911-2873-4b35-9751-27b5e294b0bb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:10.488945 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e2911-2873-4b35-9751-27b5e294b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:10.489363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e2911-2873-4b35-9751-27b5e294b0bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:10.491236 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e2911-2873-4b35-9751-27b5e294b0bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:10.492851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e2911-2873-4b35-9751-27b5e294b0bb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:10.495378 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 522/1023] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:10.501479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e2911-2873-4b35-9751-27b5e294b0bb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:10.504433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:10.536614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85492-bf02-4b95-82b1-95bc0aabb30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:10.537765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85492-bf02-4b95-82b1-95bc0aabb30d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:10.538195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85492-bf02-4b95-82b1-95bc0aabb30d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:10.538372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85492-bf02-4b95-82b1-95bc0aabb30d None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:10.538924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f85492-bf02-4b95-82b1-95bc0aabb30d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:10.539223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f85492-bf02-4b95-82b1-95bc0aabb30d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:10.540608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f85492-bf02-4b95-82b1-95bc0aabb30d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:10.548744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 502/1024] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 21 16:10:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:10.555033 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85492-bf02-4b95-82b1-95bc0aabb30d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:10.634040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e2911-2873-4b35-9751-27b5e294b0bb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:10.676643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85492-bf02-4b95-82b1-95bc0aabb30d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:10.679107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:10.701382 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f202cf-467d-4ef4-a375-9dfcac459112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:10.702526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f202cf-467d-4ef4-a375-9dfcac459112 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:10.702995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f202cf-467d-4ef4-a375-9dfcac459112 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:10.703396 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f202cf-467d-4ef4-a375-9dfcac459112 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:10.704524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f202cf-467d-4ef4-a375-9dfcac459112 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:10.707543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f202cf-467d-4ef4-a375-9dfcac459112 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:10.713159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5c76b-ad4f-45f0-8836-5064baae452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:10.714027 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5c76b-ad4f-45f0-8836-5064baae452d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:10.714305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5c76b-ad4f-45f0-8836-5064baae452d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:10.714571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5c76b-ad4f-45f0-8836-5064baae452d None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:10.715191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5c76b-ad4f-45f0-8836-5064baae452d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:10.715489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5c76b-ad4f-45f0-8836-5064baae452d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:10.716915 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5c76b-ad4f-45f0-8836-5064baae452d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:10.726574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 503/1025] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 21 16:10:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:10.727874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5c76b-ad4f-45f0-8836-5064baae452d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:10.762877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 523/1026] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 21 16:10:10 2022] POST /identity/v3/projects => generated 311 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:10:10.796663 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:10.870509 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5c76b-ad4f-45f0-8836-5064baae452d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:10.912422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fe861-e765-41c3-b625-3dbdc686b022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:10.912978 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fe861-e765-41c3-b625-3dbdc686b022 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:10.913254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fe861-e765-41c3-b625-3dbdc686b022 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:10.913521 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fe861-e765-41c3-b625-3dbdc686b022 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:10.914202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fe861-e765-41c3-b625-3dbdc686b022 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:10.915611 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fe861-e765-41c3-b625-3dbdc686b022 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:10.939713 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 504/1027] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:10:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:10:11.126006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57790b4-5729-49e4-a8ab-b32c4431ca7c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:11.126497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57790b4-5729-49e4-a8ab-b32c4431ca7c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:11.126983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57790b4-5729-49e4-a8ab-b32c4431ca7c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:11.129510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 524/1028] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:11.135802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46656a-3971-48a9-baed-8d31c7932db3 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:11.136170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46656a-3971-48a9-baed-8d31c7932db3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:11.136461 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46656a-3971-48a9-baed-8d31c7932db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:11.157292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-fd46656a-3971-48a9-baed-8d31c7932db3 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:11.158520 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-fd46656a-3971-48a9-baed-8d31c7932db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:11.275697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 505/1029] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:11.544011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57790b4-5729-49e4-a8ab-b32c4431ca7c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:11.713348 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57790b4-5729-49e4-a8ab-b32c4431ca7c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:11.755493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b99ce9-8a30-4de2-9078-809f142bd222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:11.756186 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99ce9-8a30-4de2-9078-809f142bd222 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:11.756466 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99ce9-8a30-4de2-9078-809f142bd222 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:11.756769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99ce9-8a30-4de2-9078-809f142bd222 None admin] PATH_INFO: `/v3/services/image` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:11.757869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b99ce9-8a30-4de2-9078-809f142bd222 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:11.759267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b99ce9-8a30-4de2-9078-809f142bd222 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-36b99ce9-8a30-4de2-9078-809f142bd222 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:11.771685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:11.777513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:11.778379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 525/1030] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Sep 21 16:10:11 2022] GET /identity/v3/services/image => generated 86 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:11.781290 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46656a-3971-48a9-baed-8d31c7932db3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:11.819106 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:11.959958 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46656a-3971-48a9-baed-8d31c7932db3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:12.019870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c4fad-e291-4719-9fed-a4bbeac402fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:12.020915 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c4fad-e291-4719-9fed-a4bbeac402fc None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:12.025553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c4fad-e291-4719-9fed-a4bbeac402fc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:12.025553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c4fad-e291-4719-9fed-a4bbeac402fc None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:12.025553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c4fad-e291-4719-9fed-a4bbeac402fc None admin] RBAC: Adding query filter params (name=image) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:12.025553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c4fad-e291-4719-9fed-a4bbeac402fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:12.026175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c4fad-e291-4719-9fed-a4bbeac402fc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:12.035487 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 506/1031] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:12.045970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b99ce9-8a30-4de2-9078-809f142bd222 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:12.117572 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:12.184901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b99ce9-8a30-4de2-9078-809f142bd222 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:12.225554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6a401-76f8-49b9-8fd6-667c702c2523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:12.226324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6a401-76f8-49b9-8fd6-667c702c2523 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:12.226597 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6a401-76f8-49b9-8fd6-667c702c2523 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:12.227583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6a401-76f8-49b9-8fd6-667c702c2523 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:12.228347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6a401-76f8-49b9-8fd6-667c702c2523 None admin] RBAC: Adding query filter params (type=image) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:12.228842 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6a401-76f8-49b9-8fd6-667c702c2523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:12.230173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6a401-76f8-49b9-8fd6-667c702c2523 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:12.235906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 526/1032] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:12.243503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c4fad-e291-4719-9fed-a4bbeac402fc None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:12.358815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:12.386470 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c4fad-e291-4719-9fed-a4bbeac402fc None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:12.428602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44481597-fb90-411a-9814-8912f49fed6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:12.429305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481597-fb90-411a-9814-8912f49fed6b None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:12.429579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481597-fb90-411a-9814-8912f49fed6b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:12.429841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481597-fb90-411a-9814-8912f49fed6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:12.430564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44481597-fb90-411a-9814-8912f49fed6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:12.431994 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44481597-fb90-411a-9814-8912f49fed6b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:12.464927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 507/1033] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:10:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:10:13.169470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577d85a-3993-4530-b257-e8232fd68cdc None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:13.170101 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577d85a-3993-4530-b257-e8232fd68cdc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:13.170101 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577d85a-3993-4530-b257-e8232fd68cdc None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:13.171350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 527/1034] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:13.177632 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb1599-f38a-4838-a7fa-b0186a15b0d7 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:13.178183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb1599-f38a-4838-a7fa-b0186a15b0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:13.178183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb1599-f38a-4838-a7fa-b0186a15b0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:13.198206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-f1cb1599-f38a-4838-a7fa-b0186a15b0d7 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:13.199412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f1cb1599-f38a-4838-a7fa-b0186a15b0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:13.291433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 508/1035] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:10:13.363671 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ae00d-c63c-4dea-a797-1f9db4275023 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:13.363671 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ae00d-c63c-4dea-a797-1f9db4275023 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:13.364185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ae00d-c63c-4dea-a797-1f9db4275023 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:13.366567 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 528/1036] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:13.378220 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a44eb-92ec-4784-a69f-73faa4946c01 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:13.378695 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a44eb-92ec-4784-a69f-73faa4946c01 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:13.378975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a44eb-92ec-4784-a69f-73faa4946c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:13.408807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-274a44eb-92ec-4784-a69f-73faa4946c01 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:13.410091 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-274a44eb-92ec-4784-a69f-73faa4946c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:13.526154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:13.538899 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 509/1037] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:13.621498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ae00d-c63c-4dea-a797-1f9db4275023 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:13.799022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ae00d-c63c-4dea-a797-1f9db4275023 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:13.804118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:13.822616 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a44eb-92ec-4784-a69f-73faa4946c01 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:13.860991 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab8ac4-06b8-4448-b697-c34b3b92a10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:13.861638 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab8ac4-06b8-4448-b697-c34b3b92a10b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:13.861913 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab8ac4-06b8-4448-b697-c34b3b92a10b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:13.862183 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab8ac4-06b8-4448-b697-c34b3b92a10b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:13.863363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab8ac4-06b8-4448-b697-c34b3b92a10b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:13.864890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab8ac4-06b8-4448-b697-c34b3b92a10b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:13.868736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 529/1038] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:13.876816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab8ac4-06b8-4448-b697-c34b3b92a10b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:13.947329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a44eb-92ec-4784-a69f-73faa4946c01 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:13.994426 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf32437-1a19-40cd-a900-c3b103d0554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:13.995374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf32437-1a19-40cd-a900-c3b103d0554f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:13.995782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf32437-1a19-40cd-a900-c3b103d0554f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:13.996190 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf32437-1a19-40cd-a900-c3b103d0554f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:14.005316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab8ac4-06b8-4448-b697-c34b3b92a10b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:14.011689 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf32437-1a19-40cd-a900-c3b103d0554f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-baf32437-1a19-40cd-a900-c3b103d0554f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:10:14.017123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:14.020979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:14.022580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:14.022580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:14.022580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:14.022580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:14.022580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:10:14.022580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:10:14.022580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:10:14.022580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:10:14.022580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:10:14.022580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:10:14.022580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 16:10:14.022580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:14.022580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 510/1039] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 21 16:10:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:10:14.025989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf32437-1a19-40cd-a900-c3b103d0554f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:14.050693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08593e5-d8fd-49a3-96f9-8c99a4cd20e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:14.051229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08593e5-d8fd-49a3-96f9-8c99a4cd20e2 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:14.051503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08593e5-d8fd-49a3-96f9-8c99a4cd20e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:14.051772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08593e5-d8fd-49a3-96f9-8c99a4cd20e2 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:14.052497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08593e5-d8fd-49a3-96f9-8c99a4cd20e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:14.054006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08593e5-d8fd-49a3-96f9-8c99a4cd20e2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:14.078761 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 530/1040] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:10:13 2022] POST /identity/v3/users => generated 285 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:10:14.099231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:14.155149 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf32437-1a19-40cd-a900-c3b103d0554f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:14.198088 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bc666-c771-47a9-9c81-cd61b8d40a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:14.199131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bc666-c771-47a9-9c81-cd61b8d40a5c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:14.199479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bc666-c771-47a9-9c81-cd61b8d40a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:14.199888 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bc666-c771-47a9-9c81-cd61b8d40a5c None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:14.200787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bc666-c771-47a9-9c81-cd61b8d40a5c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:14.201255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bc666-c771-47a9-9c81-cd61b8d40a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:14.202892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bc666-c771-47a9-9c81-cd61b8d40a5c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:14.219035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 511/1041] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 21 16:10:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:14.220493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08593e5-d8fd-49a3-96f9-8c99a4cd20e2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:14.258042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:14.360221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08593e5-d8fd-49a3-96f9-8c99a4cd20e2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:14.399161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c186db-e00d-4024-a3de-3a3a106b66b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:14.399985 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c186db-e00d-4024-a3de-3a3a106b66b7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:14.400392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c186db-e00d-4024-a3de-3a3a106b66b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:14.400840 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c186db-e00d-4024-a3de-3a3a106b66b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:14.414692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c186db-e00d-4024-a3de-3a3a106b66b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:14.416363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c186db-e00d-4024-a3de-3a3a106b66b7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-87c186db-e00d-4024-a3de-3a3a106b66b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:10:14.433313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:14.435225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:10:14.437177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:10:14.437177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:10:14.437177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:14.437177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 531/1042] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:10:14.441197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bc666-c771-47a9-9c81-cd61b8d40a5c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:14.566698 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bc666-c771-47a9-9c81-cd61b8d40a5c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:14.589490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:14.607170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89593f-af27-489f-b181-01606bb50798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:14.607772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89593f-af27-489f-b181-01606bb50798 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:14.608087 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89593f-af27-489f-b181-01606bb50798 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:14.608359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89593f-af27-489f-b181-01606bb50798 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:14.609030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89593f-af27-489f-b181-01606bb50798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:14.609317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89593f-af27-489f-b181-01606bb50798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:14.610750 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89593f-af27-489f-b181-01606bb50798 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:14.625351 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 512/1043] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:14.630957 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c186db-e00d-4024-a3de-3a3a106b66b7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:14.731755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:14.755226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c186db-e00d-4024-a3de-3a3a106b66b7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:14.787354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a38c1-e75c-4e6b-ac76-0a5b32ea1d29 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:14.787775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a38c1-e75c-4e6b-ac76-0a5b32ea1d29 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:14.788185 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a38c1-e75c-4e6b-ac76-0a5b32ea1d29 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:14.790364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 513/1044] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:14.797922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20946c5c-bdc6-44e5-8c4c-3f0c5b982bcb None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:14.798538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20946c5c-bdc6-44e5-8c4c-3f0c5b982bcb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:14.798887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058ab90-bfee-49f3-8b49-b824a2906e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:14.799022 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20946c5c-bdc6-44e5-8c4c-3f0c5b982bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:14.799522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058ab90-bfee-49f3-8b49-b824a2906e87 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:14.799794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058ab90-bfee-49f3-8b49-b824a2906e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:14.800109 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058ab90-bfee-49f3-8b49-b824a2906e87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:14.809161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058ab90-bfee-49f3-8b49-b824a2906e87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:14.810588 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058ab90-bfee-49f3-8b49-b824a2906e87 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b058ab90-bfee-49f3-8b49-b824a2906e87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:10:14.822793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:14.823909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:14.825012 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:14.825012 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:14.825012 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:10:14.825012 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:10:14.825012 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:10:14.825012 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:10:14.825012 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:10:14.825012 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:10:14.825012 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:10:14.825012 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:14.827997 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 532/1045] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 21 16:10:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:10:14.829673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058ab90-bfee-49f3-8b49-b824a2906e87 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:14.829826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-20946c5c-bdc6-44e5-8c4c-3f0c5b982bcb None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:14.831741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-20946c5c-bdc6-44e5-8c4c-3f0c5b982bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:14.952245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 514/1046] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:14.974247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058ab90-bfee-49f3-8b49-b824a2906e87 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:15.032182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798f0fd-5bce-496b-b2a7-6caf5210fa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:15.033232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798f0fd-5bce-496b-b2a7-6caf5210fa7b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:15.033733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798f0fd-5bce-496b-b2a7-6caf5210fa7b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:15.034230 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798f0fd-5bce-496b-b2a7-6caf5210fa7b None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:15.035520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798f0fd-5bce-496b-b2a7-6caf5210fa7b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:15.036079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798f0fd-5bce-496b-b2a7-6caf5210fa7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:15.038801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798f0fd-5bce-496b-b2a7-6caf5210fa7b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:15.055714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:15.078418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 533/1047] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 21 16:10:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:15.079966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20946c5c-bdc6-44e5-8c4c-3f0c5b982bcb None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:15.229881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798f0fd-5bce-496b-b2a7-6caf5210fa7b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:15.249162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20946c5c-bdc6-44e5-8c4c-3f0c5b982bcb None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:15.261757 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:15.292025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afe397-0abd-4601-a643-ca44120a7a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:15.293139 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe397-0abd-4601-a643-ca44120a7a6e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:15.293598 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe397-0abd-4601-a643-ca44120a7a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:15.294025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe397-0abd-4601-a643-ca44120a7a6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:15.364541 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798f0fd-5bce-496b-b2a7-6caf5210fa7b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:15.379236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afe397-0abd-4601-a643-ca44120a7a6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:15.380997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afe397-0abd-4601-a643-ca44120a7a6e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:15.409306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae1d6-7be5-466a-8132-0194ae425cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:15.409916 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae1d6-7be5-466a-8132-0194ae425cdb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:15.410178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae1d6-7be5-466a-8132-0194ae425cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:15.410718 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae1d6-7be5-466a-8132-0194ae425cdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:15.498660 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:15.501881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ae1d6-7be5-466a-8132-0194ae425cdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:15.503699 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ae1d6-7be5-466a-8132-0194ae425cdb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:15.518978 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 515/1048] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:10:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:10:15.520415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afe397-0abd-4601-a643-ca44120a7a6e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:15.538575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:15.667920 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 534/1049] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:10:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 16:10:15.678109 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae1d6-7be5-466a-8132-0194ae425cdb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:15.679087 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afe397-0abd-4601-a643-ca44120a7a6e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:15.736119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bbc1d-dc03-49b6-a3a1-1dae85bbfed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:15.736962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bbc1d-dc03-49b6-a3a1-1dae85bbfed8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:15.737364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bbc1d-dc03-49b6-a3a1-1dae85bbfed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:15.737753 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bbc1d-dc03-49b6-a3a1-1dae85bbfed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:15.754621 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bbc1d-dc03-49b6-a3a1-1dae85bbfed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:15.757064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bbc1d-dc03-49b6-a3a1-1dae85bbfed8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-815bbc1d-dc03-49b6-a3a1-1dae85bbfed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:10:15.780884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:15.782759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:10:15.783740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:10:15.783740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:10:15.783740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:15.783740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 516/1050] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:15.792230 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bbc1d-dc03-49b6-a3a1-1dae85bbfed8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:15.835422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:15.841722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae1d6-7be5-466a-8132-0194ae425cdb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:15.880011 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:15.888361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9f518-dafa-47b8-9c23-be2b3e5a0091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:15.889047 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9f518-dafa-47b8-9c23-be2b3e5a0091 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:15.889355 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9f518-dafa-47b8-9c23-be2b3e5a0091 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:15.889575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9f518-dafa-47b8-9c23-be2b3e5a0091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:15.901469 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9f518-dafa-47b8-9c23-be2b3e5a0091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:15.903010 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9f518-dafa-47b8-9c23-be2b3e5a0091 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0ba9f518-dafa-47b8-9c23-be2b3e5a0091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:10:15.922653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:15.923757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:10:15.930994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:10:15.930994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:10:15.930994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:15.930994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 535/1051] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:15.930994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9f518-dafa-47b8-9c23-be2b3e5a0091 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:15.938758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bbc1d-dc03-49b6-a3a1-1dae85bbfed8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:15.987392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22330b8a-ce84-4d6c-a094-f47783c328bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:15.988355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22330b8a-ce84-4d6c-a094-f47783c328bf None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:15.988834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22330b8a-ce84-4d6c-a094-f47783c328bf None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:15.989286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22330b8a-ce84-4d6c-a094-f47783c328bf None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:15.990428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22330b8a-ce84-4d6c-a094-f47783c328bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:15.990923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22330b8a-ce84-4d6c-a094-f47783c328bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:15.993332 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22330b8a-ce84-4d6c-a094-f47783c328bf None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:16.025151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 517/1052] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:16.027864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22330b8a-ce84-4d6c-a094-f47783c328bf None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:16.105188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9f518-dafa-47b8-9c23-be2b3e5a0091 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:16.161932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5dd44-89b6-4dea-adc2-dee85c2b34ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:16.162602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5dd44-89b6-4dea-adc2-dee85c2b34ce None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:16.163059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5dd44-89b6-4dea-adc2-dee85c2b34ce None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:16.163440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5dd44-89b6-4dea-adc2-dee85c2b34ce None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:16.164128 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5dd44-89b6-4dea-adc2-dee85c2b34ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:16.164556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5dd44-89b6-4dea-adc2-dee85c2b34ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:16.166156 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5dd44-89b6-4dea-adc2-dee85c2b34ce None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:16.171709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22330b8a-ce84-4d6c-a094-f47783c328bf None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:16.184423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 536/1053] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:16.215124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:16.238385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fab6ba-3f87-4575-a11d-420c8780a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:16.239494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fab6ba-3f87-4575-a11d-420c8780a424 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:16.240908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fab6ba-3f87-4575-a11d-420c8780a424 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:16.241146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fab6ba-3f87-4575-a11d-420c8780a424 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:16.253736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fab6ba-3f87-4575-a11d-420c8780a424 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:16.256126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fab6ba-3f87-4575-a11d-420c8780a424 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-23fab6ba-3f87-4575-a11d-420c8780a424 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:10:16.268999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:16.270233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:16.271858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:10:16.271858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:10:16.271858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:10:16.271858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:10:16.271858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:10:16.271858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:10:16.271858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:10:16.271858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:16.273376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 518/1054] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:10:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:16.276557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5dd44-89b6-4dea-adc2-dee85c2b34ce None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:16.293740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:16.443199 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5dd44-89b6-4dea-adc2-dee85c2b34ce None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:16.486978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bd446-5ce5-42dd-aad7-e4191c59a3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:16.487904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd446-5ce5-42dd-aad7-e4191c59a3bb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:16.487904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd446-5ce5-42dd-aad7-e4191c59a3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:16.488193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd446-5ce5-42dd-aad7-e4191c59a3bb None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:16.488895 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bd446-5ce5-42dd-aad7-e4191c59a3bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:16.489199 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bd446-5ce5-42dd-aad7-e4191c59a3bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:16.490752 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bd446-5ce5-42dd-aad7-e4191c59a3bb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:16.504201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 537/1055] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:10:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:16.511351 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fab6ba-3f87-4575-a11d-420c8780a424 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:16.515208 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd767fd-c652-4d11-932e-a862f4277bff None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:16.515510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd767fd-c652-4d11-932e-a862f4277bff None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:16.515762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd767fd-c652-4d11-932e-a862f4277bff None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:16.517365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 538/1056] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:10:16.523574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca104e51-9cd1-40ac-96c9-8e85c29de5bb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:16.523861 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca104e51-9cd1-40ac-96c9-8e85c29de5bb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:16.524127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca104e51-9cd1-40ac-96c9-8e85c29de5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:16.543748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ca104e51-9cd1-40ac-96c9-8e85c29de5bb None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:16.544913 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ca104e51-9cd1-40ac-96c9-8e85c29de5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:16.614417 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:16.620155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 539/1057] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:10:16.648534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fab6ba-3f87-4575-a11d-420c8780a424 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:16.687644 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc880c-19f5-43b8-961a-dfa8bbe222be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:16.688261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc880c-19f5-43b8-961a-dfa8bbe222be None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:16.688539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc880c-19f5-43b8-961a-dfa8bbe222be None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:16.688843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc880c-19f5-43b8-961a-dfa8bbe222be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:16.689596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc880c-19f5-43b8-961a-dfa8bbe222be None admin] RBAC: Adding query filter params (role.id=ac5c4a11a0f94428ac80cfb9130336f0, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=d7ff08c990dc41b4811f97fecb7c4c3a) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:16.689885 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc880c-19f5-43b8-961a-dfa8bbe222be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:16.691321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc880c-19f5-43b8-961a-dfa8bbe222be None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:16.698433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 519/1058] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:10:16 2022] GET /identity/v3/role_assignments?user.id=d7ff08c990dc41b4811f97fecb7c4c3a&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=ac5c4a11a0f94428ac80cfb9130336f0 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:16.892356 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca104e51-9cd1-40ac-96c9-8e85c29de5bb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:17.002339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca104e51-9cd1-40ac-96c9-8e85c29de5bb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:17.038415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7455a9e-206d-42fa-a714-e0a568ca177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:17.039043 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7455a9e-206d-42fa-a714-e0a568ca177a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:17.039315 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7455a9e-206d-42fa-a714-e0a568ca177a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:17.039582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7455a9e-206d-42fa-a714-e0a568ca177a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:17.050816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7455a9e-206d-42fa-a714-e0a568ca177a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b7455a9e-206d-42fa-a714-e0a568ca177a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:10:17.058582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:17.059619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:17.060462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:17.060462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:17.060462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:17.060462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:17.060462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:10:17.060462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:10:17.060462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:10:17.060462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:10:17.060462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:10:17.060462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:10:17.060462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:10:17.060462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:17.060462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 540/1059] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:10:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:17.070267 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc880c-19f5-43b8-961a-dfa8bbe222be None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:17.158486 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:17.253249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc880c-19f5-43b8-961a-dfa8bbe222be None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:17.293494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27413553-62b9-4092-867e-fc282b7a9ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:17.294201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413553-62b9-4092-867e-fc282b7a9ebb None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:17.294376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413553-62b9-4092-867e-fc282b7a9ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:17.294644 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413553-62b9-4092-867e-fc282b7a9ebb None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:17.295316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27413553-62b9-4092-867e-fc282b7a9ebb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:17.295612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27413553-62b9-4092-867e-fc282b7a9ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:17.297030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27413553-62b9-4092-867e-fc282b7a9ebb None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:17.308901 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 520/1060] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:10:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:17.315037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7455a9e-206d-42fa-a714-e0a568ca177a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:17.386484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:17.435090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7455a9e-206d-42fa-a714-e0a568ca177a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:17.483348 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5aa587-114a-49f2-970d-3aa72c6a7f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:17.484236 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5aa587-114a-49f2-970d-3aa72c6a7f87 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:17.484604 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5aa587-114a-49f2-970d-3aa72c6a7f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:17.484996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5aa587-114a-49f2-970d-3aa72c6a7f87 None admin] PATH_INFO: `/v3/users/5783b60619c84d6cbc4d4cce3b58a250` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:17.500807 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5aa587-114a-49f2-970d-3aa72c6a7f87 None admin] RBAC: Authorizing `identity:get_user(user_id=5783b60619c84d6cbc4d4cce3b58a250)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:17.502269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5aa587-114a-49f2-970d-3aa72c6a7f87 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:17.504003 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 541/1061] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:10:17 2022] GET /identity/v3/users/5783b60619c84d6cbc4d4cce3b58a250 => generated 285 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:17.509892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27413553-62b9-4092-867e-fc282b7a9ebb None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:17.635606 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27413553-62b9-4092-867e-fc282b7a9ebb None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:17.645857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:17.684874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00735948-2548-493e-ae2c-772825e1a3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:17.685947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00735948-2548-493e-ae2c-772825e1a3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:17.686342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00735948-2548-493e-ae2c-772825e1a3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:17.686801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00735948-2548-493e-ae2c-772825e1a3c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:17.787342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00735948-2548-493e-ae2c-772825e1a3c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:17.788840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00735948-2548-493e-ae2c-772825e1a3c5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:17.904436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 521/1062] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:10:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:10:17.912158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5aa587-114a-49f2-970d-3aa72c6a7f87 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:18.035161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5aa587-114a-49f2-970d-3aa72c6a7f87 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:18.061064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:18.082759 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a68f5-7322-4d66-95c5-93438d3df3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:18.083398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a68f5-7322-4d66-95c5-93438d3df3ee None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:18.083733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a68f5-7322-4d66-95c5-93438d3df3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:18.083999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a68f5-7322-4d66-95c5-93438d3df3ee None admin] PATH_INFO: `/v3/projects/c49ae1433117431588d37cb2881fd99c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:18.085170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a68f5-7322-4d66-95c5-93438d3df3ee None admin] RBAC: Authorizing `identity:get_project(project_id=c49ae1433117431588d37cb2881fd99c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:18.086593 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a68f5-7322-4d66-95c5-93438d3df3ee None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:18.088256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 542/1063] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:10:17 2022] GET /identity/v3/projects/c49ae1433117431588d37cb2881fd99c => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:18.095397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00735948-2548-493e-ae2c-772825e1a3c5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:18.114078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:18.248544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00735948-2548-493e-ae2c-772825e1a3c5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:18.295577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21834fe-18e2-4769-ab70-3d18930da1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:18.296460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21834fe-18e2-4769-ab70-3d18930da1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:18.296460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21834fe-18e2-4769-ab70-3d18930da1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:18.296654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21834fe-18e2-4769-ab70-3d18930da1a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:18.297379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21834fe-18e2-4769-ab70-3d18930da1a3 None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=c49ae1433117431588d37cb2881fd99c, user.id=5783b60619c84d6cbc4d4cce3b58a250) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:18.297688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21834fe-18e2-4769-ab70-3d18930da1a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:18.299130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21834fe-18e2-4769-ab70-3d18930da1a3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:18.306024 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 522/1064] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:10:18 2022] GET /identity/v3/role_assignments?user.id=5783b60619c84d6cbc4d4cce3b58a250&scope.project.id=c49ae1433117431588d37cb2881fd99c&role.id=beec000223e041209205627bfa0dbed1 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:19.024908 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfa3ae-20c1-4e52-ac1d-8b699875e9de None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:19.025568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfa3ae-20c1-4e52-ac1d-8b699875e9de None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:19.025568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfa3ae-20c1-4e52-ac1d-8b699875e9de None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:19.026800 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 543/1065] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:19.032414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a4b3f-7323-463d-8757-e908583f3e5a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:19.032869 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a4b3f-7323-463d-8757-e908583f3e5a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:19.033258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a4b3f-7323-463d-8757-e908583f3e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:19.053511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-666a4b3f-7323-463d-8757-e908583f3e5a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:19.054724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-666a4b3f-7323-463d-8757-e908583f3e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:19.129012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 523/1066] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:19.405848 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfa3ae-20c1-4e52-ac1d-8b699875e9de None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:19.513854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfa3ae-20c1-4e52-ac1d-8b699875e9de None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:19.555094 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd9cc8-2874-4e6b-8bea-01dd919b8829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:19.555731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd9cc8-2874-4e6b-8bea-01dd919b8829 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:19.556002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd9cc8-2874-4e6b-8bea-01dd919b8829 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:19.556268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd9cc8-2874-4e6b-8bea-01dd919b8829 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:19.567193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd9cc8-2874-4e6b-8bea-01dd919b8829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a8bd9cc8-2874-4e6b-8bea-01dd919b8829 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:10:19.572643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:19.574505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:19.576381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:19.576381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:19.576381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:19.576381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:19.576381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:10:19.576381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:10:19.576381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:10:19.576381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:10:19.576381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:10:19.576381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:10:19.576381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 16:10:19.576381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:19.578244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 544/1067] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 21 16:10:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:10:19.579868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a4b3f-7323-463d-8757-e908583f3e5a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:19.582165 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:19.688249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a4b3f-7323-463d-8757-e908583f3e5a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:19.725942 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7139f-416e-465d-a3be-7f3cea42ac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:19.726546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7139f-416e-465d-a3be-7f3cea42ac65 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:19.726820 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7139f-416e-465d-a3be-7f3cea42ac65 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:19.727088 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7139f-416e-465d-a3be-7f3cea42ac65 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:19.727757 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7139f-416e-465d-a3be-7f3cea42ac65 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:19.728062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7139f-416e-465d-a3be-7f3cea42ac65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:19.729520 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7139f-416e-465d-a3be-7f3cea42ac65 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:19.738160 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 524/1068] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 21 16:10:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:19.744004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd9cc8-2874-4e6b-8bea-01dd919b8829 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:19.794632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:19.860135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd9cc8-2874-4e6b-8bea-01dd919b8829 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:19.899725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8f57d-e09f-4c4c-ba58-896add7e9294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:19.900396 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8f57d-e09f-4c4c-ba58-896add7e9294 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:19.900670 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8f57d-e09f-4c4c-ba58-896add7e9294 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:19.900961 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8f57d-e09f-4c4c-ba58-896add7e9294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:19.913122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8f57d-e09f-4c4c-ba58-896add7e9294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:19.914585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8f57d-e09f-4c4c-ba58-896add7e9294 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-17f8f57d-e09f-4c4c-ba58-896add7e9294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:10:19.930395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:19.932233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:10:19.933227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:10:19.933227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:10:19.933227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:19.933227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 545/1069] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:19.938434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7139f-416e-465d-a3be-7f3cea42ac65 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:20.044852 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:20.087443 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7139f-416e-465d-a3be-7f3cea42ac65 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:20.125262 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e8102-fdab-46a4-bab8-18a074e0d829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:20.125881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e8102-fdab-46a4-bab8-18a074e0d829 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:20.126149 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e8102-fdab-46a4-bab8-18a074e0d829 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:20.126412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e8102-fdab-46a4-bab8-18a074e0d829 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:20.127056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e8102-fdab-46a4-bab8-18a074e0d829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:20.127355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e8102-fdab-46a4-bab8-18a074e0d829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:20.128737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e8102-fdab-46a4-bab8-18a074e0d829 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:20.141831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 525/1070] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:20.148029 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8f57d-e09f-4c4c-ba58-896add7e9294 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:20.279936 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:20.284135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8f57d-e09f-4c4c-ba58-896add7e9294 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:20.325564 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3af625-4222-4534-952b-81a1990d03d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:20.326382 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3af625-4222-4534-952b-81a1990d03d5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:20.326823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3af625-4222-4534-952b-81a1990d03d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:20.327304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3af625-4222-4534-952b-81a1990d03d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:20.341018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3af625-4222-4534-952b-81a1990d03d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:20.343548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3af625-4222-4534-952b-81a1990d03d5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-de3af625-4222-4534-952b-81a1990d03d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:10:20.357727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:20.359790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:20.361877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:20.361877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:20.361877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:10:20.361877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:10:20.361877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:10:20.361877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:10:20.361877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:10:20.361877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:10:20.361877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:10:20.361877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:20.361877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 546/1071] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 21 16:10:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:20.367046 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e8102-fdab-46a4-bab8-18a074e0d829 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:20.495227 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e8102-fdab-46a4-bab8-18a074e0d829 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:20.525739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:20.540765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d8f98-5c3d-4b1e-9191-75b0fc6c53ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:20.541308 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8f98-5c3d-4b1e-9191-75b0fc6c53ea None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:20.541582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8f98-5c3d-4b1e-9191-75b0fc6c53ea None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:20.541854 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8f98-5c3d-4b1e-9191-75b0fc6c53ea None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:20.543424 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d8f98-5c3d-4b1e-9191-75b0fc6c53ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:20.543737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d8f98-5c3d-4b1e-9191-75b0fc6c53ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:20.546081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d8f98-5c3d-4b1e-9191-75b0fc6c53ea None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:20.565939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 526/1072] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 21 16:10:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:20.573904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3af625-4222-4534-952b-81a1990d03d5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:20.587747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3bbdf-c7d1-493e-a9a0-6f363ad1beb4 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:20.588308 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3bbdf-c7d1-493e-a9a0-6f363ad1beb4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:20.588308 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3bbdf-c7d1-493e-a9a0-6f363ad1beb4 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:20.589950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 527/1073] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:10:20.595517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a8b00-ce4e-47e6-9c78-499d73494305 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:20.595797 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a8b00-ce4e-47e6-9c78-499d73494305 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:20.596060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a8b00-ce4e-47e6-9c78-499d73494305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:20.614280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c65a8b00-ce4e-47e6-9c78-499d73494305 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:20.616031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c65a8b00-ce4e-47e6-9c78-499d73494305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:20.689398 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 528/1074] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:10:20.744834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3af625-4222-4534-952b-81a1990d03d5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:20.789817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cd02f-7d5a-4bdb-afc3-8d64df62f548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:20.790494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd02f-7d5a-4bdb-afc3-8d64df62f548 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:20.790850 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd02f-7d5a-4bdb-afc3-8d64df62f548 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:20.791025 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd02f-7d5a-4bdb-afc3-8d64df62f548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:20.804606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cd02f-7d5a-4bdb-afc3-8d64df62f548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:20.806176 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cd02f-7d5a-4bdb-afc3-8d64df62f548 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-328cd02f-7d5a-4bdb-afc3-8d64df62f548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:10:20.823056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:20.825210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:10:20.827022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:10:20.827022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:10:20.827022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:20.827022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 547/1075] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:20.830820 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a8b00-ce4e-47e6-9c78-499d73494305 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:20.979257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a8b00-ce4e-47e6-9c78-499d73494305 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:20.995897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:21.011841 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cd02f-7d5a-4bdb-afc3-8d64df62f548 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:21.020673 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5ecae-18ce-4f31-a6bc-04554e79e1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:21.021964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ecae-18ce-4f31-a6bc-04554e79e1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:21.022236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ecae-18ce-4f31-a6bc-04554e79e1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:21.022503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ecae-18ce-4f31-a6bc-04554e79e1f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:21.023156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5ecae-18ce-4f31-a6bc-04554e79e1f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:21.023450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5ecae-18ce-4f31-a6bc-04554e79e1f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:21.024868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5ecae-18ce-4f31-a6bc-04554e79e1f2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:21.027018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:21.037801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 529/1076] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:21.043670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5ecae-18ce-4f31-a6bc-04554e79e1f2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:21.161604 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cd02f-7d5a-4bdb-afc3-8d64df62f548 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:21.184809 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5ecae-18ce-4f31-a6bc-04554e79e1f2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:21.199582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308a1ba-b6ef-4542-aad5-000976f07c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:21.200213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a1ba-b6ef-4542-aad5-000976f07c39 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:21.200470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a1ba-b6ef-4542-aad5-000976f07c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:21.200779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a1ba-b6ef-4542-aad5-000976f07c39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:21.213008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308a1ba-b6ef-4542-aad5-000976f07c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8308a1ba-b6ef-4542-aad5-000976f07c39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:10:21.218269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:21.219293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:21.220194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:21.220194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:21.220194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:21.220194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:21.220194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:10:21.220194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:10:21.220194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:10:21.220194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:10:21.220194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:10:21.220194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:10:21.220194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:10:21.220194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:21.220194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 548/1077] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:10:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:10:21.222128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaca01-6bff-4d32-b494-e7b59061628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:21.222767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaca01-6bff-4d32-b494-e7b59061628a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:21.223044 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaca01-6bff-4d32-b494-e7b59061628a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:21.223316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaca01-6bff-4d32-b494-e7b59061628a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:21.225528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308a1ba-b6ef-4542-aad5-000976f07c39 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:21.230564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeaca01-6bff-4d32-b494-e7b59061628a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:21.232012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeaca01-6bff-4d32-b494-e7b59061628a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-baeaca01-6bff-4d32-b494-e7b59061628a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:10:21.245664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:21.246804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:21.248544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:10:21.248544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:10:21.248544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:10:21.248544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:10:21.248544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:10:21.248544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:10:21.248544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:10:21.248544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:21.248544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 530/1078] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:10:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:10:21.252658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaca01-6bff-4d32-b494-e7b59061628a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:21.287872 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:21.296357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:21.332015 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308a1ba-b6ef-4542-aad5-000976f07c39 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:21.360590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaca01-6bff-4d32-b494-e7b59061628a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:21.367304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e90dc-f6ef-4634-a3df-b7121c27ac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:21.367907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e90dc-f6ef-4634-a3df-b7121c27ac39 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:21.368182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e90dc-f6ef-4634-a3df-b7121c27ac39 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:21.368444 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e90dc-f6ef-4634-a3df-b7121c27ac39 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:21.369125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e90dc-f6ef-4634-a3df-b7121c27ac39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:21.369424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e90dc-f6ef-4634-a3df-b7121c27ac39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:21.370771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e90dc-f6ef-4634-a3df-b7121c27ac39 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:21.379366 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 549/1079] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:10:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:21.385863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e90dc-f6ef-4634-a3df-b7121c27ac39 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:21.396521 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5793b-4ee9-47dd-90d1-74a446933535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:21.397178 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5793b-4ee9-47dd-90d1-74a446933535 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:21.397461 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5793b-4ee9-47dd-90d1-74a446933535 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:21.397735 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5793b-4ee9-47dd-90d1-74a446933535 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:21.398426 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5793b-4ee9-47dd-90d1-74a446933535 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:21.398734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5793b-4ee9-47dd-90d1-74a446933535 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:21.400172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5793b-4ee9-47dd-90d1-74a446933535 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:21.416728 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 531/1080] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:10:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:21.418799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5793b-4ee9-47dd-90d1-74a446933535 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:21.491062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e90dc-f6ef-4634-a3df-b7121c27ac39 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:21.516672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:21.527483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5793b-4ee9-47dd-90d1-74a446933535 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:21.531959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:21.539541 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f45b8f-177f-4a42-9ffa-ef6a5dc811ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:21.540252 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f45b8f-177f-4a42-9ffa-ef6a5dc811ca None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:21.540587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f45b8f-177f-4a42-9ffa-ef6a5dc811ca None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:21.540994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f45b8f-177f-4a42-9ffa-ef6a5dc811ca None admin] PATH_INFO: `/v3/users/5783b60619c84d6cbc4d4cce3b58a250` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:21.542223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f45b8f-177f-4a42-9ffa-ef6a5dc811ca None admin] RBAC: Authorizing `identity:get_user(user_id=5783b60619c84d6cbc4d4cce3b58a250)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:21.543651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f45b8f-177f-4a42-9ffa-ef6a5dc811ca None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:21.545303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 550/1081] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:10:21 2022] GET /identity/v3/users/5783b60619c84d6cbc4d4cce3b58a250 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:21.551145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f45b8f-177f-4a42-9ffa-ef6a5dc811ca None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:21.564473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2115836-ca14-45a9-aaad-14b1f56ed11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:21.565158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2115836-ca14-45a9-aaad-14b1f56ed11e None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:21.565438 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2115836-ca14-45a9-aaad-14b1f56ed11e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:21.565708 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2115836-ca14-45a9-aaad-14b1f56ed11e None admin] PATH_INFO: `/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/d7ff08c990dc41b4811f97fecb7c4c3a/roles/ac5c4a11a0f94428ac80cfb9130336f0` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:21.567890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2115836-ca14-45a9-aaad-14b1f56ed11e None admin] RBAC: Authorizing `identity:create_grant(project_id=78142a67f69a4ba58113cc7c8dc269b1, user_id=d7ff08c990dc41b4811f97fecb7c4c3a, role_id=ac5c4a11a0f94428ac80cfb9130336f0)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:21.569367 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2115836-ca14-45a9-aaad-14b1f56ed11e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:21.582764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 532/1082] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:10:21 2022] PUT /identity/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/d7ff08c990dc41b4811f97fecb7c4c3a/roles/ac5c4a11a0f94428ac80cfb9130336f0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:10:21.662845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f45b8f-177f-4a42-9ffa-ef6a5dc811ca None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:21.700257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5dfe0-6340-4edf-87af-047d52705091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:21.700935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5dfe0-6340-4edf-87af-047d52705091 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:21.701211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5dfe0-6340-4edf-87af-047d52705091 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:21.701478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5dfe0-6340-4edf-87af-047d52705091 None admin] PATH_INFO: `/v3/projects/c49ae1433117431588d37cb2881fd99c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:21.702630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5dfe0-6340-4edf-87af-047d52705091 None admin] RBAC: Authorizing `identity:get_project(project_id=c49ae1433117431588d37cb2881fd99c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:21.704052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5dfe0-6340-4edf-87af-047d52705091 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:21.705774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 551/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:10:21 2022] GET /identity/v3/projects/c49ae1433117431588d37cb2881fd99c => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:21.712091 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2115836-ca14-45a9-aaad-14b1f56ed11e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:21.833910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2115836-ca14-45a9-aaad-14b1f56ed11e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:21.874430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea006cfa-9a37-4de4-8302-c5d47ca93ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:21.875580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006cfa-9a37-4de4-8302-c5d47ca93ed4 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:21.876080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006cfa-9a37-4de4-8302-c5d47ca93ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:21.876626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006cfa-9a37-4de4-8302-c5d47ca93ed4 None admin] PATH_INFO: `/v3/projects/c49ae1433117431588d37cb2881fd99c/users/5783b60619c84d6cbc4d4cce3b58a250/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:21.880141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea006cfa-9a37-4de4-8302-c5d47ca93ed4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c49ae1433117431588d37cb2881fd99c, user_id=5783b60619c84d6cbc4d4cce3b58a250, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:21.883140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea006cfa-9a37-4de4-8302-c5d47ca93ed4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:21.907258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 533/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:10:21 2022] PUT /identity/v3/projects/c49ae1433117431588d37cb2881fd99c/users/5783b60619c84d6cbc4d4cce3b58a250/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:10:23.775706 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d83b02-f29b-468f-b99a-4759f49efb04 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:23.776224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d83b02-f29b-468f-b99a-4759f49efb04 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:23.776224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d83b02-f29b-468f-b99a-4759f49efb04 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:23.777700 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 552/1085] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:23.783306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57bb36-ec1c-4034-9664-cd7b9e6b503b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:23.783791 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57bb36-ec1c-4034-9664-cd7b9e6b503b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:23.783877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57bb36-ec1c-4034-9664-cd7b9e6b503b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:23.802882 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3c57bb36-ec1c-4034-9664-cd7b9e6b503b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:23.804073 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3c57bb36-ec1c-4034-9664-cd7b9e6b503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:23.814098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:23.881595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 534/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:24.114559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64117635-1255-402e-a94a-e8b791cf1991 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:24.114748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64117635-1255-402e-a94a-e8b791cf1991 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:24.115044 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64117635-1255-402e-a94a-e8b791cf1991 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:24.116391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 553/1087] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:24.122985 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20109470-0e51-4e43-95be-2575e390fb4b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:24.123242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20109470-0e51-4e43-95be-2575e390fb4b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:24.123517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20109470-0e51-4e43-95be-2575e390fb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:24.143521 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-20109470-0e51-4e43-95be-2575e390fb4b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:24.144780 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-20109470-0e51-4e43-95be-2575e390fb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:24.152169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64117635-1255-402e-a94a-e8b791cf1991 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:24.225624 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 535/1088] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:10:24.230861 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:24.272849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64117635-1255-402e-a94a-e8b791cf1991 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:24.308217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59caa4-759d-42d4-bd45-170fbe3a168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:24.308882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59caa4-759d-42d4-bd45-170fbe3a168c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:24.309179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59caa4-759d-42d4-bd45-170fbe3a168c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:24.309424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59caa4-759d-42d4-bd45-170fbe3a168c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:24.326574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59caa4-759d-42d4-bd45-170fbe3a168c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7f59caa4-759d-42d4-bd45-170fbe3a168c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:10:24.331411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:24.332925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:24.334964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:24.334964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:24.334964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:24.334964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:24.334964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:10:24.334964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:10:24.334964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:10:24.334964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:10:24.334964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:10:24.334964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:10:24.334964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 16:10:24.334964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:24.334964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 554/1089] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 21 16:10:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:10:24.339532 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20109470-0e51-4e43-95be-2575e390fb4b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:24.423044 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:24.459681 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20109470-0e51-4e43-95be-2575e390fb4b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:24.496566 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6790e9-079b-49b6-a014-779f9e8400be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:24.497229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6790e9-079b-49b6-a014-779f9e8400be None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:24.497524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6790e9-079b-49b6-a014-779f9e8400be None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:24.497763 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6790e9-079b-49b6-a014-779f9e8400be None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:24.498468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6790e9-079b-49b6-a014-779f9e8400be None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:24.498782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6790e9-079b-49b6-a014-779f9e8400be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:24.498932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59caa4-759d-42d4-bd45-170fbe3a168c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:24.500218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6790e9-079b-49b6-a014-779f9e8400be None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:24.510256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 536/1090] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 21 16:10:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:24.516256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6790e9-079b-49b6-a014-779f9e8400be None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:24.621981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59caa4-759d-42d4-bd45-170fbe3a168c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:24.648739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6790e9-079b-49b6-a014-779f9e8400be None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:24.654180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:24.667857 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af720a-38ac-4ff3-900e-202d978b7d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:24.668501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af720a-38ac-4ff3-900e-202d978b7d0e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:24.668802 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af720a-38ac-4ff3-900e-202d978b7d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:24.669069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af720a-38ac-4ff3-900e-202d978b7d0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:24.680631 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af720a-38ac-4ff3-900e-202d978b7d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c9af720a-38ac-4ff3-900e-202d978b7d0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:10:24.685622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:24.687414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:24.689037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:24.689037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:24.689037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:24.689037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:24.689037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:10:24.689037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:10:24.689037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:10:24.689037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:10:24.689037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:10:24.689037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:10:24.689037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:10:24.689037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:24.689037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 555/1091] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:10:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:10:24.691290 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe287a3-2453-4a2b-a8e8-3d9ae7bbd712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:24.691942 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe287a3-2453-4a2b-a8e8-3d9ae7bbd712 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:24.692205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe287a3-2453-4a2b-a8e8-3d9ae7bbd712 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:24.692504 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe287a3-2453-4a2b-a8e8-3d9ae7bbd712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:24.693573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af720a-38ac-4ff3-900e-202d978b7d0e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:24.694677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:24.705149 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe287a3-2453-4a2b-a8e8-3d9ae7bbd712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:24.706612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe287a3-2453-4a2b-a8e8-3d9ae7bbd712 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-abe287a3-2453-4a2b-a8e8-3d9ae7bbd712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:10:24.722294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:24.723507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:10:24.725278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:10:24.725278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:10:24.725278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:24.725278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 537/1092] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:10:24.733892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe287a3-2453-4a2b-a8e8-3d9ae7bbd712 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:24.813392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af720a-38ac-4ff3-900e-202d978b7d0e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:24.853881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db6e95-04c4-4d46-95ba-29ed089b0364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:24.854492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db6e95-04c4-4d46-95ba-29ed089b0364 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:24.854593 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe287a3-2453-4a2b-a8e8-3d9ae7bbd712 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:24.855051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db6e95-04c4-4d46-95ba-29ed089b0364 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:24.855051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db6e95-04c4-4d46-95ba-29ed089b0364 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:24.855673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db6e95-04c4-4d46-95ba-29ed089b0364 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:24.855975 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db6e95-04c4-4d46-95ba-29ed089b0364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:24.857389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db6e95-04c4-4d46-95ba-29ed089b0364 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:24.866352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 556/1093] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:10:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:24.872789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db6e95-04c4-4d46-95ba-29ed089b0364 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:24.894626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d9256-4602-4b45-8fc7-c4bb52f20e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:24.895240 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d9256-4602-4b45-8fc7-c4bb52f20e49 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:24.895513 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d9256-4602-4b45-8fc7-c4bb52f20e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:24.896354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d9256-4602-4b45-8fc7-c4bb52f20e49 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:24.897029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d9256-4602-4b45-8fc7-c4bb52f20e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:24.897327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d9256-4602-4b45-8fc7-c4bb52f20e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:24.898743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d9256-4602-4b45-8fc7-c4bb52f20e49 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:24.911201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 538/1094] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:24.919163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d9256-4602-4b45-8fc7-c4bb52f20e49 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:24.940657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:24.972943 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:24.997341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db6e95-04c4-4d46-95ba-29ed089b0364 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:25.034471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d9256-4602-4b45-8fc7-c4bb52f20e49 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:25.035394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f59a7-a24c-43d0-9c71-ccf8b04898b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:25.036024 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f59a7-a24c-43d0-9c71-ccf8b04898b5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:25.036867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f59a7-a24c-43d0-9c71-ccf8b04898b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:25.037140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f59a7-a24c-43d0-9c71-ccf8b04898b5 None admin] PATH_INFO: `/v3/users/5783b60619c84d6cbc4d4cce3b58a250` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:25.038291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f59a7-a24c-43d0-9c71-ccf8b04898b5 None admin] RBAC: Authorizing `identity:get_user(user_id=5783b60619c84d6cbc4d4cce3b58a250)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:25.039737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f59a7-a24c-43d0-9c71-ccf8b04898b5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:25.041372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 557/1095] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:10:24 2022] GET /identity/v3/users/5783b60619c84d6cbc4d4cce3b58a250 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:25.047258 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f59a7-a24c-43d0-9c71-ccf8b04898b5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:25.071120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a891b-272a-42d2-bcb7-09a32659eaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:25.071755 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a891b-272a-42d2-bcb7-09a32659eaeb None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:25.072036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a891b-272a-42d2-bcb7-09a32659eaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:25.072312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a891b-272a-42d2-bcb7-09a32659eaeb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:25.080634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a891b-272a-42d2-bcb7-09a32659eaeb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:25.082107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a891b-272a-42d2-bcb7-09a32659eaeb None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-1a4a891b-272a-42d2-bcb7-09a32659eaeb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:10:25.093990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:25.095090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:25.096076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:25.096076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:25.096076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:10:25.096076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:10:25.096076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:10:25.096076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:10:25.096076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:10:25.096076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:10:25.096076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 16:10:25.096076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:25.100482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 539/1096] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 21 16:10:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:10:25.101445 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a891b-272a-42d2-bcb7-09a32659eaeb None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:25.151868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f59a7-a24c-43d0-9c71-ccf8b04898b5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:25.168748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:25.193272 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626a87b-fec5-4387-8cfe-059af76d26e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:25.193807 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626a87b-fec5-4387-8cfe-059af76d26e9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:25.194085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626a87b-fec5-4387-8cfe-059af76d26e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:25.194354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626a87b-fec5-4387-8cfe-059af76d26e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:25.209419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a891b-272a-42d2-bcb7-09a32659eaeb None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:25.217164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:25.249202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed94d8-5e1f-4b12-9144-ef9eb38b7b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:25.249805 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed94d8-5e1f-4b12-9144-ef9eb38b7b09 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:25.250078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed94d8-5e1f-4b12-9144-ef9eb38b7b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:25.250344 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed94d8-5e1f-4b12-9144-ef9eb38b7b09 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:25.251065 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed94d8-5e1f-4b12-9144-ef9eb38b7b09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:25.251371 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed94d8-5e1f-4b12-9144-ef9eb38b7b09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:25.252809 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed94d8-5e1f-4b12-9144-ef9eb38b7b09 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:25.268423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626a87b-fec5-4387-8cfe-059af76d26e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:25.269929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626a87b-fec5-4387-8cfe-059af76d26e9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:25.270173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 540/1097] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 21 16:10:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:25.276508 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed94d8-5e1f-4b12-9144-ef9eb38b7b09 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:25.369157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 558/1098] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:10:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 16:10:25.373630 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed94d8-5e1f-4b12-9144-ef9eb38b7b09 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:25.374954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626a87b-fec5-4387-8cfe-059af76d26e9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:25.391854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:25.407852 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d1991-513e-4627-a29f-ad68e4358396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:25.408465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d1991-513e-4627-a29f-ad68e4358396 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:25.408771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d1991-513e-4627-a29f-ad68e4358396 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:25.409042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d1991-513e-4627-a29f-ad68e4358396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:25.440399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:25.476310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626a87b-fec5-4387-8cfe-059af76d26e9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:25.482586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d1991-513e-4627-a29f-ad68e4358396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:25.484031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d1991-513e-4627-a29f-ad68e4358396 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:25.512359 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6cf86-6f50-4f2e-90d2-087ee8439745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:25.513028 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6cf86-6f50-4f2e-90d2-087ee8439745 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:25.513305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6cf86-6f50-4f2e-90d2-087ee8439745 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:25.513579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6cf86-6f50-4f2e-90d2-087ee8439745 None admin] PATH_INFO: `/v3/projects/c49ae1433117431588d37cb2881fd99c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:25.514686 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6cf86-6f50-4f2e-90d2-087ee8439745 None admin] RBAC: Authorizing `identity:get_project(project_id=c49ae1433117431588d37cb2881fd99c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:25.516105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6cf86-6f50-4f2e-90d2-087ee8439745 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:25.517744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 559/1099] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:10:25 2022] GET /identity/v3/projects/c49ae1433117431588d37cb2881fd99c => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:25.524550 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6cf86-6f50-4f2e-90d2-087ee8439745 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:25.582994 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 541/1100] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:10:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 16:10:25.589625 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d1991-513e-4627-a29f-ad68e4358396 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:25.608148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:25.623214 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6cf86-6f50-4f2e-90d2-087ee8439745 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:25.650600 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:25.657057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07738d40-7057-4bd7-a940-704a19137ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:25.657660 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738d40-7057-4bd7-a940-704a19137ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:25.657939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738d40-7057-4bd7-a940-704a19137ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:25.658210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738d40-7057-4bd7-a940-704a19137ba5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:25.658926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07738d40-7057-4bd7-a940-704a19137ba5 None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=c49ae1433117431588d37cb2881fd99c, user.id=5783b60619c84d6cbc4d4cce3b58a250) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:25.659232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07738d40-7057-4bd7-a940-704a19137ba5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:25.660649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07738d40-7057-4bd7-a940-704a19137ba5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:25.666795 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 560/1101] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:10:25 2022] GET /identity/v3/role_assignments?user.id=5783b60619c84d6cbc4d4cce3b58a250&scope.project.id=c49ae1433117431588d37cb2881fd99c&role.id=beec000223e041209205627bfa0dbed1 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:10:25.689426 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d1991-513e-4627-a29f-ad68e4358396 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:25.727425 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a1f36-e243-43cf-ab2a-903d0f0738df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:25.728111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a1f36-e243-43cf-ab2a-903d0f0738df None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:25.728455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a1f36-e243-43cf-ab2a-903d0f0738df None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:25.728832 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a1f36-e243-43cf-ab2a-903d0f0738df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:25.739987 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a1f36-e243-43cf-ab2a-903d0f0738df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:25.741497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a1f36-e243-43cf-ab2a-903d0f0738df None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-5c4a1f36-e243-43cf-ab2a-903d0f0738df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:10:25.757923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:25.759000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:10:25.759930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:10:25.759930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:10:25.759930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:25.759930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 542/1102] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:10:25.765195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07738d40-7057-4bd7-a940-704a19137ba5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:25.870712 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07738d40-7057-4bd7-a940-704a19137ba5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:25.903557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0f1b7-e8cf-42e5-aff2-38c203854833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:25.904157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0f1b7-e8cf-42e5-aff2-38c203854833 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:25.904430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0f1b7-e8cf-42e5-aff2-38c203854833 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:25.904711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0f1b7-e8cf-42e5-aff2-38c203854833 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:25.905412 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0f1b7-e8cf-42e5-aff2-38c203854833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:25.905710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0f1b7-e8cf-42e5-aff2-38c203854833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:25.907056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0f1b7-e8cf-42e5-aff2-38c203854833 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:25.919139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 561/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:25.924815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a1f36-e243-43cf-ab2a-903d0f0738df None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:26.024586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a1f36-e243-43cf-ab2a-903d0f0738df None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:26.040625 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:26.059175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a610d6-31f5-4d10-b83b-e4defaea597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:26.059797 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a610d6-31f5-4d10-b83b-e4defaea597c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:26.060074 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a610d6-31f5-4d10-b83b-e4defaea597c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:26.060342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a610d6-31f5-4d10-b83b-e4defaea597c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:26.066928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a610d6-31f5-4d10-b83b-e4defaea597c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:26.069037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a610d6-31f5-4d10-b83b-e4defaea597c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-68a610d6-31f5-4d10-b83b-e4defaea597c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:10:26.081260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:26.082374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:26.083512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:10:26.083512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:10:26.083512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:10:26.083512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:10:26.083512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:10:26.083512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:10:26.083512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:10:26.083512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:26.084852 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 543/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:10:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:26.088301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0f1b7-e8cf-42e5-aff2-38c203854833 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:26.100643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:26.186800 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0f1b7-e8cf-42e5-aff2-38c203854833 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:26.220267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d31ccb-5b3f-43b8-a9b2-e2c573468274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:26.220899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d31ccb-5b3f-43b8-a9b2-e2c573468274 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:26.221176 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d31ccb-5b3f-43b8-a9b2-e2c573468274 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:26.221445 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d31ccb-5b3f-43b8-a9b2-e2c573468274 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:26.222134 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d31ccb-5b3f-43b8-a9b2-e2c573468274 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:26.222438 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d31ccb-5b3f-43b8-a9b2-e2c573468274 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:26.224416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d31ccb-5b3f-43b8-a9b2-e2c573468274 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:26.235704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 562/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:26.243892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a610d6-31f5-4d10-b83b-e4defaea597c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:26.346367 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a610d6-31f5-4d10-b83b-e4defaea597c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:26.380868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaafbff-67ba-4561-ab48-0d6445d16d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:26.381478 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaafbff-67ba-4561-ab48-0d6445d16d53 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:26.381751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaafbff-67ba-4561-ab48-0d6445d16d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:26.382015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaafbff-67ba-4561-ab48-0d6445d16d53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:26.382736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaafbff-67ba-4561-ab48-0d6445d16d53 None admin] RBAC: Adding query filter params (role.id=ac5c4a11a0f94428ac80cfb9130336f0, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=d7ff08c990dc41b4811f97fecb7c4c3a) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:26.383042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaafbff-67ba-4561-ab48-0d6445d16d53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:26.384482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaafbff-67ba-4561-ab48-0d6445d16d53 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:26.390355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 544/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:10:26 2022] GET /identity/v3/role_assignments?user.id=d7ff08c990dc41b4811f97fecb7c4c3a&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=ac5c4a11a0f94428ac80cfb9130336f0 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:27.876258 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c022454-67c6-4199-9498-0fbc1f58fb71 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:27.876855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c022454-67c6-4199-9498-0fbc1f58fb71 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:27.876855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c022454-67c6-4199-9498-0fbc1f58fb71 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:27.878251 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 563/1107] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:27.883544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b0da5-f509-4c8f-a121-b0e131051a52 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:27.884005 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b0da5-f509-4c8f-a121-b0e131051a52 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:27.884114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b0da5-f509-4c8f-a121-b0e131051a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:27.901989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e96b0da5-f509-4c8f-a121-b0e131051a52 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:27.903170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e96b0da5-f509-4c8f-a121-b0e131051a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:27.937269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:27.970239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 545/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:28.238093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c022454-67c6-4199-9498-0fbc1f58fb71 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:28.311090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:28.345379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c022454-67c6-4199-9498-0fbc1f58fb71 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:28.378171 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274e5e7-7d8f-44c6-a31d-8ea3091b38b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:28.378793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274e5e7-7d8f-44c6-a31d-8ea3091b38b0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:28.379070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274e5e7-7d8f-44c6-a31d-8ea3091b38b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:28.379340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274e5e7-7d8f-44c6-a31d-8ea3091b38b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:28.380530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274e5e7-7d8f-44c6-a31d-8ea3091b38b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:28.381980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274e5e7-7d8f-44c6-a31d-8ea3091b38b0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:28.383534 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 564/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:28.389334 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b0da5-f509-4c8f-a121-b0e131051a52 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:28.486826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b0da5-f509-4c8f-a121-b0e131051a52 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:28.520248 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bb421-d501-459d-8384-1072befca2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:28.521366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bb421-d501-459d-8384-1072befca2cc None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:28.521646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bb421-d501-459d-8384-1072befca2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:28.521915 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bb421-d501-459d-8384-1072befca2cc None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:28.522569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bb421-d501-459d-8384-1072befca2cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:28.523988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bb421-d501-459d-8384-1072befca2cc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:28.545063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 546/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:10:28 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:10:30.759464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bf615-dd8a-4da1-a0e6-30207dfe0e48 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:30.759987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bf615-dd8a-4da1-a0e6-30207dfe0e48 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:30.759987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bf615-dd8a-4da1-a0e6-30207dfe0e48 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:30.761271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 565/1111] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:30.766552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1eccd-fcd5-4177-aeb3-eec97e0c8672 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:30.766963 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1eccd-fcd5-4177-aeb3-eec97e0c8672 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:30.767102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1eccd-fcd5-4177-aeb3-eec97e0c8672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:30.785088 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7db1eccd-fcd5-4177-aeb3-eec97e0c8672 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:30.786836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7db1eccd-fcd5-4177-aeb3-eec97e0c8672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:30.807120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:30.854098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 547/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:31.134376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bf615-dd8a-4da1-a0e6-30207dfe0e48 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:31.231890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bf615-dd8a-4da1-a0e6-30207dfe0e48 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:31.268314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31611ef1-a7da-4138-b43b-6eceb93d064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:31.271007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31611ef1-a7da-4138-b43b-6eceb93d064f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:31.271350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31611ef1-a7da-4138-b43b-6eceb93d064f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:31.271619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31611ef1-a7da-4138-b43b-6eceb93d064f None admin] PATH_INFO: `/v3/roles/fdf188800dba4eee980df53694a7ed69` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:31.273064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31611ef1-a7da-4138-b43b-6eceb93d064f None admin] RBAC: Authorizing `identity:get_role(role_id=fdf188800dba4eee980df53694a7ed69)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:31.274424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31611ef1-a7da-4138-b43b-6eceb93d064f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:31.275755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 566/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:10:31 2022] GET /identity/v3/roles/fdf188800dba4eee980df53694a7ed69 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:31.281655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1eccd-fcd5-4177-aeb3-eec97e0c8672 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:31.379651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1eccd-fcd5-4177-aeb3-eec97e0c8672 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:31.412902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8d867-c08b-4147-a057-b90b5f682d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:31.413463 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8d867-c08b-4147-a057-b90b5f682d87 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:31.413744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8d867-c08b-4147-a057-b90b5f682d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:31.414015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8d867-c08b-4147-a057-b90b5f682d87 None admin] PATH_INFO: `/v3/users/2e136f81f67c4e14a65198e09f7a750d` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:31.427398 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8d867-c08b-4147-a057-b90b5f682d87 None admin] RBAC: Authorizing `identity:get_user(user_id=2e136f81f67c4e14a65198e09f7a750d)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:31.428850 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8d867-c08b-4147-a057-b90b5f682d87 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:31.430454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 548/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:10:31 2022] GET /identity/v3/users/2e136f81f67c4e14a65198e09f7a750d => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:31.436353 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31611ef1-a7da-4138-b43b-6eceb93d064f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:31.445611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:31.534260 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31611ef1-a7da-4138-b43b-6eceb93d064f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:31.573477 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bc4ca-38e2-4fac-8fb3-de3b7777df14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:31.574076 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bc4ca-38e2-4fac-8fb3-de3b7777df14 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:31.574349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bc4ca-38e2-4fac-8fb3-de3b7777df14 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:31.574615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bc4ca-38e2-4fac-8fb3-de3b7777df14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:31.638900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961bc4ca-38e2-4fac-8fb3-de3b7777df14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:31.640332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961bc4ca-38e2-4fac-8fb3-de3b7777df14 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:31.647850 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:31.737965 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 567/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:10:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 16:10:31.744404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8d867-c08b-4147-a057-b90b5f682d87 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:31.759561 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:31.841733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8d867-c08b-4147-a057-b90b5f682d87 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:31.875322 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d78a7-e5a6-4704-9bee-400cc64d1cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:31.875942 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d78a7-e5a6-4704-9bee-400cc64d1cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:31.876220 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d78a7-e5a6-4704-9bee-400cc64d1cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:31.876491 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d78a7-e5a6-4704-9bee-400cc64d1cb0 None admin] PATH_INFO: `/v3/projects/c49ae1433117431588d37cb2881fd99c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:31.877617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d78a7-e5a6-4704-9bee-400cc64d1cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=c49ae1433117431588d37cb2881fd99c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:31.883067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d78a7-e5a6-4704-9bee-400cc64d1cb0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:31.884731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 549/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:10:31 2022] GET /identity/v3/projects/c49ae1433117431588d37cb2881fd99c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:31.891006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bc4ca-38e2-4fac-8fb3-de3b7777df14 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:31.987904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bc4ca-38e2-4fac-8fb3-de3b7777df14 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:31.995045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:32.021247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3954e80-84be-4d8c-8b80-b02396241d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:32.021847 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3954e80-84be-4d8c-8b80-b02396241d1b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:32.022124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3954e80-84be-4d8c-8b80-b02396241d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:32.022393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3954e80-84be-4d8c-8b80-b02396241d1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:32.023105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3954e80-84be-4d8c-8b80-b02396241d1b None admin] RBAC: Adding query filter params (role.id=fdf188800dba4eee980df53694a7ed69, scope.project.id=c49ae1433117431588d37cb2881fd99c, user.id=2e136f81f67c4e14a65198e09f7a750d) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:32.023409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3954e80-84be-4d8c-8b80-b02396241d1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:32.024841 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3954e80-84be-4d8c-8b80-b02396241d1b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:32.030111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 568/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:10:31 2022] GET /identity/v3/role_assignments?user.id=2e136f81f67c4e14a65198e09f7a750d&scope.project.id=c49ae1433117431588d37cb2881fd99c&role.id=fdf188800dba4eee980df53694a7ed69 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:34.178236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a732ac-55b2-4b99-b692-e67cc10c185b None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:34.178775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a732ac-55b2-4b99-b692-e67cc10c185b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:34.178775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a732ac-55b2-4b99-b692-e67cc10c185b None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:34.180127 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 550/1118] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:34.185498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5df4c-daba-47e0-ab41-b733697d0963 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:34.185939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5df4c-daba-47e0-ab41-b733697d0963 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:34.186042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5df4c-daba-47e0-ab41-b733697d0963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:34.204492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-46c5df4c-daba-47e0-ab41-b733697d0963 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:34.205712 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-46c5df4c-daba-47e0-ab41-b733697d0963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:34.270755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 569/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:34.544345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a732ac-55b2-4b99-b692-e67cc10c185b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:34.623973 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:34.643605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a732ac-55b2-4b99-b692-e67cc10c185b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:34.676920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c112e-4372-4260-bab6-bc3b1079e8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:34.677545 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c112e-4372-4260-bab6-bc3b1079e8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:34.677824 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c112e-4372-4260-bab6-bc3b1079e8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:34.678094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c112e-4372-4260-bab6-bc3b1079e8a6 None admin] PATH_INFO: `/v3/roles/fdf188800dba4eee980df53694a7ed69` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:34.679481 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c112e-4372-4260-bab6-bc3b1079e8a6 None admin] RBAC: Authorizing `identity:get_role(role_id=fdf188800dba4eee980df53694a7ed69)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:34.680878 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c112e-4372-4260-bab6-bc3b1079e8a6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:34.682198 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 551/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:10:34 2022] GET /identity/v3/roles/fdf188800dba4eee980df53694a7ed69 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:34.688010 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5df4c-daba-47e0-ab41-b733697d0963 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:34.781451 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:34.784790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5df4c-daba-47e0-ab41-b733697d0963 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:34.820383 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697afc2-4a95-4e1f-99dd-6f3260a61710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:34.821048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697afc2-4a95-4e1f-99dd-6f3260a61710 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:34.821324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697afc2-4a95-4e1f-99dd-6f3260a61710 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:34.821594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697afc2-4a95-4e1f-99dd-6f3260a61710 None admin] PATH_INFO: `/v3/users/2e136f81f67c4e14a65198e09f7a750d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:34.822706 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697afc2-4a95-4e1f-99dd-6f3260a61710 None admin] RBAC: Authorizing `identity:get_user(user_id=2e136f81f67c4e14a65198e09f7a750d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:34.824117 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697afc2-4a95-4e1f-99dd-6f3260a61710 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:34.825727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 570/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:10:34 2022] GET /identity/v3/users/2e136f81f67c4e14a65198e09f7a750d => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:34.831548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c112e-4372-4260-bab6-bc3b1079e8a6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:34.928581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c112e-4372-4260-bab6-bc3b1079e8a6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:34.961709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3aceb-80b4-4c16-8736-a56275233b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:34.962329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3aceb-80b4-4c16-8736-a56275233b68 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:34.962608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3aceb-80b4-4c16-8736-a56275233b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:34.962879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3aceb-80b4-4c16-8736-a56275233b68 None admin] PATH_INFO: `/v3/projects/c49ae1433117431588d37cb2881fd99c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:34.964232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3aceb-80b4-4c16-8736-a56275233b68 None admin] RBAC: Authorizing `identity:get_project(project_id=c49ae1433117431588d37cb2881fd99c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:34.965682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3aceb-80b4-4c16-8736-a56275233b68 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:34.967292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 552/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:10:34 2022] GET /identity/v3/projects/c49ae1433117431588d37cb2881fd99c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:34.973191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697afc2-4a95-4e1f-99dd-6f3260a61710 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:35.078800 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697afc2-4a95-4e1f-99dd-6f3260a61710 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:35.111531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78f0ad-4081-4285-866b-72efad4f8706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:35.112181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f0ad-4081-4285-866b-72efad4f8706 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:35.112458 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f0ad-4081-4285-866b-72efad4f8706 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:35.112749 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f0ad-4081-4285-866b-72efad4f8706 None admin] PATH_INFO: `/v3/projects/c49ae1433117431588d37cb2881fd99c/users/2e136f81f67c4e14a65198e09f7a750d/roles/fdf188800dba4eee980df53694a7ed69` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:35.115442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78f0ad-4081-4285-866b-72efad4f8706 None admin] RBAC: Authorizing `identity:create_grant(project_id=c49ae1433117431588d37cb2881fd99c, user_id=2e136f81f67c4e14a65198e09f7a750d, role_id=fdf188800dba4eee980df53694a7ed69)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:35.116919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78f0ad-4081-4285-866b-72efad4f8706 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:35.129305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 571/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:10:34 2022] PUT /identity/v3/projects/c49ae1433117431588d37cb2881fd99c/users/2e136f81f67c4e14a65198e09f7a750d/roles/fdf188800dba4eee980df53694a7ed69 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:10:37.262607 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de45e4c-ef3c-4614-8d51-9ecb3e3e7648 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:37.263172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de45e4c-ef3c-4614-8d51-9ecb3e3e7648 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:37.263172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de45e4c-ef3c-4614-8d51-9ecb3e3e7648 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:37.264520 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 553/1124] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:37.270418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14f47a-ee3c-42a1-97b1-e71467e22a4f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:37.270874 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14f47a-ee3c-42a1-97b1-e71467e22a4f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:37.270976 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14f47a-ee3c-42a1-97b1-e71467e22a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:37.289240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fa14f47a-ee3c-42a1-97b1-e71467e22a4f None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:37.290421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fa14f47a-ee3c-42a1-97b1-e71467e22a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:37.312491 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:37.360104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 572/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:37.628325 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de45e4c-ef3c-4614-8d51-9ecb3e3e7648 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:37.650379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:37.732603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de45e4c-ef3c-4614-8d51-9ecb3e3e7648 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:37.765849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1738cf-6a1d-4e73-8483-bc8746a5cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:37.766470 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1738cf-6a1d-4e73-8483-bc8746a5cf90 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:37.766751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1738cf-6a1d-4e73-8483-bc8746a5cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:37.767024 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1738cf-6a1d-4e73-8483-bc8746a5cf90 None admin] PATH_INFO: `/v3/roles/fdf188800dba4eee980df53694a7ed69` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:37.768390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1738cf-6a1d-4e73-8483-bc8746a5cf90 None admin] RBAC: Authorizing `identity:get_role(role_id=fdf188800dba4eee980df53694a7ed69)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:37.769782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1738cf-6a1d-4e73-8483-bc8746a5cf90 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:37.771659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 554/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:10:37 2022] GET /identity/v3/roles/fdf188800dba4eee980df53694a7ed69 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:37.777502 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14f47a-ee3c-42a1-97b1-e71467e22a4f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:37.871164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14f47a-ee3c-42a1-97b1-e71467e22a4f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:37.904344 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765f181-0428-4d4c-9544-2a0f47129ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:37.904908 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765f181-0428-4d4c-9544-2a0f47129ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:37.905181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765f181-0428-4d4c-9544-2a0f47129ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:37.905446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765f181-0428-4d4c-9544-2a0f47129ca8 None admin] PATH_INFO: `/v3/users/2e136f81f67c4e14a65198e09f7a750d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:37.906534 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765f181-0428-4d4c-9544-2a0f47129ca8 None admin] RBAC: Authorizing `identity:get_user(user_id=2e136f81f67c4e14a65198e09f7a750d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:37.907931 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765f181-0428-4d4c-9544-2a0f47129ca8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:37.909497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 573/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:10:37 2022] GET /identity/v3/users/2e136f81f67c4e14a65198e09f7a750d => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:37.915385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1738cf-6a1d-4e73-8483-bc8746a5cf90 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:37.998356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:38.014097 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1738cf-6a1d-4e73-8483-bc8746a5cf90 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:38.047724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c2b04-0bc1-429c-8247-0b0fe8fcdd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:38.048330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c2b04-0bc1-429c-8247-0b0fe8fcdd21 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:38.048610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c2b04-0bc1-429c-8247-0b0fe8fcdd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:38.048911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c2b04-0bc1-429c-8247-0b0fe8fcdd21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:38.116952 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c2b04-0bc1-429c-8247-0b0fe8fcdd21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:38.118411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c2b04-0bc1-429c-8247-0b0fe8fcdd21 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:38.199747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:38.218878 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 555/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:10:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:10:38.225771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765f181-0428-4d4c-9544-2a0f47129ca8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:38.253629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:38.324695 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765f181-0428-4d4c-9544-2a0f47129ca8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:38.358050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58035dc-b9d3-4af8-970d-ce95f4a82159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:38.358668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58035dc-b9d3-4af8-970d-ce95f4a82159 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:38.358941 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58035dc-b9d3-4af8-970d-ce95f4a82159 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:38.359207 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58035dc-b9d3-4af8-970d-ce95f4a82159 None admin] PATH_INFO: `/v3/projects/c49ae1433117431588d37cb2881fd99c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:38.360291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58035dc-b9d3-4af8-970d-ce95f4a82159 None admin] RBAC: Authorizing `identity:get_project(project_id=c49ae1433117431588d37cb2881fd99c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:38.361721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58035dc-b9d3-4af8-970d-ce95f4a82159 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:38.363320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 574/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:10:38 2022] GET /identity/v3/projects/c49ae1433117431588d37cb2881fd99c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:38.370162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c2b04-0bc1-429c-8247-0b0fe8fcdd21 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:38.465545 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c2b04-0bc1-429c-8247-0b0fe8fcdd21 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:38.499150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864904a-3888-4cd9-bb14-8704e00a9a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:38.499753 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864904a-3888-4cd9-bb14-8704e00a9a75 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:38.500032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864904a-3888-4cd9-bb14-8704e00a9a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:38.500302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864904a-3888-4cd9-bb14-8704e00a9a75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:38.501057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864904a-3888-4cd9-bb14-8704e00a9a75 None admin] RBAC: Adding query filter params (role.id=fdf188800dba4eee980df53694a7ed69, scope.project.id=c49ae1433117431588d37cb2881fd99c, user.id=2e136f81f67c4e14a65198e09f7a750d) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:38.501363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864904a-3888-4cd9-bb14-8704e00a9a75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:38.502789 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864904a-3888-4cd9-bb14-8704e00a9a75 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:38.508729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 556/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:10:38 2022] GET /identity/v3/role_assignments?user.id=2e136f81f67c4e14a65198e09f7a750d&scope.project.id=c49ae1433117431588d37cb2881fd99c&role.id=fdf188800dba4eee980df53694a7ed69 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:40.704499 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b314e98-ab06-48c6-8aa8-68cc9aaece3b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:40.705056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b314e98-ab06-48c6-8aa8-68cc9aaece3b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:40.705166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b314e98-ab06-48c6-8aa8-68cc9aaece3b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:40.706482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 575/1131] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:40.712245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305dad-1892-418f-9933-11a8c023d546 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:40.712672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305dad-1892-418f-9933-11a8c023d546 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:40.712837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305dad-1892-418f-9933-11a8c023d546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:40.730966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a2305dad-1892-418f-9933-11a8c023d546 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:40.732155 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a2305dad-1892-418f-9933-11a8c023d546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:40.777366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:40.798517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 557/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:41.068504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b314e98-ab06-48c6-8aa8-68cc9aaece3b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:41.163165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:41.171507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b314e98-ab06-48c6-8aa8-68cc9aaece3b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:41.203760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394bdfe-dfc8-4c70-9242-51e852737cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:41.204376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394bdfe-dfc8-4c70-9242-51e852737cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:41.204654 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394bdfe-dfc8-4c70-9242-51e852737cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:41.204957 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394bdfe-dfc8-4c70-9242-51e852737cc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:41.206090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394bdfe-dfc8-4c70-9242-51e852737cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:41.208029 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394bdfe-dfc8-4c70-9242-51e852737cc7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:41.209610 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 576/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:41.215761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2305dad-1892-418f-9933-11a8c023d546 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:41.310673 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2305dad-1892-418f-9933-11a8c023d546 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:41.344591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762090e-acf0-4f5f-bb19-a23f5a855942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:41.345135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762090e-acf0-4f5f-bb19-a23f5a855942 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:41.345412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762090e-acf0-4f5f-bb19-a23f5a855942 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:41.345680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762090e-acf0-4f5f-bb19-a23f5a855942 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:41.346334 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762090e-acf0-4f5f-bb19-a23f5a855942 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:41.347748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762090e-acf0-4f5f-bb19-a23f5a855942 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:41.375652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 558/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 21 16:10:41 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:10:43.576914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad69a1-4639-4315-b2b6-246a4ef3e903 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:43.577439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad69a1-4639-4315-b2b6-246a4ef3e903 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:43.577439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad69a1-4639-4315-b2b6-246a4ef3e903 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:43.578827 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 577/1135] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:43.584377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b97082-dd9a-452d-9602-19a2051c5c63 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:43.584826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b97082-dd9a-452d-9602-19a2051c5c63 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:43.584957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b97082-dd9a-452d-9602-19a2051c5c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:43.603538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d0b97082-dd9a-452d-9602-19a2051c5c63 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:43.604755 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d0b97082-dd9a-452d-9602-19a2051c5c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:43.630198 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:43.670586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 559/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:43.946749 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad69a1-4639-4315-b2b6-246a4ef3e903 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:44.051019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad69a1-4639-4315-b2b6-246a4ef3e903 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:44.083553 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887cd80-bc1a-4ed5-8376-f3058ac54c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:44.084171 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887cd80-bc1a-4ed5-8376-f3058ac54c61 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:44.084446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887cd80-bc1a-4ed5-8376-f3058ac54c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:44.084742 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887cd80-bc1a-4ed5-8376-f3058ac54c61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:44.085838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887cd80-bc1a-4ed5-8376-f3058ac54c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:44.087250 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887cd80-bc1a-4ed5-8376-f3058ac54c61 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:44.089081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 578/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:10:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:44.094907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b97082-dd9a-452d-9602-19a2051c5c63 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:44.190961 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b97082-dd9a-452d-9602-19a2051c5c63 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:44.224828 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc557639-9165-4c40-9cfc-76fecd2f204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:44.225356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557639-9165-4c40-9cfc-76fecd2f204c None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:44.225631 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557639-9165-4c40-9cfc-76fecd2f204c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:44.225896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557639-9165-4c40-9cfc-76fecd2f204c None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:44.226528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc557639-9165-4c40-9cfc-76fecd2f204c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:44.227944 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc557639-9165-4c40-9cfc-76fecd2f204c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:44.248741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 560/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:10:44 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:10:46.447219 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd28ca-edfb-418f-9ab3-594bbb042d6f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:46.447747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd28ca-edfb-418f-9ab3-594bbb042d6f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:46.447747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd28ca-edfb-418f-9ab3-594bbb042d6f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:46.449256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 579/1139] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:46.454640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16eaf0-347b-4bcb-afba-5d6be4e5ab7c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:46.455085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16eaf0-347b-4bcb-afba-5d6be4e5ab7c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:46.455256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16eaf0-347b-4bcb-afba-5d6be4e5ab7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:46.475075 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-bd16eaf0-347b-4bcb-afba-5d6be4e5ab7c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:46.476262 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bd16eaf0-347b-4bcb-afba-5d6be4e5ab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:46.490239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:46.546303 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 561/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:46.821250 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd28ca-edfb-418f-9ab3-594bbb042d6f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:46.852994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:46.927576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd28ca-edfb-418f-9ab3-594bbb042d6f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:46.964711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d40a0-e863-435f-9b41-c5a6dbf25f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:46.966981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d40a0-e863-435f-9b41-c5a6dbf25f78 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:46.966981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d40a0-e863-435f-9b41-c5a6dbf25f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:46.966981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d40a0-e863-435f-9b41-c5a6dbf25f78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:46.976103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d40a0-e863-435f-9b41-c5a6dbf25f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-dc1d40a0-e863-435f-9b41-c5a6dbf25f78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:10:46.980925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:46.982065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:46.983352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:46.983352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:46.983352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:46.983352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:46.983352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:10:46.983352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:10:46.983352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:10:46.983352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:10:46.983352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:10:46.983352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:10:46.983352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:10:46.983352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:46.983352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 580/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:10:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:46.988647 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16eaf0-347b-4bcb-afba-5d6be4e5ab7c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:47.085060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16eaf0-347b-4bcb-afba-5d6be4e5ab7c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:47.118124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa01efb-3a7c-469d-9b51-56a2422da40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:47.118720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa01efb-3a7c-469d-9b51-56a2422da40c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:47.118998 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa01efb-3a7c-469d-9b51-56a2422da40c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:47.119268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa01efb-3a7c-469d-9b51-56a2422da40c None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:47.119923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa01efb-3a7c-469d-9b51-56a2422da40c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:47.120228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa01efb-3a7c-469d-9b51-56a2422da40c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:47.121616 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa01efb-3a7c-469d-9b51-56a2422da40c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:47.130214 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 562/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:10:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:47.136206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d40a0-e863-435f-9b41-c5a6dbf25f78 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:47.223922 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:47.233742 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d40a0-e863-435f-9b41-c5a6dbf25f78 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:47.266989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f558516-06ac-481e-b70a-04447c77d818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:47.267614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f558516-06ac-481e-b70a-04447c77d818 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:47.267891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f558516-06ac-481e-b70a-04447c77d818 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:47.268158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f558516-06ac-481e-b70a-04447c77d818 None admin] PATH_INFO: `/v3/users/81d6bd9c546d47fc9064f3943f9ab3d8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:47.281560 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f558516-06ac-481e-b70a-04447c77d818 None admin] RBAC: Authorizing `identity:get_user(user_id=81d6bd9c546d47fc9064f3943f9ab3d8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:47.282979 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f558516-06ac-481e-b70a-04447c77d818 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:47.284561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 581/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:10:47 2022] GET /identity/v3/users/81d6bd9c546d47fc9064f3943f9ab3d8 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:47.290927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa01efb-3a7c-469d-9b51-56a2422da40c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:47.304079 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:47.390132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa01efb-3a7c-469d-9b51-56a2422da40c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:47.423966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561f64c-5ce7-4917-b286-678904e4dbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:47.424577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561f64c-5ce7-4917-b286-678904e4dbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:47.424884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561f64c-5ce7-4917-b286-678904e4dbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:47.425156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561f64c-5ce7-4917-b286-678904e4dbc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:47.492674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561f64c-5ce7-4917-b286-678904e4dbc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:47.494131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561f64c-5ce7-4917-b286-678904e4dbc3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:47.505252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:47.592612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 563/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:10:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:10:47.599113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f558516-06ac-481e-b70a-04447c77d818 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:47.692302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f558516-06ac-481e-b70a-04447c77d818 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:47.724705 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fb0aa-279d-4b55-94fb-9956b9099743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:47.725335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fb0aa-279d-4b55-94fb-9956b9099743 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:47.725605 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fb0aa-279d-4b55-94fb-9956b9099743 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:47.725867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fb0aa-279d-4b55-94fb-9956b9099743 None admin] PATH_INFO: `/v3/projects/8e824068a6e64f79a4c17be6112009a5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:47.726948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fb0aa-279d-4b55-94fb-9956b9099743 None admin] RBAC: Authorizing `identity:get_project(project_id=8e824068a6e64f79a4c17be6112009a5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:47.728338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fb0aa-279d-4b55-94fb-9956b9099743 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:47.730142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 582/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:10:47 2022] GET /identity/v3/projects/8e824068a6e64f79a4c17be6112009a5 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:47.736294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561f64c-5ce7-4917-b286-678904e4dbc3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:47.831138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561f64c-5ce7-4917-b286-678904e4dbc3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:47.842248 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:47.865681 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb51783-dcca-4023-9772-3cc2f0beabed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:47.866221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb51783-dcca-4023-9772-3cc2f0beabed None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:47.866493 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb51783-dcca-4023-9772-3cc2f0beabed None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:47.866761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb51783-dcca-4023-9772-3cc2f0beabed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:47.867469 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb51783-dcca-4023-9772-3cc2f0beabed None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=8e824068a6e64f79a4c17be6112009a5, user.id=81d6bd9c546d47fc9064f3943f9ab3d8) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:47.867772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb51783-dcca-4023-9772-3cc2f0beabed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:47.869220 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb51783-dcca-4023-9772-3cc2f0beabed None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:47.874313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 564/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:10:47 2022] GET /identity/v3/role_assignments?user.id=81d6bd9c546d47fc9064f3943f9ab3d8&scope.project.id=8e824068a6e64f79a4c17be6112009a5&role.id=beec000223e041209205627bfa0dbed1 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:50.012900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88088e-5b59-464d-a252-e64ffbe24dc2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:50.013457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88088e-5b59-464d-a252-e64ffbe24dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:50.013457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88088e-5b59-464d-a252-e64ffbe24dc2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:50.014790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 583/1147] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:50.021312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1b16c-1b29-45db-92d0-6d16a56975a4 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:50.021848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1b16c-1b29-45db-92d0-6d16a56975a4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:50.021938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1b16c-1b29-45db-92d0-6d16a56975a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:50.041825 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1dc1b16c-1b29-45db-92d0-6d16a56975a4 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:50.043059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1dc1b16c-1b29-45db-92d0-6d16a56975a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:50.115751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 565/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:50.386681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88088e-5b59-464d-a252-e64ffbe24dc2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:50.405222 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:50.489147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88088e-5b59-464d-a252-e64ffbe24dc2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:50.523510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419f061-87b1-487b-9524-4e3638b28abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:50.524135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419f061-87b1-487b-9524-4e3638b28abf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:50.524415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419f061-87b1-487b-9524-4e3638b28abf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:50.524701 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419f061-87b1-487b-9524-4e3638b28abf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:50.534898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419f061-87b1-487b-9524-4e3638b28abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3419f061-87b1-487b-9524-4e3638b28abf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:10:50.539663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:50.540781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:50.541657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:50.541657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:50.541657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:50.541657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:50.541657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:10:50.541657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:10:50.541657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:10:50.541657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:10:50.541657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:10:50.541657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:10:50.541657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:10:50.541657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:50.541657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 584/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:10:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:50.546936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1b16c-1b29-45db-92d0-6d16a56975a4 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:50.642805 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1b16c-1b29-45db-92d0-6d16a56975a4 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:50.645051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:50.684397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb77ec-649f-4147-9161-3014d1b6f0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:50.685036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb77ec-649f-4147-9161-3014d1b6f0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:50.685316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb77ec-649f-4147-9161-3014d1b6f0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:50.685587 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb77ec-649f-4147-9161-3014d1b6f0a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:50.686247 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb77ec-649f-4147-9161-3014d1b6f0a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:50.686553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb77ec-649f-4147-9161-3014d1b6f0a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:50.687924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb77ec-649f-4147-9161-3014d1b6f0a8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:50.696957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 566/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:10:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:50.702973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419f061-87b1-487b-9524-4e3638b28abf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:50.777149 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:50.799372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419f061-87b1-487b-9524-4e3638b28abf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:50.832555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43c3f5-098d-4a34-8569-b224d8ce49b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:50.833203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43c3f5-098d-4a34-8569-b224d8ce49b4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:50.833483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43c3f5-098d-4a34-8569-b224d8ce49b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:50.833754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43c3f5-098d-4a34-8569-b224d8ce49b4 None admin] PATH_INFO: `/v3/users/81d6bd9c546d47fc9064f3943f9ab3d8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:50.834864 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43c3f5-098d-4a34-8569-b224d8ce49b4 None admin] RBAC: Authorizing `identity:get_user(user_id=81d6bd9c546d47fc9064f3943f9ab3d8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:50.836282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43c3f5-098d-4a34-8569-b224d8ce49b4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:50.837878 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 585/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:10:50 2022] GET /identity/v3/users/81d6bd9c546d47fc9064f3943f9ab3d8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:50.843975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb77ec-649f-4147-9161-3014d1b6f0a8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:50.944774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb77ec-649f-4147-9161-3014d1b6f0a8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:50.977035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db95a3-09e9-40e6-ae6b-0edcf8006b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:50.977656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db95a3-09e9-40e6-ae6b-0edcf8006b7c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:50.977934 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db95a3-09e9-40e6-ae6b-0edcf8006b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:50.978204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db95a3-09e9-40e6-ae6b-0edcf8006b7c None admin] PATH_INFO: `/v3/projects/8e824068a6e64f79a4c17be6112009a5` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:50.979314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db95a3-09e9-40e6-ae6b-0edcf8006b7c None admin] RBAC: Authorizing `identity:get_project(project_id=8e824068a6e64f79a4c17be6112009a5)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:50.980761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db95a3-09e9-40e6-ae6b-0edcf8006b7c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:50.982381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 567/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:10:50 2022] GET /identity/v3/projects/8e824068a6e64f79a4c17be6112009a5 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:50.989017 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43c3f5-098d-4a34-8569-b224d8ce49b4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:51.093716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43c3f5-098d-4a34-8569-b224d8ce49b4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:51.126527 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3a4a0-b411-4ed5-92e9-5549f494286d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:51.127172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3a4a0-b411-4ed5-92e9-5549f494286d None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:51.127445 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3a4a0-b411-4ed5-92e9-5549f494286d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:51.127711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3a4a0-b411-4ed5-92e9-5549f494286d None admin] PATH_INFO: `/v3/projects/8e824068a6e64f79a4c17be6112009a5/users/81d6bd9c546d47fc9064f3943f9ab3d8/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:51.129628 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3a4a0-b411-4ed5-92e9-5549f494286d None admin] RBAC: Authorizing `identity:create_grant(project_id=8e824068a6e64f79a4c17be6112009a5, user_id=81d6bd9c546d47fc9064f3943f9ab3d8, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:51.131033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3a4a0-b411-4ed5-92e9-5549f494286d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:51.143813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 586/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:10:50 2022] PUT /identity/v3/projects/8e824068a6e64f79a4c17be6112009a5/users/81d6bd9c546d47fc9064f3943f9ab3d8/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:10:53.305938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4127-84d7-4c7d-9a66-b20a15c57fa0 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:53.306479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4127-84d7-4c7d-9a66-b20a15c57fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:53.306664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4127-84d7-4c7d-9a66-b20a15c57fa0 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:53.308431 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 568/1154] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:53.313930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64b6c7-5491-49e2-8900-ad0d56345842 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:53.314402 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64b6c7-5491-49e2-8900-ad0d56345842 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:53.314504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64b6c7-5491-49e2-8900-ad0d56345842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:53.322732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:53.335352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7f64b6c7-5491-49e2-8900-ad0d56345842 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:53.336553 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7f64b6c7-5491-49e2-8900-ad0d56345842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:53.405035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 587/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:10:53.678548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe4127-84d7-4c7d-9a66-b20a15c57fa0 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:53.716551 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:53.787704 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe4127-84d7-4c7d-9a66-b20a15c57fa0 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:53.821765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1b6fb-b3db-497a-9b99-d9bafbff7260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:53.822384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1b6fb-b3db-497a-9b99-d9bafbff7260 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:53.822659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1b6fb-b3db-497a-9b99-d9bafbff7260 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:53.822923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1b6fb-b3db-497a-9b99-d9bafbff7260 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:53.833552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1b6fb-b3db-497a-9b99-d9bafbff7260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-62f1b6fb-b3db-497a-9b99-d9bafbff7260 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:10:53.838565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:53.839659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:53.840653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:53.840653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:53.840653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:53.840653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:53.840653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:10:53.840653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:10:53.840653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:10:53.840653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:10:53.840653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:10:53.840653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:10:53.840653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:10:53.840653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:10:53.840653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 569/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:10:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:53.845834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64b6c7-5491-49e2-8900-ad0d56345842 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:53.942762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64b6c7-5491-49e2-8900-ad0d56345842 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:53.975938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafbb18-7e9b-442d-974f-b66e7695c1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:53.976548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafbb18-7e9b-442d-974f-b66e7695c1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:53.976866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafbb18-7e9b-442d-974f-b66e7695c1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:53.977140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafbb18-7e9b-442d-974f-b66e7695c1e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:53.977799 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafbb18-7e9b-442d-974f-b66e7695c1e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:53.978106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafbb18-7e9b-442d-974f-b66e7695c1e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:53.979485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafbb18-7e9b-442d-974f-b66e7695c1e6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:53.980844 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:53.988906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 588/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:10:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:53.994872 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1b6fb-b3db-497a-9b99-d9bafbff7260 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:54.086147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:54.093373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1b6fb-b3db-497a-9b99-d9bafbff7260 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:54.127544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c8d19-0019-4e78-a1d8-b8327b716d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:54.128167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c8d19-0019-4e78-a1d8-b8327b716d11 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:54.128999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c8d19-0019-4e78-a1d8-b8327b716d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:54.129272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c8d19-0019-4e78-a1d8-b8327b716d11 None admin] PATH_INFO: `/v3/users/81d6bd9c546d47fc9064f3943f9ab3d8` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:54.130384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c8d19-0019-4e78-a1d8-b8327b716d11 None admin] RBAC: Authorizing `identity:get_user(user_id=81d6bd9c546d47fc9064f3943f9ab3d8)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:54.131814 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c8d19-0019-4e78-a1d8-b8327b716d11 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:54.133583 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 570/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:10:53 2022] GET /identity/v3/users/81d6bd9c546d47fc9064f3943f9ab3d8 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:54.139543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafbb18-7e9b-442d-974f-b66e7695c1e6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:54.235614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafbb18-7e9b-442d-974f-b66e7695c1e6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:54.267940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbdd5d-00bf-4565-83a2-f500ce7770bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:54.268539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbdd5d-00bf-4565-83a2-f500ce7770bc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:54.268848 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbdd5d-00bf-4565-83a2-f500ce7770bc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:54.269690 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbdd5d-00bf-4565-83a2-f500ce7770bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:54.328853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:54.338578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbdd5d-00bf-4565-83a2-f500ce7770bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:54.341418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbdd5d-00bf-4565-83a2-f500ce7770bc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:54.442647 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 589/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:10:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:10:54.448713 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c8d19-0019-4e78-a1d8-b8327b716d11 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:54.552432 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c8d19-0019-4e78-a1d8-b8327b716d11 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:54.585067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e692fd-85eb-4fdd-b5b4-04f84e7942f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:54.585689 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e692fd-85eb-4fdd-b5b4-04f84e7942f6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:54.585971 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e692fd-85eb-4fdd-b5b4-04f84e7942f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:54.586245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e692fd-85eb-4fdd-b5b4-04f84e7942f6 None admin] PATH_INFO: `/v3/projects/8e824068a6e64f79a4c17be6112009a5` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:54.587373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e692fd-85eb-4fdd-b5b4-04f84e7942f6 None admin] RBAC: Authorizing `identity:get_project(project_id=8e824068a6e64f79a4c17be6112009a5)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:54.589138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e692fd-85eb-4fdd-b5b4-04f84e7942f6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:54.590803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 571/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:10:54 2022] GET /identity/v3/projects/8e824068a6e64f79a4c17be6112009a5 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:54.597175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbdd5d-00bf-4565-83a2-f500ce7770bc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:54.688223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:54.695027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbdd5d-00bf-4565-83a2-f500ce7770bc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:54.728695 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aba4cc-ed4f-4ba7-b845-afa4e6590e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:54.729339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba4cc-ed4f-4ba7-b845-afa4e6590e53 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:54.729619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba4cc-ed4f-4ba7-b845-afa4e6590e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:54.729893 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba4cc-ed4f-4ba7-b845-afa4e6590e53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:54.730644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aba4cc-ed4f-4ba7-b845-afa4e6590e53 None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=8e824068a6e64f79a4c17be6112009a5, user.id=81d6bd9c546d47fc9064f3943f9ab3d8) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:54.730959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aba4cc-ed4f-4ba7-b845-afa4e6590e53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:54.732441 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aba4cc-ed4f-4ba7-b845-afa4e6590e53 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:54.738819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 590/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:10:54 2022] GET /identity/v3/role_assignments?user.id=81d6bd9c546d47fc9064f3943f9ab3d8&scope.project.id=8e824068a6e64f79a4c17be6112009a5&role.id=beec000223e041209205627bfa0dbed1 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:10:56.909502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e07e-d836-467c-9ea3-6d632cfff7d6 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:56.910191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e07e-d836-467c-9ea3-6d632cfff7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:56.910393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e07e-d836-467c-9ea3-6d632cfff7d6 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:56.911760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 572/1162] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:10:56.918144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7dc7-7218-4c28-9522-5a7ca8b69295 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:56.918681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7dc7-7218-4c28-9522-5a7ca8b69295 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:56.918681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7dc7-7218-4c28-9522-5a7ca8b69295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:56.942063 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b1ac7dc7-7218-4c28-9522-5a7ca8b69295 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:10:56.943269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b1ac7dc7-7218-4c28-9522-5a7ca8b69295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:10:57.009962 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 591/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:10:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:10:57.281143 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6e07e-d836-467c-9ea3-6d632cfff7d6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:57.313116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:57.383503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6e07e-d836-467c-9ea3-6d632cfff7d6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:57.416416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e664b-c27e-406e-9c5e-b9bcbf0cca6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:57.417049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e664b-c27e-406e-9c5e-b9bcbf0cca6d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:57.417325 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e664b-c27e-406e-9c5e-b9bcbf0cca6d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:57.417591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e664b-c27e-406e-9c5e-b9bcbf0cca6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:57.483644 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e664b-c27e-406e-9c5e-b9bcbf0cca6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:57.485119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e664b-c27e-406e-9c5e-b9bcbf0cca6d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:57.514491 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:57.583981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 573/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:10:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:10:57.590129 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac7dc7-7218-4c28-9522-5a7ca8b69295 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:57.676552 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:57.687125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac7dc7-7218-4c28-9522-5a7ca8b69295 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:57.721458 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222c8b7-089d-4036-a563-defd7c40c2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:57.722715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222c8b7-089d-4036-a563-defd7c40c2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:57.722995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222c8b7-089d-4036-a563-defd7c40c2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:57.723268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222c8b7-089d-4036-a563-defd7c40c2f6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:57.729808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222c8b7-089d-4036-a563-defd7c40c2f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:57.731234 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222c8b7-089d-4036-a563-defd7c40c2f6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3222c8b7-089d-4036-a563-defd7c40c2f6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:10:57.742308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:10:57.743531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:10:57.744616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 592/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 21 16:10:57 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:10:57.749469 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e664b-c27e-406e-9c5e-b9bcbf0cca6d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:10:57.847652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e664b-c27e-406e-9c5e-b9bcbf0cca6d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:10:57.874570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:10:57.881406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec9b16-7b44-46a3-b277-f17247be2822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:10:57.882009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9b16-7b44-46a3-b277-f17247be2822 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:10:57.882286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9b16-7b44-46a3-b277-f17247be2822 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:10:57.882553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9b16-7b44-46a3-b277-f17247be2822 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:10:57.883186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec9b16-7b44-46a3-b277-f17247be2822 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:10:57.883490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec9b16-7b44-46a3-b277-f17247be2822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:10:57.884882 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec9b16-7b44-46a3-b277-f17247be2822 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:10:57.891989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 574/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 21 16:10:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:11:00.022566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c945913-558b-42d2-849d-145b8d1e1334 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:00.023133 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c945913-558b-42d2-849d-145b8d1e1334 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:00.023133 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c945913-558b-42d2-849d-145b8d1e1334 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:00.024433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 593/1167] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:11:00.029822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b3c88-6159-40a2-a7f0-31b4c536007b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:00.030255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b3c88-6159-40a2-a7f0-31b4c536007b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:00.030361 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b3c88-6159-40a2-a7f0-31b4c536007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:00.048638 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ee6b3c88-6159-40a2-a7f0-31b4c536007b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:11:00.049839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ee6b3c88-6159-40a2-a7f0-31b4c536007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:11:00.116024 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 575/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:11:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:11:00.381863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c945913-558b-42d2-849d-145b8d1e1334 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:00.482955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c945913-558b-42d2-849d-145b8d1e1334 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:00.516137 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf46d53-b665-4ad7-ad95-3ca28d4cb933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:00.516759 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46d53-b665-4ad7-ad95-3ca28d4cb933 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:00.517046 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46d53-b665-4ad7-ad95-3ca28d4cb933 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:00.517314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46d53-b665-4ad7-ad95-3ca28d4cb933 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:00.517969 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf46d53-b665-4ad7-ad95-3ca28d4cb933 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:00.519843 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf46d53-b665-4ad7-ad95-3ca28d4cb933 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:00.535986 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 594/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Wed Sep 21 16:11:00 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:11:02.715818 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686f5be-ceb5-403c-8c64-b549eb7ce5ba None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:02.716349 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686f5be-ceb5-403c-8c64-b549eb7ce5ba None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:02.716349 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686f5be-ceb5-403c-8c64-b549eb7ce5ba None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:02.717682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 576/1170] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:11:02.722839 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0772fe-d73b-474f-ac32-1e9e8d236797 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:02.723285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0772fe-d73b-474f-ac32-1e9e8d236797 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:02.723392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0772fe-d73b-474f-ac32-1e9e8d236797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:02.741801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bc0772fe-d73b-474f-ac32-1e9e8d236797 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:11:02.742971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bc0772fe-d73b-474f-ac32-1e9e8d236797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:11:02.745699 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:02.807303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 595/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:11:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:11:03.072958 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686f5be-ceb5-403c-8c64-b549eb7ce5ba None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:03.172979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686f5be-ceb5-403c-8c64-b549eb7ce5ba None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:03.195907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:03.206904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14d486-c445-4738-91c5-343868251b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:03.207533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14d486-c445-4738-91c5-343868251b28 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:03.207810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14d486-c445-4738-91c5-343868251b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:03.208081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14d486-c445-4738-91c5-343868251b28 None admin] PATH_INFO: `/v3/domains/e93338c6f0734a90ae9262201dcb7d47` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:03.218811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14d486-c445-4738-91c5-343868251b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e93338c6f0734a90ae9262201dcb7d47)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:03.220242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14d486-c445-4738-91c5-343868251b28 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:03.222424 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 577/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Sep 21 16:11:03 2022] GET /identity/v3/domains/e93338c6f0734a90ae9262201dcb7d47 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:11:03.228329 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0772fe-d73b-474f-ac32-1e9e8d236797 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:03.326447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0772fe-d73b-474f-ac32-1e9e8d236797 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:03.359631 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cc090-26ef-45a9-b449-3bd0c36efe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:03.360235 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cc090-26ef-45a9-b449-3bd0c36efe95 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:03.360531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cc090-26ef-45a9-b449-3bd0c36efe95 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:03.360812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cc090-26ef-45a9-b449-3bd0c36efe95 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:03.361462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cc090-26ef-45a9-b449-3bd0c36efe95 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:03.363566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cc090-26ef-45a9-b449-3bd0c36efe95 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:03.374139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:03.390340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 596/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 21 16:11:03 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:11:05.578400 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817847eb-11d3-420e-aef4-f590c0e4c480 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:05.578958 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817847eb-11d3-420e-aef4-f590c0e4c480 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:05.578958 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817847eb-11d3-420e-aef4-f590c0e4c480 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:05.580264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 578/1174] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:11:05.585516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85202042-faa6-48b1-8129-e43ef72be68a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:05.585972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85202042-faa6-48b1-8129-e43ef72be68a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:05.586075 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85202042-faa6-48b1-8129-e43ef72be68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:05.604363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-85202042-faa6-48b1-8129-e43ef72be68a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:11:05.605572 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-85202042-faa6-48b1-8129-e43ef72be68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:11:05.670716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 597/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:11:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 16:11:05.938352 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817847eb-11d3-420e-aef4-f590c0e4c480 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:06.038660 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817847eb-11d3-420e-aef4-f590c0e4c480 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:06.079501 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7a6d0-3097-4daa-98c4-e2ab945fcd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:06.080129 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7a6d0-3097-4daa-98c4-e2ab945fcd74 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:06.080406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7a6d0-3097-4daa-98c4-e2ab945fcd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:06.080675 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7a6d0-3097-4daa-98c4-e2ab945fcd74 None admin] PATH_INFO: `/v3/domains/e93338c6f0734a90ae9262201dcb7d47` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:06.082419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7a6d0-3097-4daa-98c4-e2ab945fcd74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e93338c6f0734a90ae9262201dcb7d47)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:06.083849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7a6d0-3097-4daa-98c4-e2ab945fcd74 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:06.085441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 579/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Sep 21 16:11:05 2022] GET /identity/v3/domains/e93338c6f0734a90ae9262201dcb7d47 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:11:06.091452 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85202042-faa6-48b1-8129-e43ef72be68a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:06.187215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85202042-faa6-48b1-8129-e43ef72be68a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:06.210120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:06.222019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f5b74-f5f9-48f7-82b7-ceffec9efe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:06.222615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5b74-f5f9-48f7-82b7-ceffec9efe37 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:06.222910 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5b74-f5f9-48f7-82b7-ceffec9efe37 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:06.223164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5b74-f5f9-48f7-82b7-ceffec9efe37 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:06.223794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f5b74-f5f9-48f7-82b7-ceffec9efe37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:06.225235 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f5b74-f5f9-48f7-82b7-ceffec9efe37 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:06.245407 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 598/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:11:06 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:11:08.443852 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fc985-6661-4d29-86dd-72bb6c8c7733 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:08.444428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fc985-6661-4d29-86dd-72bb6c8c7733 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:08.444428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fc985-6661-4d29-86dd-72bb6c8c7733 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:08.445752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 580/1178] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:11:08.451330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9b3e5-9d24-4c3f-b381-ed8d31b9e915 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:08.451839 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9b3e5-9d24-4c3f-b381-ed8d31b9e915 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:08.451945 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9b3e5-9d24-4c3f-b381-ed8d31b9e915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:08.470390 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-32f9b3e5-9d24-4c3f-b381-ed8d31b9e915 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:11:08.472027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-32f9b3e5-9d24-4c3f-b381-ed8d31b9e915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:11:08.539002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 599/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:11:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:11:08.814934 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fc985-6661-4d29-86dd-72bb6c8c7733 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:08.868983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:08.922428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fc985-6661-4d29-86dd-72bb6c8c7733 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:08.958859 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3b1f2-c015-49ad-aa93-aab635c3f3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:08.959508 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3b1f2-c015-49ad-aa93-aab635c3f3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:08.959781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3b1f2-c015-49ad-aa93-aab635c3f3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:08.960049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3b1f2-c015-49ad-aa93-aab635c3f3a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:08.973418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3b1f2-c015-49ad-aa93-aab635c3f3a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-90f3b1f2-c015-49ad-aa93-aab635c3f3a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:11:08.978269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:11:08.979458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:11:08.980353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:11:08.980353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:11:08.980353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:11:08.980353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:11:08.980353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:11:08.980353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:11:08.980353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:11:08.980353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:11:08.980353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:11:08.980353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:11:08.980353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:11:08.980353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:11:08.980353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 581/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:11:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:11:08.985749 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9b3e5-9d24-4c3f-b381-ed8d31b9e915 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:09.086625 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9b3e5-9d24-4c3f-b381-ed8d31b9e915 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:09.096091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:09.123060 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfa54e-23b6-42e0-8adc-71399a358651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:09.123670 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa54e-23b6-42e0-8adc-71399a358651 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:09.123948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa54e-23b6-42e0-8adc-71399a358651 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:09.124217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa54e-23b6-42e0-8adc-71399a358651 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:09.124903 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfa54e-23b6-42e0-8adc-71399a358651 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:11:09.125207 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfa54e-23b6-42e0-8adc-71399a358651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:09.126557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfa54e-23b6-42e0-8adc-71399a358651 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:09.134470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 600/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:11:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:11:09.140480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3b1f2-c015-49ad-aa93-aab635c3f3a3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:09.236799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3b1f2-c015-49ad-aa93-aab635c3f3a3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:09.249662 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:09.270484 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b46b7d-06ee-4a6c-8b3b-60760b8b3d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:09.271109 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46b7d-06ee-4a6c-8b3b-60760b8b3d5e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:09.271385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46b7d-06ee-4a6c-8b3b-60760b8b3d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:09.271653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46b7d-06ee-4a6c-8b3b-60760b8b3d5e None admin] PATH_INFO: `/v3/users/8ee8932ce0f643a5bc8bc7d8ce9248cb` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:09.284931 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b46b7d-06ee-4a6c-8b3b-60760b8b3d5e None admin] RBAC: Authorizing `identity:get_user(user_id=8ee8932ce0f643a5bc8bc7d8ce9248cb)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:09.286365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b46b7d-06ee-4a6c-8b3b-60760b8b3d5e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:09.287938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 582/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:11:09 2022] GET /identity/v3/users/8ee8932ce0f643a5bc8bc7d8ce9248cb => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:11:09.293821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfa54e-23b6-42e0-8adc-71399a358651 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:09.391279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfa54e-23b6-42e0-8adc-71399a358651 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:09.424703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97aaf-4dbd-433d-87b3-93d3571fda68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:09.425328 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97aaf-4dbd-433d-87b3-93d3571fda68 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:09.425609 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97aaf-4dbd-433d-87b3-93d3571fda68 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:09.425882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97aaf-4dbd-433d-87b3-93d3571fda68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:09.467487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:09.495553 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da97aaf-4dbd-433d-87b3-93d3571fda68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:09.497014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da97aaf-4dbd-433d-87b3-93d3571fda68 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:09.592282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 601/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:11:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:11:09.598887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b46b7d-06ee-4a6c-8b3b-60760b8b3d5e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:09.694520 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b46b7d-06ee-4a6c-8b3b-60760b8b3d5e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:09.727798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fa2db-fc70-41ea-a3b1-4b8ce5f39592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:09.728410 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fa2db-fc70-41ea-a3b1-4b8ce5f39592 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:09.728706 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fa2db-fc70-41ea-a3b1-4b8ce5f39592 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:09.728974 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fa2db-fc70-41ea-a3b1-4b8ce5f39592 None admin] PATH_INFO: `/v3/projects/813f7619fffd49a8926382dcebe7ab1a` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:09.730062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fa2db-fc70-41ea-a3b1-4b8ce5f39592 None admin] RBAC: Authorizing `identity:get_project(project_id=813f7619fffd49a8926382dcebe7ab1a)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:09.731471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fa2db-fc70-41ea-a3b1-4b8ce5f39592 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:09.733097 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 583/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:11:09 2022] GET /identity/v3/projects/813f7619fffd49a8926382dcebe7ab1a => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:11:09.739435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97aaf-4dbd-433d-87b3-93d3571fda68 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:09.813025 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:09.844144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97aaf-4dbd-433d-87b3-93d3571fda68 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:09.876708 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a52e0-9593-4d98-935b-a80645f017ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:09.877326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a52e0-9593-4d98-935b-a80645f017ea None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:09.878146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a52e0-9593-4d98-935b-a80645f017ea None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:09.878416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a52e0-9593-4d98-935b-a80645f017ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:09.879127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a52e0-9593-4d98-935b-a80645f017ea None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=813f7619fffd49a8926382dcebe7ab1a, user.id=8ee8932ce0f643a5bc8bc7d8ce9248cb) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:11:09.879432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a52e0-9593-4d98-935b-a80645f017ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:09.880866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a52e0-9593-4d98-935b-a80645f017ea None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:09.886014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 602/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:11:09 2022] GET /identity/v3/role_assignments?user.id=8ee8932ce0f643a5bc8bc7d8ce9248cb&scope.project.id=813f7619fffd49a8926382dcebe7ab1a&role.id=beec000223e041209205627bfa0dbed1 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:11:12.027210 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8652c5-13d6-48b8-8940-86161e374568 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:12.027787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8652c5-13d6-48b8-8940-86161e374568 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:12.027787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8652c5-13d6-48b8-8940-86161e374568 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:12.029124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 584/1186] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:11:12.034962 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbbcc6-1b83-4ca6-b392-b599aa359043 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:12.035392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbbcc6-1b83-4ca6-b392-b599aa359043 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:12.035509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbbcc6-1b83-4ca6-b392-b599aa359043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:12.053897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-62fbbcc6-1b83-4ca6-b392-b599aa359043 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:11:12.055083 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-62fbbcc6-1b83-4ca6-b392-b599aa359043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:11:12.122646 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 603/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:11:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:11:12.391927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8652c5-13d6-48b8-8940-86161e374568 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:12.432909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:12.493654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8652c5-13d6-48b8-8940-86161e374568 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:12.527397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087979ed-e45a-4080-9fe7-9844f9483189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:12.528028 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087979ed-e45a-4080-9fe7-9844f9483189 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:12.528304 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087979ed-e45a-4080-9fe7-9844f9483189 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:12.528576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087979ed-e45a-4080-9fe7-9844f9483189 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:12.539288 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087979ed-e45a-4080-9fe7-9844f9483189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-087979ed-e45a-4080-9fe7-9844f9483189 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:11:12.544039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:11:12.545168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:11:12.546337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:11:12.546337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:11:12.546337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:11:12.546337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:11:12.546337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:11:12.546337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:11:12.546337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:11:12.546337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:11:12.546337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:11:12.546337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:11:12.546337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:11:12.546337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:11:12.546337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 585/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:11:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:11:12.554585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbbcc6-1b83-4ca6-b392-b599aa359043 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:12.613924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:12.650583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbbcc6-1b83-4ca6-b392-b599aa359043 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:12.684062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051ddfb-9b87-4bc6-bd0b-b353f1a7ee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:12.684667 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051ddfb-9b87-4bc6-bd0b-b353f1a7ee37 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:12.684968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051ddfb-9b87-4bc6-bd0b-b353f1a7ee37 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:12.685232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051ddfb-9b87-4bc6-bd0b-b353f1a7ee37 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:12.685882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051ddfb-9b87-4bc6-bd0b-b353f1a7ee37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:11:12.686180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051ddfb-9b87-4bc6-bd0b-b353f1a7ee37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:12.687519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051ddfb-9b87-4bc6-bd0b-b353f1a7ee37 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:12.695273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 604/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:11:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:11:12.701719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087979ed-e45a-4080-9fe7-9844f9483189 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:12.796520 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:12.800548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087979ed-e45a-4080-9fe7-9844f9483189 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:12.834713 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc975074-7e86-4a9e-bf70-2e0b11bf4df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:12.835324 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc975074-7e86-4a9e-bf70-2e0b11bf4df7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:12.835597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc975074-7e86-4a9e-bf70-2e0b11bf4df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:12.835862 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc975074-7e86-4a9e-bf70-2e0b11bf4df7 None admin] PATH_INFO: `/v3/users/8ee8932ce0f643a5bc8bc7d8ce9248cb` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:12.836990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc975074-7e86-4a9e-bf70-2e0b11bf4df7 None admin] RBAC: Authorizing `identity:get_user(user_id=8ee8932ce0f643a5bc8bc7d8ce9248cb)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:12.838667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc975074-7e86-4a9e-bf70-2e0b11bf4df7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:12.840219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 586/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:11:12 2022] GET /identity/v3/users/8ee8932ce0f643a5bc8bc7d8ce9248cb => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:11:12.846090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051ddfb-9b87-4bc6-bd0b-b353f1a7ee37 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:12.943825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051ddfb-9b87-4bc6-bd0b-b353f1a7ee37 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:12.968604 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:12.977732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b332f96-f15a-4868-a30e-22e1734a4279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:12.978358 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b332f96-f15a-4868-a30e-22e1734a4279 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:12.978636 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b332f96-f15a-4868-a30e-22e1734a4279 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:12.978907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b332f96-f15a-4868-a30e-22e1734a4279 None admin] PATH_INFO: `/v3/projects/813f7619fffd49a8926382dcebe7ab1a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:12.980008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b332f96-f15a-4868-a30e-22e1734a4279 None admin] RBAC: Authorizing `identity:get_project(project_id=813f7619fffd49a8926382dcebe7ab1a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:12.981454 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b332f96-f15a-4868-a30e-22e1734a4279 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:12.983084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 605/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:11:12 2022] GET /identity/v3/projects/813f7619fffd49a8926382dcebe7ab1a => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:11:12.989075 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc975074-7e86-4a9e-bf70-2e0b11bf4df7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:13.088405 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc975074-7e86-4a9e-bf70-2e0b11bf4df7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:13.121118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c76815-7d01-4b97-8016-5b7959e4da95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:13.121767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76815-7d01-4b97-8016-5b7959e4da95 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:13.122046 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76815-7d01-4b97-8016-5b7959e4da95 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:13.122317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76815-7d01-4b97-8016-5b7959e4da95 None admin] PATH_INFO: `/v3/projects/813f7619fffd49a8926382dcebe7ab1a/users/8ee8932ce0f643a5bc8bc7d8ce9248cb/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:13.124203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c76815-7d01-4b97-8016-5b7959e4da95 None admin] RBAC: Authorizing `identity:create_grant(project_id=813f7619fffd49a8926382dcebe7ab1a, user_id=8ee8932ce0f643a5bc8bc7d8ce9248cb, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:13.125652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c76815-7d01-4b97-8016-5b7959e4da95 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:13.138594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 587/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:11:12 2022] PUT /identity/v3/projects/813f7619fffd49a8926382dcebe7ab1a/users/8ee8932ce0f643a5bc8bc7d8ce9248cb/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:11:15.272309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03bd52-9af1-4be8-8b14-0aac4836d015 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:15.272886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03bd52-9af1-4be8-8b14-0aac4836d015 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:15.272886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03bd52-9af1-4be8-8b14-0aac4836d015 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:15.274191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 606/1193] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:11:15.279465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b4358-c033-4b23-8c35-4de312b08059 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:15.279889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b4358-c033-4b23-8c35-4de312b08059 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:15.280011 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b4358-c033-4b23-8c35-4de312b08059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:15.297871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-209b4358-c033-4b23-8c35-4de312b08059 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:11:15.299063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-209b4358-c033-4b23-8c35-4de312b08059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:11:15.319355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:15.368330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 588/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:11:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:11:15.636518 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03bd52-9af1-4be8-8b14-0aac4836d015 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:15.738370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03bd52-9af1-4be8-8b14-0aac4836d015 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:15.773818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76fb1e-15c9-402e-938a-3f4cb1ea1103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:15.774451 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76fb1e-15c9-402e-938a-3f4cb1ea1103 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:15.774725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76fb1e-15c9-402e-938a-3f4cb1ea1103 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:15.774990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76fb1e-15c9-402e-938a-3f4cb1ea1103 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:15.786672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76fb1e-15c9-402e-938a-3f4cb1ea1103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2b76fb1e-15c9-402e-938a-3f4cb1ea1103 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:11:15.791507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:11:15.792658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:11:15.793739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:11:15.793739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:11:15.793739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:11:15.793739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:11:15.793739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:11:15.793739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:11:15.793739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:11:15.793739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:11:15.793739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:11:15.793739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:11:15.793739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:11:15.793739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:11:15.793739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 607/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:11:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:11:15.798850 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b4358-c033-4b23-8c35-4de312b08059 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:15.903032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b4358-c033-4b23-8c35-4de312b08059 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:15.939570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db61cd2-941f-4d2d-bb57-3fe41a16126d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:15.940209 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61cd2-941f-4d2d-bb57-3fe41a16126d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:15.940490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61cd2-941f-4d2d-bb57-3fe41a16126d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:15.940787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61cd2-941f-4d2d-bb57-3fe41a16126d None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:15.941449 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db61cd2-941f-4d2d-bb57-3fe41a16126d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:11:15.941752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db61cd2-941f-4d2d-bb57-3fe41a16126d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:15.943124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db61cd2-941f-4d2d-bb57-3fe41a16126d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:15.951238 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 589/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:11:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:11:15.957415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76fb1e-15c9-402e-938a-3f4cb1ea1103 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:16.013053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:16.063067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76fb1e-15c9-402e-938a-3f4cb1ea1103 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:16.099289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c664eec-b1f5-4203-a21d-7337c8a7549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:16.099916 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c664eec-b1f5-4203-a21d-7337c8a7549c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:16.100190 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c664eec-b1f5-4203-a21d-7337c8a7549c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:16.100455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c664eec-b1f5-4203-a21d-7337c8a7549c None admin] PATH_INFO: `/v3/users/8ee8932ce0f643a5bc8bc7d8ce9248cb` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:16.101594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c664eec-b1f5-4203-a21d-7337c8a7549c None admin] RBAC: Authorizing `identity:get_user(user_id=8ee8932ce0f643a5bc8bc7d8ce9248cb)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:16.103030 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c664eec-b1f5-4203-a21d-7337c8a7549c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:16.104599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 608/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 21 16:11:15 2022] GET /identity/v3/users/8ee8932ce0f643a5bc8bc7d8ce9248cb => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:11:16.110472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db61cd2-941f-4d2d-bb57-3fe41a16126d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:16.130841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:16.221258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db61cd2-941f-4d2d-bb57-3fe41a16126d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:16.261181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae546d55-a5f3-4ce4-99e0-2f0af612fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:16.261794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae546d55-a5f3-4ce4-99e0-2f0af612fd4a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:16.262072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae546d55-a5f3-4ce4-99e0-2f0af612fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:16.262344 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae546d55-a5f3-4ce4-99e0-2f0af612fd4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:16.330786 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae546d55-a5f3-4ce4-99e0-2f0af612fd4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:16.332254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae546d55-a5f3-4ce4-99e0-2f0af612fd4a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:16.350974 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:16.431664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 590/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:11:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:11:16.437656 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c664eec-b1f5-4203-a21d-7337c8a7549c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:16.535385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c664eec-b1f5-4203-a21d-7337c8a7549c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:16.558487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:16.570287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006c770-af47-43f3-acac-b08625058f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:16.570919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006c770-af47-43f3-acac-b08625058f6c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:16.571198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006c770-af47-43f3-acac-b08625058f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:16.571469 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006c770-af47-43f3-acac-b08625058f6c None admin] PATH_INFO: `/v3/projects/813f7619fffd49a8926382dcebe7ab1a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:16.572574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006c770-af47-43f3-acac-b08625058f6c None admin] RBAC: Authorizing `identity:get_project(project_id=813f7619fffd49a8926382dcebe7ab1a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:16.574028 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006c770-af47-43f3-acac-b08625058f6c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:16.575653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 609/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 21 16:11:16 2022] GET /identity/v3/projects/813f7619fffd49a8926382dcebe7ab1a => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:11:16.581849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae546d55-a5f3-4ce4-99e0-2f0af612fd4a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:11:16.684308 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae546d55-a5f3-4ce4-99e0-2f0af612fd4a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:11:16.701394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:16.718198 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb91a8-3deb-415b-95e8-15bb829948c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:11:16.718794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb91a8-3deb-415b-95e8-15bb829948c2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:11:16.719070 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb91a8-3deb-415b-95e8-15bb829948c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:11:16.719337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb91a8-3deb-415b-95e8-15bb829948c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:11:16.720048 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb91a8-3deb-415b-95e8-15bb829948c2 None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=813f7619fffd49a8926382dcebe7ab1a, user.id=8ee8932ce0f643a5bc8bc7d8ce9248cb) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:11:16.720350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb91a8-3deb-415b-95e8-15bb829948c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:11:16.722357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb91a8-3deb-415b-95e8-15bb829948c2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:11:16.728171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 591/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:11:16 2022] GET /identity/v3/role_assignments?user.id=8ee8932ce0f643a5bc8bc7d8ce9248cb&scope.project.id=813f7619fffd49a8926382dcebe7ab1a&role.id=beec000223e041209205627bfa0dbed1 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:11:26.566727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:11:26.725608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=9 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:15.198905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4deba-040a-42ed-9ec1-efc4f67274e2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:15.198905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4deba-040a-42ed-9ec1-efc4f67274e2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:15.198905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4deba-040a-42ed-9ec1-efc4f67274e2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:15.198905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 610/1201] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:12:15.208731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b95022-e827-41a8-aca5-483376612947 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:15.208731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b95022-e827-41a8-aca5-483376612947 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:15.208731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b95022-e827-41a8-aca5-483376612947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:15.231121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-62b95022-e827-41a8-aca5-483376612947 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:12:15.232436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-62b95022-e827-41a8-aca5-483376612947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:12:15.373370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 592/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:12:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:12:15.713264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4deba-040a-42ed-9ec1-efc4f67274e2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:15.877930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4deba-040a-42ed-9ec1-efc4f67274e2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:15.931198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c652bf0-094a-4b2a-8c3f-c9a00d0a3f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:15.932138 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c652bf0-094a-4b2a-8c3f-c9a00d0a3f81 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:15.932644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c652bf0-094a-4b2a-8c3f-c9a00d0a3f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:15.932950 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c652bf0-094a-4b2a-8c3f-c9a00d0a3f81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:15.954054 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c652bf0-094a-4b2a-8c3f-c9a00d0a3f81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:15.955559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c652bf0-094a-4b2a-8c3f-c9a00d0a3f81 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4c652bf0-094a-4b2a-8c3f-c9a00d0a3f81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:12:15.972854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:15.977523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:12:15.978557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:12:15.978557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:15.978557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:15.978557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 611/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:15.981926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b95022-e827-41a8-aca5-483376612947 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:16.150433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b95022-e827-41a8-aca5-483376612947 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:16.205987 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:16.215537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f3b5c-65d1-4e4a-a767-4dfdbbbcc890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:16.216436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f3b5c-65d1-4e4a-a767-4dfdbbbcc890 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:16.216937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f3b5c-65d1-4e4a-a767-4dfdbbbcc890 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:16.217255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f3b5c-65d1-4e4a-a767-4dfdbbbcc890 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:16.218086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f3b5c-65d1-4e4a-a767-4dfdbbbcc890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:16.218387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f3b5c-65d1-4e4a-a767-4dfdbbbcc890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:16.219836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f3b5c-65d1-4e4a-a767-4dfdbbbcc890 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:16.236110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 593/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:12:16.251781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c652bf0-094a-4b2a-8c3f-c9a00d0a3f81 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:16.323909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:16.405603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c652bf0-094a-4b2a-8c3f-c9a00d0a3f81 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:16.473355 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dec721-e90d-4752-bef6-594167598b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:16.474018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dec721-e90d-4752-bef6-594167598b15 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:16.474334 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dec721-e90d-4752-bef6-594167598b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:16.474604 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dec721-e90d-4752-bef6-594167598b15 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:16.475357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dec721-e90d-4752-bef6-594167598b15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:16.477008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dec721-e90d-4752-bef6-594167598b15 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:16.518541 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 612/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 21 16:12:16 2022] POST /identity/v3/users => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:12:19.164304 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2b5f-c909-4419-be76-fbe55e935907 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:19.164927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2b5f-c909-4419-be76-fbe55e935907 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:19.165298 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2b5f-c909-4419-be76-fbe55e935907 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:19.167876 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 594/1206] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:12:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:12:19.181294 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750c9e4-222b-4e42-aec1-9cec761f57be None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:19.181294 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750c9e4-222b-4e42-aec1-9cec761f57be None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:19.181294 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750c9e4-222b-4e42-aec1-9cec761f57be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:19.213779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c750c9e4-222b-4e42-aec1-9cec761f57be None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:12:19.215698 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c750c9e4-222b-4e42-aec1-9cec761f57be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:12:19.324730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 613/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:12:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:12:19.604405 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b2b5f-c909-4419-be76-fbe55e935907 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:19.786910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b2b5f-c909-4419-be76-fbe55e935907 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:19.844748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b38e4-7f83-403b-9898-40927e97b51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:19.845547 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b38e4-7f83-403b-9898-40927e97b51e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:19.846039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b38e4-7f83-403b-9898-40927e97b51e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:19.846526 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b38e4-7f83-403b-9898-40927e97b51e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:19.866442 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b38e4-7f83-403b-9898-40927e97b51e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-718b38e4-7f83-403b-9898-40927e97b51e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:12:19.876960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:19.878042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:19.879379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:19.879379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:19.879379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:19.879379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:19.879379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:12:19.879379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:12:19.879379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:12:19.879379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:12:19.879379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:12:19.879379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:12:19.879379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:12:19.879379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:19.879379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 595/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:12:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:19.887934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750c9e4-222b-4e42-aec1-9cec761f57be None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:19.959780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:20.092082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750c9e4-222b-4e42-aec1-9cec761f57be None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:20.156797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffde778-5796-45a5-b34d-fa27d009a62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:20.158406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffde778-5796-45a5-b34d-fa27d009a62c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:20.158406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffde778-5796-45a5-b34d-fa27d009a62c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:20.158703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffde778-5796-45a5-b34d-fa27d009a62c None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:20.159722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffde778-5796-45a5-b34d-fa27d009a62c None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:20.160227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffde778-5796-45a5-b34d-fa27d009a62c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:20.162431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffde778-5796-45a5-b34d-fa27d009a62c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:20.175635 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 614/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:12:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:20.182696 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b38e4-7f83-403b-9898-40927e97b51e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:20.291729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:20.373193 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b38e4-7f83-403b-9898-40927e97b51e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:20.436666 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b774c-d265-4e3c-b0ad-91625568b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:20.438142 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b774c-d265-4e3c-b0ad-91625568b365 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:20.438966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b774c-d265-4e3c-b0ad-91625568b365 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:20.440672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b774c-d265-4e3c-b0ad-91625568b365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:20.466131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b774c-d265-4e3c-b0ad-91625568b365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:20.469013 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b774c-d265-4e3c-b0ad-91625568b365 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-781b774c-d265-4e3c-b0ad-91625568b365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:12:20.489433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:20.490957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:12:20.492728 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:12:20.492728 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:20.492728 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:20.493447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 596/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:20.501287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffde778-5796-45a5-b34d-fa27d009a62c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:20.671293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:20.675898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffde778-5796-45a5-b34d-fa27d009a62c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:20.745690 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb5dce-1213-42be-9ca3-ef84c0c5628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:20.746385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb5dce-1213-42be-9ca3-ef84c0c5628a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:20.746755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb5dce-1213-42be-9ca3-ef84c0c5628a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:20.747001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb5dce-1213-42be-9ca3-ef84c0c5628a None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:20.747548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb5dce-1213-42be-9ca3-ef84c0c5628a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:20.747846 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb5dce-1213-42be-9ca3-ef84c0c5628a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:20.749325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb5dce-1213-42be-9ca3-ef84c0c5628a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:20.770961 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 615/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:20.778402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b774c-d265-4e3c-b0ad-91625568b365 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:20.945767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b774c-d265-4e3c-b0ad-91625568b365 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:20.947738 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:20.999157 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25b78e-70f6-422d-8fb9-04a9df1c50f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:21.000246 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25b78e-70f6-422d-8fb9-04a9df1c50f3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:21.000766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25b78e-70f6-422d-8fb9-04a9df1c50f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:21.001153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25b78e-70f6-422d-8fb9-04a9df1c50f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:21.015875 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25b78e-70f6-422d-8fb9-04a9df1c50f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:21.018618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25b78e-70f6-422d-8fb9-04a9df1c50f3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-fc25b78e-70f6-422d-8fb9-04a9df1c50f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:12:21.032618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:21.034758 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:21.037009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:21.037009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:21.037009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:12:21.037009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:12:21.037009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:12:21.037009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:12:21.037009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:12:21.037009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:12:21.037009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 16:12:21.037009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:21.037009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 597/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:21.040120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb5dce-1213-42be-9ca3-ef84c0c5628a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:21.176280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb5dce-1213-42be-9ca3-ef84c0c5628a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:21.230984 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69da6b-d72c-46d3-bd98-4a15dece6263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:21.232415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69da6b-d72c-46d3-bd98-4a15dece6263 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:21.233121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69da6b-d72c-46d3-bd98-4a15dece6263 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:21.233636 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69da6b-d72c-46d3-bd98-4a15dece6263 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:21.234754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69da6b-d72c-46d3-bd98-4a15dece6263 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:21.235216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69da6b-d72c-46d3-bd98-4a15dece6263 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:21.237463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69da6b-d72c-46d3-bd98-4a15dece6263 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:21.279570 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 616/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 21 16:12:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:21.280963 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25b78e-70f6-422d-8fb9-04a9df1c50f3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:21.412885 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25b78e-70f6-422d-8fb9-04a9df1c50f3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:21.471718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6801e7-4866-4eb9-aca8-9857826e48d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:21.472889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6801e7-4866-4eb9-aca8-9857826e48d0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:21.473443 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6801e7-4866-4eb9-aca8-9857826e48d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:21.473994 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6801e7-4866-4eb9-aca8-9857826e48d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:21.523905 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:21.597211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6801e7-4866-4eb9-aca8-9857826e48d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:21.600054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6801e7-4866-4eb9-aca8-9857826e48d0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:21.734620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 598/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:12:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:12:21.744379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69da6b-d72c-46d3-bd98-4a15dece6263 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:21.768480 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:21.881935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69da6b-d72c-46d3-bd98-4a15dece6263 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:21.929745 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ed4f4-7fea-4302-867a-67f1a8728833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:21.930624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ed4f4-7fea-4302-867a-67f1a8728833 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:21.931129 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ed4f4-7fea-4302-867a-67f1a8728833 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:21.931598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ed4f4-7fea-4302-867a-67f1a8728833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:21.946677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ed4f4-7fea-4302-867a-67f1a8728833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:21.948294 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ed4f4-7fea-4302-867a-67f1a8728833 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-971ed4f4-7fea-4302-867a-67f1a8728833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:12:21.965386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:21.967411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:12:21.969460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:12:21.969460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:21.969460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:21.969460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 617/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:12:21.975112 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6801e7-4866-4eb9-aca8-9857826e48d0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:22.113325 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:22.186652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6801e7-4866-4eb9-aca8-9857826e48d0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:22.242538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b4d7b-5124-48bd-8b58-18b0dc2d37c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:22.243235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b4d7b-5124-48bd-8b58-18b0dc2d37c0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:22.243513 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b4d7b-5124-48bd-8b58-18b0dc2d37c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:22.243784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b4d7b-5124-48bd-8b58-18b0dc2d37c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:22.244455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b4d7b-5124-48bd-8b58-18b0dc2d37c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:22.244957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b4d7b-5124-48bd-8b58-18b0dc2d37c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:22.246395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b4d7b-5124-48bd-8b58-18b0dc2d37c0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:22.265756 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 599/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:12:22.273254 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ed4f4-7fea-4302-867a-67f1a8728833 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:22.366683 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:22.414056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ed4f4-7fea-4302-867a-67f1a8728833 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:22.463805 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf59ec0-9e4f-4ed8-a829-6f311b3ad183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:22.464475 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf59ec0-9e4f-4ed8-a829-6f311b3ad183 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:22.464816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf59ec0-9e4f-4ed8-a829-6f311b3ad183 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:22.465092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf59ec0-9e4f-4ed8-a829-6f311b3ad183 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:22.474027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf59ec0-9e4f-4ed8-a829-6f311b3ad183 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:22.475661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf59ec0-9e4f-4ed8-a829-6f311b3ad183 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ebf59ec0-9e4f-4ed8-a829-6f311b3ad183 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:12:22.489703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:22.491197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:22.492580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:12:22.492580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:12:22.492580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:12:22.492580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:12:22.492580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:12:22.492580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:12:22.492580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:12:22.492580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:22.492580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 618/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:22.497383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b4d7b-5124-48bd-8b58-18b0dc2d37c0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:22.646852 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b4d7b-5124-48bd-8b58-18b0dc2d37c0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:22.679111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:22.694037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd861c-caa2-435e-aec6-99f2be772d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:22.694791 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd861c-caa2-435e-aec6-99f2be772d2c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:22.695132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd861c-caa2-435e-aec6-99f2be772d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:22.695461 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd861c-caa2-435e-aec6-99f2be772d2c None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:22.696211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd861c-caa2-435e-aec6-99f2be772d2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:22.696615 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd861c-caa2-435e-aec6-99f2be772d2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:22.698278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd861c-caa2-435e-aec6-99f2be772d2c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:22.714682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 600/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:22.722174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf59ec0-9e4f-4ed8-a829-6f311b3ad183 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:22.849668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf59ec0-9e4f-4ed8-a829-6f311b3ad183 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:22.881510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:22.889349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd89b93-cb62-4178-87aa-d232fbf2f897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:22.890262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89b93-cb62-4178-87aa-d232fbf2f897 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:22.890573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89b93-cb62-4178-87aa-d232fbf2f897 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:22.891022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89b93-cb62-4178-87aa-d232fbf2f897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:22.891879 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd89b93-cb62-4178-87aa-d232fbf2f897 None admin] RBAC: Adding query filter params (role.id=8e7b3a48a50745adad97c6205aafc562, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=7cd3076ca5a84ff7ada13065f9531f52) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:22.892365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd89b93-cb62-4178-87aa-d232fbf2f897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:22.894108 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd89b93-cb62-4178-87aa-d232fbf2f897 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:22.901275 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 619/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:12:22 2022] GET /identity/v3/role_assignments?user.id=7cd3076ca5a84ff7ada13065f9531f52&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=8e7b3a48a50745adad97c6205aafc562 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:25.335193 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc92b8-6242-470f-8e94-9e82c39f8a32 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:25.336264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc92b8-6242-470f-8e94-9e82c39f8a32 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:25.336264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc92b8-6242-470f-8e94-9e82c39f8a32 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:25.337367 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 601/1220] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:12:25.342935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec32e76-915f-4f37-abf0-6f8b59539503 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:25.343485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec32e76-915f-4f37-abf0-6f8b59539503 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:25.343485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec32e76-915f-4f37-abf0-6f8b59539503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:25.369298 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1ec32e76-915f-4f37-abf0-6f8b59539503 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:12:25.370508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ec32e76-915f-4f37-abf0-6f8b59539503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:12:25.449846 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 620/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:12:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:12:25.775327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc92b8-6242-470f-8e94-9e82c39f8a32 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:25.925966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc92b8-6242-470f-8e94-9e82c39f8a32 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:25.976001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36f9aa-42e2-4523-9bbf-7b873e7fce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:25.976905 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36f9aa-42e2-4523-9bbf-7b873e7fce18 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:25.977256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36f9aa-42e2-4523-9bbf-7b873e7fce18 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:25.977642 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36f9aa-42e2-4523-9bbf-7b873e7fce18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:25.996993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36f9aa-42e2-4523-9bbf-7b873e7fce18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-8a36f9aa-42e2-4523-9bbf-7b873e7fce18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:12:26.007671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:26.009119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:26.010343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:26.010343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:26.010343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:26.010343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:26.010343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:12:26.010343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:12:26.010343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:12:26.010343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:12:26.010343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:12:26.010343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:12:26.010343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:12:26.010343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:26.010343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 602/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:12:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:26.016397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec32e76-915f-4f37-abf0-6f8b59539503 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:26.156324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec32e76-915f-4f37-abf0-6f8b59539503 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:26.185550 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:26.202233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba26e1-d43c-40c0-8ff7-bb2091bdf949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:26.202845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba26e1-d43c-40c0-8ff7-bb2091bdf949 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:26.203123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba26e1-d43c-40c0-8ff7-bb2091bdf949 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:26.203407 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba26e1-d43c-40c0-8ff7-bb2091bdf949 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:26.204237 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba26e1-d43c-40c0-8ff7-bb2091bdf949 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:26.204586 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba26e1-d43c-40c0-8ff7-bb2091bdf949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:26.206210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba26e1-d43c-40c0-8ff7-bb2091bdf949 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:26.216116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 621/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:12:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:26.223125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36f9aa-42e2-4523-9bbf-7b873e7fce18 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:26.285230 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:26.356400 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36f9aa-42e2-4523-9bbf-7b873e7fce18 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:26.403205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa41a93-2f80-4ba8-8b5c-527b8dbd17f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:26.404372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa41a93-2f80-4ba8-8b5c-527b8dbd17f0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:26.404823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa41a93-2f80-4ba8-8b5c-527b8dbd17f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:26.405166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa41a93-2f80-4ba8-8b5c-527b8dbd17f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:26.424260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa41a93-2f80-4ba8-8b5c-527b8dbd17f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:26.425946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa41a93-2f80-4ba8-8b5c-527b8dbd17f0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-8aa41a93-2f80-4ba8-8b5c-527b8dbd17f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:12:26.446050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:26.448467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:12:26.450485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:12:26.450485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:26.450485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:26.452917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 603/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:26.453938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba26e1-d43c-40c0-8ff7-bb2091bdf949 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:26.639166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba26e1-d43c-40c0-8ff7-bb2091bdf949 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:26.680070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c67d6-53b1-4972-9ed8-bb1af5aa08a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:26.681070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c67d6-53b1-4972-9ed8-bb1af5aa08a5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:26.681547 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c67d6-53b1-4972-9ed8-bb1af5aa08a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:26.682020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c67d6-53b1-4972-9ed8-bb1af5aa08a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:26.683339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c67d6-53b1-4972-9ed8-bb1af5aa08a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:26.683886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c67d6-53b1-4972-9ed8-bb1af5aa08a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:26.687322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c67d6-53b1-4972-9ed8-bb1af5aa08a5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:26.702281 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 622/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:12:26.708745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa41a93-2f80-4ba8-8b5c-527b8dbd17f0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:26.830072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:26.839149 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa41a93-2f80-4ba8-8b5c-527b8dbd17f0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:26.880094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeb22c-ffe8-4dca-98ae-ad049bf3ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:26.880983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb22c-ffe8-4dca-98ae-ad049bf3ac44 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:26.881334 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb22c-ffe8-4dca-98ae-ad049bf3ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:26.881667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb22c-ffe8-4dca-98ae-ad049bf3ac44 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:26.893305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeb22c-ffe8-4dca-98ae-ad049bf3ac44 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:26.895170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeb22c-ffe8-4dca-98ae-ad049bf3ac44 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-dffeb22c-ffe8-4dca-98ae-ad049bf3ac44 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:12:26.909260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:26.910903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:26.912051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:26.912051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:26.912051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:12:26.912051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:12:26.912051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:12:26.912051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:12:26.912051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:12:26.912051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:12:26.912051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 16:12:26.912051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:26.915776 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 604/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:26.917442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c67d6-53b1-4972-9ed8-bb1af5aa08a5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:26.976222 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:27.041358 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c67d6-53b1-4972-9ed8-bb1af5aa08a5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:27.088996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b17215-56fd-46c8-b54d-cf9a28dbd1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:27.089716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17215-56fd-46c8-b54d-cf9a28dbd1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:27.090179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17215-56fd-46c8-b54d-cf9a28dbd1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:27.090374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17215-56fd-46c8-b54d-cf9a28dbd1f4 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:27.091210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b17215-56fd-46c8-b54d-cf9a28dbd1f4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:27.091522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b17215-56fd-46c8-b54d-cf9a28dbd1f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:27.093623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b17215-56fd-46c8-b54d-cf9a28dbd1f4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:27.120862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 623/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 21 16:12:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:27.122332 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeb22c-ffe8-4dca-98ae-ad049bf3ac44 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:27.264448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeb22c-ffe8-4dca-98ae-ad049bf3ac44 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:27.313263 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a35e58-eba1-4a8b-b4a2-d111f25c86fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:27.313992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a35e58-eba1-4a8b-b4a2-d111f25c86fa None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:27.314273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a35e58-eba1-4a8b-b4a2-d111f25c86fa None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:27.314545 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a35e58-eba1-4a8b-b4a2-d111f25c86fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:27.327640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a35e58-eba1-4a8b-b4a2-d111f25c86fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:27.329159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a35e58-eba1-4a8b-b4a2-d111f25c86fa None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-12a35e58-eba1-4a8b-b4a2-d111f25c86fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:12:27.348333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:27.350385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:12:27.352389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:12:27.352389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:27.352389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:27.352389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 605/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:27.356289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b17215-56fd-46c8-b54d-cf9a28dbd1f4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:27.499916 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b17215-56fd-46c8-b54d-cf9a28dbd1f4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:27.503186 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:27.540420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90e9c4-5f8a-4c8c-9bef-77e3c144be33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:27.541209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90e9c4-5f8a-4c8c-9bef-77e3c144be33 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:27.541583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90e9c4-5f8a-4c8c-9bef-77e3c144be33 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:27.541944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90e9c4-5f8a-4c8c-9bef-77e3c144be33 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:27.542685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90e9c4-5f8a-4c8c-9bef-77e3c144be33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:27.543070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90e9c4-5f8a-4c8c-9bef-77e3c144be33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:27.544608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90e9c4-5f8a-4c8c-9bef-77e3c144be33 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:27.559302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 624/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:27.566091 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a35e58-eba1-4a8b-b4a2-d111f25c86fa None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:27.577821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:27.689776 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a35e58-eba1-4a8b-b4a2-d111f25c86fa None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:27.735370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d672ae-99c1-426e-8354-f4c169460619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:27.736008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d672ae-99c1-426e-8354-f4c169460619 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:27.736329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d672ae-99c1-426e-8354-f4c169460619 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:27.736628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d672ae-99c1-426e-8354-f4c169460619 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:27.744394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d672ae-99c1-426e-8354-f4c169460619 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:27.745941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d672ae-99c1-426e-8354-f4c169460619 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-e5d672ae-99c1-426e-8354-f4c169460619 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:12:27.764272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:27.765529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:27.766775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:12:27.766775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:12:27.766775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:12:27.766775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:12:27.766775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:12:27.766775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:12:27.766775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:12:27.766775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:27.766775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 606/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:12:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:27.773188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90e9c4-5f8a-4c8c-9bef-77e3c144be33 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:27.891359 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90e9c4-5f8a-4c8c-9bef-77e3c144be33 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:27.946614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0da65-bffc-4f39-942e-5b9b3f6fa329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:27.947435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0da65-bffc-4f39-942e-5b9b3f6fa329 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:27.947721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0da65-bffc-4f39-942e-5b9b3f6fa329 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:27.947992 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0da65-bffc-4f39-942e-5b9b3f6fa329 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:27.948729 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0da65-bffc-4f39-942e-5b9b3f6fa329 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:27.949031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0da65-bffc-4f39-942e-5b9b3f6fa329 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:27.950771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0da65-bffc-4f39-942e-5b9b3f6fa329 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:27.968730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 625/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:12:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:27.977076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d672ae-99c1-426e-8354-f4c169460619 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:28.060014 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:28.110397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d672ae-99c1-426e-8354-f4c169460619 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:28.148548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af9d65-8193-48b0-8cfb-b35a1a8aa68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:28.149239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9d65-8193-48b0-8cfb-b35a1a8aa68a None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:28.149604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9d65-8193-48b0-8cfb-b35a1a8aa68a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:28.149759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9d65-8193-48b0-8cfb-b35a1a8aa68a None admin] PATH_INFO: `/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/7cd3076ca5a84ff7ada13065f9531f52/roles/8e7b3a48a50745adad97c6205aafc562` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:28.165919 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af9d65-8193-48b0-8cfb-b35a1a8aa68a None admin] RBAC: Authorizing `identity:create_grant(project_id=78142a67f69a4ba58113cc7c8dc269b1, user_id=7cd3076ca5a84ff7ada13065f9531f52, role_id=8e7b3a48a50745adad97c6205aafc562)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:28.167483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af9d65-8193-48b0-8cfb-b35a1a8aa68a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:28.182420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 607/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:12:27 2022] PUT /identity/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/7cd3076ca5a84ff7ada13065f9531f52/roles/8e7b3a48a50745adad97c6205aafc562 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:12:30.714969 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440f9d0-90bf-4b0d-8e77-665f3c0b1680 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:30.715538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440f9d0-90bf-4b0d-8e77-665f3c0b1680 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:30.715538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440f9d0-90bf-4b0d-8e77-665f3c0b1680 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:30.717743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 626/1233] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:12:30.725171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e580241-f634-4eca-8a8c-138cf8ae942e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:30.725759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e580241-f634-4eca-8a8c-138cf8ae942e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:30.726106 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e580241-f634-4eca-8a8c-138cf8ae942e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:30.753645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5e580241-f634-4eca-8a8c-138cf8ae942e None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:12:30.755046 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5e580241-f634-4eca-8a8c-138cf8ae942e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:12:30.857730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 608/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:12:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:12:31.168342 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440f9d0-90bf-4b0d-8e77-665f3c0b1680 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:31.200919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:31.316178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440f9d0-90bf-4b0d-8e77-665f3c0b1680 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:31.352981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89fbd-4680-40dc-8357-aec13e5ef58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:31.353616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89fbd-4680-40dc-8357-aec13e5ef58b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:31.353889 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89fbd-4680-40dc-8357-aec13e5ef58b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:31.354152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89fbd-4680-40dc-8357-aec13e5ef58b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:31.367146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b89fbd-4680-40dc-8357-aec13e5ef58b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a8b89fbd-4680-40dc-8357-aec13e5ef58b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:12:31.378042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:31.379165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:31.380084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:31.380084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:31.380084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:31.380084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:31.380084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:12:31.380084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:12:31.380084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:12:31.380084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:12:31.380084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:12:31.380084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:12:31.380084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 16:12:31.380084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:31.380084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 627/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 21 16:12:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:12:31.387502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e580241-f634-4eca-8a8c-138cf8ae942e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:31.436188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:31.511855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e580241-f634-4eca-8a8c-138cf8ae942e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:31.562935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1dd08-61b7-4677-bfb6-a8107d1f1002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:31.562935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1dd08-61b7-4677-bfb6-a8107d1f1002 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:31.562935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1dd08-61b7-4677-bfb6-a8107d1f1002 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:31.562935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1dd08-61b7-4677-bfb6-a8107d1f1002 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:31.563452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1dd08-61b7-4677-bfb6-a8107d1f1002 None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:31.563452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1dd08-61b7-4677-bfb6-a8107d1f1002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:31.563922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1dd08-61b7-4677-bfb6-a8107d1f1002 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:31.574982 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 609/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 21 16:12:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:31.581228 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89fbd-4680-40dc-8357-aec13e5ef58b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:31.693529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:31.717669 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89fbd-4680-40dc-8357-aec13e5ef58b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:31.765931 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636684f-1d23-4714-9af7-72a4f59cb19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:31.767265 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636684f-1d23-4714-9af7-72a4f59cb19b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:31.769015 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636684f-1d23-4714-9af7-72a4f59cb19b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:31.769304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636684f-1d23-4714-9af7-72a4f59cb19b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:31.791038 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636684f-1d23-4714-9af7-72a4f59cb19b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:31.793677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636684f-1d23-4714-9af7-72a4f59cb19b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c636684f-1d23-4714-9af7-72a4f59cb19b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:12:31.818902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:31.820210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:12:31.826211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:12:31.826211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:31.826211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:31.826211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 628/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:31.826806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1dd08-61b7-4677-bfb6-a8107d1f1002 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:31.975069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1dd08-61b7-4677-bfb6-a8107d1f1002 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:31.985455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:32.029836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134d697-dc1c-4400-8040-05973058743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:32.030569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134d697-dc1c-4400-8040-05973058743e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:32.030845 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134d697-dc1c-4400-8040-05973058743e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:32.031136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134d697-dc1c-4400-8040-05973058743e None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:32.031889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134d697-dc1c-4400-8040-05973058743e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:32.032319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134d697-dc1c-4400-8040-05973058743e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:32.033806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134d697-dc1c-4400-8040-05973058743e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:32.051919 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 610/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:32.059876 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636684f-1d23-4714-9af7-72a4f59cb19b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:32.198141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636684f-1d23-4714-9af7-72a4f59cb19b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:32.246421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cedc94-3154-4850-9f59-34b4ccfbcd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:32.246986 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cedc94-3154-4850-9f59-34b4ccfbcd64 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:32.247247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cedc94-3154-4850-9f59-34b4ccfbcd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:32.247517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cedc94-3154-4850-9f59-34b4ccfbcd64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:32.250664 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:32.257563 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cedc94-3154-4850-9f59-34b4ccfbcd64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:32.259324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cedc94-3154-4850-9f59-34b4ccfbcd64 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-41cedc94-3154-4850-9f59-34b4ccfbcd64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:12:32.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:32.276194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:32.280244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:32.280244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:32.280244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:12:32.280244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:12:32.280244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:12:32.280244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:12:32.280244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:12:32.280244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:12:32.280244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 16:12:32.280244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:32.280244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 629/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:32.283479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134d697-dc1c-4400-8040-05973058743e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:32.414354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134d697-dc1c-4400-8040-05973058743e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:32.465804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e7528-aece-42e2-87db-433f5f94572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:32.467334 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e7528-aece-42e2-87db-433f5f94572d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:32.467613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e7528-aece-42e2-87db-433f5f94572d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:32.467908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e7528-aece-42e2-87db-433f5f94572d None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:32.469089 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e7528-aece-42e2-87db-433f5f94572d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:32.469392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e7528-aece-42e2-87db-433f5f94572d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:32.471197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e7528-aece-42e2-87db-433f5f94572d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:32.498349 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 611/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 21 16:12:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:12:32.505610 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cedc94-3154-4850-9f59-34b4ccfbcd64 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:32.653741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cedc94-3154-4850-9f59-34b4ccfbcd64 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:32.701697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccb5d3-3ac2-4e24-8696-d7226c861560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:32.702438 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccb5d3-3ac2-4e24-8696-d7226c861560 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:32.705714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccb5d3-3ac2-4e24-8696-d7226c861560 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:32.705714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccb5d3-3ac2-4e24-8696-d7226c861560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:32.784176 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:32.793166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccb5d3-3ac2-4e24-8696-d7226c861560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:32.795078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccb5d3-3ac2-4e24-8696-d7226c861560 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:32.939575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 630/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:12:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:12:32.946509 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e7528-aece-42e2-87db-433f5f94572d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:32.991606 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:33.100134 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e7528-aece-42e2-87db-433f5f94572d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:33.142009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652d4ad-e774-479e-a7b9-1eb4abeeded3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:33.142782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652d4ad-e774-479e-a7b9-1eb4abeeded3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:33.143086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652d4ad-e774-479e-a7b9-1eb4abeeded3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:33.143507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652d4ad-e774-479e-a7b9-1eb4abeeded3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:33.156810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652d4ad-e774-479e-a7b9-1eb4abeeded3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:33.158460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652d4ad-e774-479e-a7b9-1eb4abeeded3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-3652d4ad-e774-479e-a7b9-1eb4abeeded3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:12:33.176601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:33.179055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:12:33.181174 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:12:33.181174 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:33.181174 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:33.181174 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 612/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:33.183919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccb5d3-3ac2-4e24-8696-d7226c861560 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:33.316078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:33.324136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccb5d3-3ac2-4e24-8696-d7226c861560 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:33.378311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f5ce6-2d6a-4008-aa2b-ca40f9023c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:33.379105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5ce6-2d6a-4008-aa2b-ca40f9023c42 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:33.379420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5ce6-2d6a-4008-aa2b-ca40f9023c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:33.379676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5ce6-2d6a-4008-aa2b-ca40f9023c42 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:33.380458 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f5ce6-2d6a-4008-aa2b-ca40f9023c42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:33.380796 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f5ce6-2d6a-4008-aa2b-ca40f9023c42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:33.382243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f5ce6-2d6a-4008-aa2b-ca40f9023c42 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:33.396731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 631/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:33.402426 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652d4ad-e774-479e-a7b9-1eb4abeeded3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:33.527351 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:33.556942 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652d4ad-e774-479e-a7b9-1eb4abeeded3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:33.601438 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73da50-88e6-463f-b215-2e82949a9caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:33.602162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73da50-88e6-463f-b215-2e82949a9caa None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:33.602444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73da50-88e6-463f-b215-2e82949a9caa None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:33.602714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73da50-88e6-463f-b215-2e82949a9caa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:33.611413 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73da50-88e6-463f-b215-2e82949a9caa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:33.613014 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73da50-88e6-463f-b215-2e82949a9caa None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-bf73da50-88e6-463f-b215-2e82949a9caa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:12:33.627063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:33.636726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:33.638459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:12:33.638459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:12:33.638459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:12:33.638459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:12:33.638459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:12:33.638459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:12:33.638459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:12:33.638459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:33.638459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 613/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:12:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 16:12:33.639485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f5ce6-2d6a-4008-aa2b-ca40f9023c42 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:33.771037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f5ce6-2d6a-4008-aa2b-ca40f9023c42 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:33.817742 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55bdb6-2dfa-45b2-8bf9-eb842a0a03d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:33.818430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55bdb6-2dfa-45b2-8bf9-eb842a0a03d1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:33.818685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55bdb6-2dfa-45b2-8bf9-eb842a0a03d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:33.818977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55bdb6-2dfa-45b2-8bf9-eb842a0a03d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:33.819700 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55bdb6-2dfa-45b2-8bf9-eb842a0a03d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:33.820048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55bdb6-2dfa-45b2-8bf9-eb842a0a03d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:33.821574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55bdb6-2dfa-45b2-8bf9-eb842a0a03d1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:33.835733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 632/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:12:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:33.843383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73da50-88e6-463f-b215-2e82949a9caa None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:34.001035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73da50-88e6-463f-b215-2e82949a9caa None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:34.049860 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72c2e4-2dd6-44f7-945e-6ad753d4ceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:34.050494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c2e4-2dd6-44f7-945e-6ad753d4ceaf None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:34.050769 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c2e4-2dd6-44f7-945e-6ad753d4ceaf None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:34.051037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c2e4-2dd6-44f7-945e-6ad753d4ceaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:34.051753 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72c2e4-2dd6-44f7-945e-6ad753d4ceaf None admin] RBAC: Adding query filter params (role.id=8e7b3a48a50745adad97c6205aafc562, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=7cd3076ca5a84ff7ada13065f9531f52) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:34.052063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72c2e4-2dd6-44f7-945e-6ad753d4ceaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:34.053735 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72c2e4-2dd6-44f7-945e-6ad753d4ceaf None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:34.061312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 614/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:12:33 2022] GET /identity/v3/role_assignments?user.id=7cd3076ca5a84ff7ada13065f9531f52&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=8e7b3a48a50745adad97c6205aafc562 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:36.630740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627d47b-123b-4a86-9be8-c844b4bc97ba None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:36.631440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627d47b-123b-4a86-9be8-c844b4bc97ba None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:36.631769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627d47b-123b-4a86-9be8-c844b4bc97ba None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:36.633746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 633/1247] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:12:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:12:36.641407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bddc08-f289-4982-bfbd-b62c8c91c8c5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:36.642206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bddc08-f289-4982-bfbd-b62c8c91c8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:36.642206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bddc08-f289-4982-bfbd-b62c8c91c8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:36.650009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:36.667797 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-41bddc08-f289-4982-bfbd-b62c8c91c8c5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:12:36.669360 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-41bddc08-f289-4982-bfbd-b62c8c91c8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:12:36.765605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 615/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:12:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:12:37.059096 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627d47b-123b-4a86-9be8-c844b4bc97ba None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:37.081853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:37.225055 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627d47b-123b-4a86-9be8-c844b4bc97ba None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:37.274960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24370176-7edc-4a23-8764-56f4e2af6a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:37.275764 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370176-7edc-4a23-8764-56f4e2af6a48 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:37.276136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370176-7edc-4a23-8764-56f4e2af6a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:37.276505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370176-7edc-4a23-8764-56f4e2af6a48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:37.294677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24370176-7edc-4a23-8764-56f4e2af6a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-24370176-7edc-4a23-8764-56f4e2af6a48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:12:37.300575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:37.301845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:37.302883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:37.302883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:37.302883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:37.302883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:37.302883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:12:37.302883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:12:37.302883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:12:37.302883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:12:37.302883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:12:37.302883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:12:37.302883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:12:37.302883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:37.307431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 634/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:12:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:37.308449 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bddc08-f289-4982-bfbd-b62c8c91c8c5 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:37.458083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bddc08-f289-4982-bfbd-b62c8c91c8c5 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:37.495297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:37.501661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae597a60-a34e-4a52-92c5-c0adb2766978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:37.502288 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae597a60-a34e-4a52-92c5-c0adb2766978 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:37.502567 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae597a60-a34e-4a52-92c5-c0adb2766978 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:37.502839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae597a60-a34e-4a52-92c5-c0adb2766978 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:37.503513 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae597a60-a34e-4a52-92c5-c0adb2766978 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:37.503816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae597a60-a34e-4a52-92c5-c0adb2766978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:37.505271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae597a60-a34e-4a52-92c5-c0adb2766978 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:37.523575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 616/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:12:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:12:37.525104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24370176-7edc-4a23-8764-56f4e2af6a48 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:37.626301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:37.657840 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24370176-7edc-4a23-8764-56f4e2af6a48 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:37.698974 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb6926-1382-4d81-982f-245622f3fdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:37.699611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb6926-1382-4d81-982f-245622f3fdf0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:37.699890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb6926-1382-4d81-982f-245622f3fdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:37.700160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb6926-1382-4d81-982f-245622f3fdf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:37.712855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb6926-1382-4d81-982f-245622f3fdf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:37.714246 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb6926-1382-4d81-982f-245622f3fdf0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7eeb6926-1382-4d81-982f-245622f3fdf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:12:37.730404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:37.732245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:12:37.733970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:12:37.733970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:37.733970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:37.733970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 635/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:37.737618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae597a60-a34e-4a52-92c5-c0adb2766978 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:37.849583 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae597a60-a34e-4a52-92c5-c0adb2766978 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:37.891087 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d23f4-5f21-4e10-80af-533538e1bef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:37.891984 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d23f4-5f21-4e10-80af-533538e1bef0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:37.892430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d23f4-5f21-4e10-80af-533538e1bef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:37.892867 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d23f4-5f21-4e10-80af-533538e1bef0 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:37.893387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d23f4-5f21-4e10-80af-533538e1bef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:37.893689 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d23f4-5f21-4e10-80af-533538e1bef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:37.895064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d23f4-5f21-4e10-80af-533538e1bef0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:37.909250 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 617/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:37.921720 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb6926-1382-4d81-982f-245622f3fdf0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:38.056025 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb6926-1382-4d81-982f-245622f3fdf0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:38.095906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:38.104872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fd6fe-81da-45d3-8240-68e556fd1e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:38.105547 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fd6fe-81da-45d3-8240-68e556fd1e0e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:38.105820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fd6fe-81da-45d3-8240-68e556fd1e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:38.106125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fd6fe-81da-45d3-8240-68e556fd1e0e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:38.115241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fd6fe-81da-45d3-8240-68e556fd1e0e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:38.116664 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fd6fe-81da-45d3-8240-68e556fd1e0e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9f0fd6fe-81da-45d3-8240-68e556fd1e0e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:12:38.129073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:38.130367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:38.131623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:38.131623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:38.131623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:12:38.131623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:12:38.131623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:12:38.131623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:12:38.131623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:12:38.131623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:12:38.131623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 16:12:38.131623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:38.131623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 636/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:38.137367 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d23f4-5f21-4e10-80af-533538e1bef0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:38.198834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:38.250965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d23f4-5f21-4e10-80af-533538e1bef0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:38.295808 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8155dc5-5af0-47e3-9147-e2294bf39786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:38.297323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8155dc5-5af0-47e3-9147-e2294bf39786 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:38.297808 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8155dc5-5af0-47e3-9147-e2294bf39786 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:38.298280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8155dc5-5af0-47e3-9147-e2294bf39786 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:38.299737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8155dc5-5af0-47e3-9147-e2294bf39786 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:38.300284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8155dc5-5af0-47e3-9147-e2294bf39786 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:38.303196 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8155dc5-5af0-47e3-9147-e2294bf39786 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:38.328614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 618/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 21 16:12:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:12:38.335599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fd6fe-81da-45d3-8240-68e556fd1e0e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:38.463358 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fd6fe-81da-45d3-8240-68e556fd1e0e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:38.502406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbb131-ed76-4342-a1a5-375cc0ade17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:38.503155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb131-ed76-4342-a1a5-375cc0ade17b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:38.503436 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb131-ed76-4342-a1a5-375cc0ade17b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:38.503743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb131-ed76-4342-a1a5-375cc0ade17b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:38.564244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:38.578404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbb131-ed76-4342-a1a5-375cc0ade17b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:38.579963 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbb131-ed76-4342-a1a5-375cc0ade17b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:38.698698 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 637/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:12:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:12:38.706167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8155dc5-5af0-47e3-9147-e2294bf39786 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:38.834658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8155dc5-5af0-47e3-9147-e2294bf39786 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:38.851056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:38.873358 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b70bb-2e2d-4da1-9807-7983e2d0d8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:38.874003 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b70bb-2e2d-4da1-9807-7983e2d0d8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:38.874280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b70bb-2e2d-4da1-9807-7983e2d0d8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:38.874546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b70bb-2e2d-4da1-9807-7983e2d0d8f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:38.885383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b70bb-2e2d-4da1-9807-7983e2d0d8f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:38.886858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b70bb-2e2d-4da1-9807-7983e2d0d8f7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-271b70bb-2e2d-4da1-9807-7983e2d0d8f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:12:38.908831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:38.910052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:12:38.911137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:12:38.911137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:38.911137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:38.915135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 619/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:38.916999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbb131-ed76-4342-a1a5-375cc0ade17b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:39.024650 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:39.038516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbb131-ed76-4342-a1a5-375cc0ade17b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:39.081925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0d7a9-8a96-437d-8415-d4a0979e5af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:39.082844 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0d7a9-8a96-437d-8415-d4a0979e5af3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:39.083226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0d7a9-8a96-437d-8415-d4a0979e5af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:39.083611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0d7a9-8a96-437d-8415-d4a0979e5af3 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:39.084367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0d7a9-8a96-437d-8415-d4a0979e5af3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:39.084826 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0d7a9-8a96-437d-8415-d4a0979e5af3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:39.086528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0d7a9-8a96-437d-8415-d4a0979e5af3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:39.099977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 638/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:39.106549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b70bb-2e2d-4da1-9807-7983e2d0d8f7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:39.220385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b70bb-2e2d-4da1-9807-7983e2d0d8f7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:39.261438 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d539e-f632-443a-a3bc-cdd73be6dd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:39.262073 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d539e-f632-443a-a3bc-cdd73be6dd11 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:39.262351 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d539e-f632-443a-a3bc-cdd73be6dd11 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:39.262620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d539e-f632-443a-a3bc-cdd73be6dd11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:39.270242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d539e-f632-443a-a3bc-cdd73be6dd11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:39.271683 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d539e-f632-443a-a3bc-cdd73be6dd11 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-543d539e-f632-443a-a3bc-cdd73be6dd11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:12:39.283362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:39.284516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:39.285655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:12:39.285655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:12:39.285655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:12:39.285655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:12:39.285655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:12:39.285655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:12:39.285655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:12:39.285655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:39.285655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 620/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:39.290756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0d7a9-8a96-437d-8415-d4a0979e5af3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:39.395820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0d7a9-8a96-437d-8415-d4a0979e5af3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:39.428434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd87a5-1106-47db-9cf2-2c91517db802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:39.429063 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd87a5-1106-47db-9cf2-2c91517db802 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:39.429340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd87a5-1106-47db-9cf2-2c91517db802 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:39.429609 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd87a5-1106-47db-9cf2-2c91517db802 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:39.430287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd87a5-1106-47db-9cf2-2c91517db802 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:39.430589 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd87a5-1106-47db-9cf2-2c91517db802 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:39.432007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd87a5-1106-47db-9cf2-2c91517db802 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:39.443648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 639/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:39.449863 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d539e-f632-443a-a3bc-cdd73be6dd11 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:39.476484 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:39.551544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d539e-f632-443a-a3bc-cdd73be6dd11 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:39.584840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df01162-03c5-4980-974e-fcd6001caf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:39.585692 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df01162-03c5-4980-974e-fcd6001caf33 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:39.585968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df01162-03c5-4980-974e-fcd6001caf33 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:39.586235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df01162-03c5-4980-974e-fcd6001caf33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:39.586950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df01162-03c5-4980-974e-fcd6001caf33 None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=7cd3076ca5a84ff7ada13065f9531f52) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:39.587255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df01162-03c5-4980-974e-fcd6001caf33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:39.588677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df01162-03c5-4980-974e-fcd6001caf33 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:39.594444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 621/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:12:39 2022] GET /identity/v3/role_assignments?user.id=7cd3076ca5a84ff7ada13065f9531f52&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=beec000223e041209205627bfa0dbed1 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:41.762773 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da71aab-c8df-43ac-b8c1-fcc0a9fcf876 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:41.763297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da71aab-c8df-43ac-b8c1-fcc0a9fcf876 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:41.763297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da71aab-c8df-43ac-b8c1-fcc0a9fcf876 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:41.764546 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 640/1261] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:12:41.769735 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f864d94-4f5d-4614-aa0c-5db7669f6468 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:41.770192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f864d94-4f5d-4614-aa0c-5db7669f6468 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:41.770296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f864d94-4f5d-4614-aa0c-5db7669f6468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:41.788227 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9f864d94-4f5d-4614-aa0c-5db7669f6468 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:12:41.789456 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9f864d94-4f5d-4614-aa0c-5db7669f6468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:12:41.855127 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 622/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:12:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:12:42.129273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da71aab-c8df-43ac-b8c1-fcc0a9fcf876 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:42.140083 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:42.244653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da71aab-c8df-43ac-b8c1-fcc0a9fcf876 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:42.282165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77236e7-addd-4f52-aaa6-a8f35b69d4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:42.282795 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77236e7-addd-4f52-aaa6-a8f35b69d4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:42.283069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77236e7-addd-4f52-aaa6-a8f35b69d4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:42.283337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77236e7-addd-4f52-aaa6-a8f35b69d4c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:42.293651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77236e7-addd-4f52-aaa6-a8f35b69d4c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e77236e7-addd-4f52-aaa6-a8f35b69d4c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:12:42.299040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:42.300216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:42.301569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:42.301569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:42.301569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:42.301569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:42.301569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:12:42.301569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:12:42.301569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:12:42.301569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:12:42.301569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:12:42.301569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:12:42.301569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:12:42.301569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:42.301569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 641/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:12:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:42.306218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f864d94-4f5d-4614-aa0c-5db7669f6468 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:42.325933 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:42.412185 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f864d94-4f5d-4614-aa0c-5db7669f6468 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:42.444830 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03695c3b-1d08-4e6d-bfd0-266dc82b4f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:42.445381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03695c3b-1d08-4e6d-bfd0-266dc82b4f21 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:42.445659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03695c3b-1d08-4e6d-bfd0-266dc82b4f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:42.445928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03695c3b-1d08-4e6d-bfd0-266dc82b4f21 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:42.446590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03695c3b-1d08-4e6d-bfd0-266dc82b4f21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:42.446893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03695c3b-1d08-4e6d-bfd0-266dc82b4f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:42.448252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03695c3b-1d08-4e6d-bfd0-266dc82b4f21 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:42.457916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 623/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:12:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:42.463968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77236e7-addd-4f52-aaa6-a8f35b69d4c7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:42.529952 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:42.562803 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77236e7-addd-4f52-aaa6-a8f35b69d4c7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:42.596300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0776c-01da-4071-9e2e-007c9a10943d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:42.596939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0776c-01da-4071-9e2e-007c9a10943d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:42.597217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0776c-01da-4071-9e2e-007c9a10943d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:42.597486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0776c-01da-4071-9e2e-007c9a10943d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:42.607194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0776c-01da-4071-9e2e-007c9a10943d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:42.608616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0776c-01da-4071-9e2e-007c9a10943d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8ca0776c-01da-4071-9e2e-007c9a10943d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:12:42.625136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:42.626306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:12:42.628232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:12:42.628232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:42.628232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:42.628232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 642/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:42.633062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03695c3b-1d08-4e6d-bfd0-266dc82b4f21 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:42.717446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:42.736989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03695c3b-1d08-4e6d-bfd0-266dc82b4f21 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:42.770829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf00d0-f39a-450f-af67-573c5201da53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:42.771473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf00d0-f39a-450f-af67-573c5201da53 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:42.771703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf00d0-f39a-450f-af67-573c5201da53 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:42.771975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf00d0-f39a-450f-af67-573c5201da53 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:42.772622 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf00d0-f39a-450f-af67-573c5201da53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:42.772955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf00d0-f39a-450f-af67-573c5201da53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:42.774315 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf00d0-f39a-450f-af67-573c5201da53 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:42.785902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 624/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:42.791627 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0776c-01da-4071-9e2e-007c9a10943d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:42.890533 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0776c-01da-4071-9e2e-007c9a10943d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:42.911888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:42.926930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014d017-9d9d-4d2f-80d9-0fa40b2a88b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:42.927559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014d017-9d9d-4d2f-80d9-0fa40b2a88b4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:42.927834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014d017-9d9d-4d2f-80d9-0fa40b2a88b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:42.928102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014d017-9d9d-4d2f-80d9-0fa40b2a88b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:42.936114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014d017-9d9d-4d2f-80d9-0fa40b2a88b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:42.937569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014d017-9d9d-4d2f-80d9-0fa40b2a88b4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6014d017-9d9d-4d2f-80d9-0fa40b2a88b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:12:42.948555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:42.949767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:42.951626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:42.951626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:42.951626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:12:42.951626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:12:42.951626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:12:42.951626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:12:42.951626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:12:42.951626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:12:42.951626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 16:12:42.951626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:42.951626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 643/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:42.956192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf00d0-f39a-450f-af67-573c5201da53 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:43.059017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf00d0-f39a-450f-af67-573c5201da53 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:43.093833 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e2d27-ef79-4a32-b257-823c8c140710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:43.094406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e2d27-ef79-4a32-b257-823c8c140710 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:43.094719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e2d27-ef79-4a32-b257-823c8c140710 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:43.094930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e2d27-ef79-4a32-b257-823c8c140710 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:43.095642 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e2d27-ef79-4a32-b257-823c8c140710 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:43.095939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e2d27-ef79-4a32-b257-823c8c140710 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:43.097446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e2d27-ef79-4a32-b257-823c8c140710 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:43.106198 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:43.116508 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 625/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 21 16:12:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:43.123165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014d017-9d9d-4d2f-80d9-0fa40b2a88b4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:43.220714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014d017-9d9d-4d2f-80d9-0fa40b2a88b4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:43.253714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63484e-e9bf-44e0-8748-e1f7e646b272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:43.254338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63484e-e9bf-44e0-8748-e1f7e646b272 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:43.254616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63484e-e9bf-44e0-8748-e1f7e646b272 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:43.254887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63484e-e9bf-44e0-8748-e1f7e646b272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:43.265241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63484e-e9bf-44e0-8748-e1f7e646b272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:43.266673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63484e-e9bf-44e0-8748-e1f7e646b272 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ce63484e-e9bf-44e0-8748-e1f7e646b272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:12:43.280494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:43.281692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:12:43.282677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:12:43.282677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:43.282677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:43.282677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 644/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:43.287465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e2d27-ef79-4a32-b257-823c8c140710 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:43.393309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e2d27-ef79-4a32-b257-823c8c140710 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:43.429710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24a6c3-0901-4fe8-8bf3-649655fccfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:43.430327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24a6c3-0901-4fe8-8bf3-649655fccfd9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:43.430604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24a6c3-0901-4fe8-8bf3-649655fccfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:43.430872 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24a6c3-0901-4fe8-8bf3-649655fccfd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:43.431522 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24a6c3-0901-4fe8-8bf3-649655fccfd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:43.431822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24a6c3-0901-4fe8-8bf3-649655fccfd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:43.433240 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24a6c3-0901-4fe8-8bf3-649655fccfd9 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:43.446126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 626/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:43.452169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63484e-e9bf-44e0-8748-e1f7e646b272 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:43.486092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:43.557304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63484e-e9bf-44e0-8748-e1f7e646b272 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:43.594297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36737872-66b3-4aac-b9f1-894dc2f39e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:43.594928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36737872-66b3-4aac-b9f1-894dc2f39e39 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:43.595416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36737872-66b3-4aac-b9f1-894dc2f39e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:43.595777 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36737872-66b3-4aac-b9f1-894dc2f39e39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:43.603250 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36737872-66b3-4aac-b9f1-894dc2f39e39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:43.604703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36737872-66b3-4aac-b9f1-894dc2f39e39 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-36737872-66b3-4aac-b9f1-894dc2f39e39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:12:43.616556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:43.617587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:43.618649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:12:43.618649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:12:43.618649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:12:43.618649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:12:43.618649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:12:43.618649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:12:43.618649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:12:43.618649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:43.618649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 645/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:12:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:43.623749 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24a6c3-0901-4fe8-8bf3-649655fccfd9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:43.681589 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:43.724009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24a6c3-0901-4fe8-8bf3-649655fccfd9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:43.756845 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050b315-ef85-473d-8dbd-42d08df62810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:43.757442 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050b315-ef85-473d-8dbd-42d08df62810 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:43.757718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050b315-ef85-473d-8dbd-42d08df62810 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:43.757988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050b315-ef85-473d-8dbd-42d08df62810 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:43.758675 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050b315-ef85-473d-8dbd-42d08df62810 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:43.758979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050b315-ef85-473d-8dbd-42d08df62810 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:43.760400 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050b315-ef85-473d-8dbd-42d08df62810 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:43.772107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 627/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:43.778899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36737872-66b3-4aac-b9f1-894dc2f39e39 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:43.867585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:43.876288 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36737872-66b3-4aac-b9f1-894dc2f39e39 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:43.914544 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acec80-96a4-4024-b532-9ebc3614c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:43.915208 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acec80-96a4-4024-b532-9ebc3614c8b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:43.915483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acec80-96a4-4024-b532-9ebc3614c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:43.915751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acec80-96a4-4024-b532-9ebc3614c8b9 None admin] PATH_INFO: `/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/7cd3076ca5a84ff7ada13065f9531f52/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:43.917728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acec80-96a4-4024-b532-9ebc3614c8b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=78142a67f69a4ba58113cc7c8dc269b1, user_id=7cd3076ca5a84ff7ada13065f9531f52, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:43.919286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acec80-96a4-4024-b532-9ebc3614c8b9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:43.931767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 646/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 21 16:12:43 2022] PUT /identity/v3/projects/78142a67f69a4ba58113cc7c8dc269b1/users/7cd3076ca5a84ff7ada13065f9531f52/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:12:46.057492 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5cec-1995-4127-bb85-d820f2bef6a4 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:46.058069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5cec-1995-4127-bb85-d820f2bef6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:46.058069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5cec-1995-4127-bb85-d820f2bef6a4 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:46.059877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 628/1274] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:12:46.065198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6386cc0-8d1a-4fe1-88e6-e9085a7fda95 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:46.065721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6386cc0-8d1a-4fe1-88e6-e9085a7fda95 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:46.065721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6386cc0-8d1a-4fe1-88e6-e9085a7fda95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:46.086798 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a6386cc0-8d1a-4fe1-88e6-e9085a7fda95 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:12:46.087991 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a6386cc0-8d1a-4fe1-88e6-e9085a7fda95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:12:46.158854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 647/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:12:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:12:46.427221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d5cec-1995-4127-bb85-d820f2bef6a4 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:46.532169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d5cec-1995-4127-bb85-d820f2bef6a4 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:46.552297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:46.569189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14b06e-3a4f-4be3-9b1a-b33fe566d23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:46.569819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14b06e-3a4f-4be3-9b1a-b33fe566d23a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:46.570095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14b06e-3a4f-4be3-9b1a-b33fe566d23a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:46.570390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14b06e-3a4f-4be3-9b1a-b33fe566d23a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:46.580390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14b06e-3a4f-4be3-9b1a-b33fe566d23a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-7c14b06e-3a4f-4be3-9b1a-b33fe566d23a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 16:12:46.585468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:46.586573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:46.587641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:46.587641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:46.587641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:46.587641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:46.587641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 16:12:46.587641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 16:12:46.587641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 16:12:46.587641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 16:12:46.587641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 16:12:46.587641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 16:12:46.587641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 16:12:46.587641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:46.587641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 629/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 21 16:12:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:46.593236 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6386cc0-8d1a-4fe1-88e6-e9085a7fda95 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:46.671988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:46.696230 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6386cc0-8d1a-4fe1-88e6-e9085a7fda95 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:46.730225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacfcbb-4fd2-4685-a758-3709e84a4751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:46.730834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacfcbb-4fd2-4685-a758-3709e84a4751 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:46.731112 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacfcbb-4fd2-4685-a758-3709e84a4751 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:46.731949 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacfcbb-4fd2-4685-a758-3709e84a4751 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:46.732606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacfcbb-4fd2-4685-a758-3709e84a4751 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:46.732935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacfcbb-4fd2-4685-a758-3709e84a4751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:46.734296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacfcbb-4fd2-4685-a758-3709e84a4751 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:46.742609 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 648/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 21 16:12:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:46.748645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14b06e-3a4f-4be3-9b1a-b33fe566d23a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:46.847762 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14b06e-3a4f-4be3-9b1a-b33fe566d23a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:46.881201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b574d88-eec7-4db4-b78d-26e01803604b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:46.881823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574d88-eec7-4db4-b78d-26e01803604b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:46.882095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574d88-eec7-4db4-b78d-26e01803604b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:46.882360 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574d88-eec7-4db4-b78d-26e01803604b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:46.894371 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b574d88-eec7-4db4-b78d-26e01803604b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:46.895740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b574d88-eec7-4db4-b78d-26e01803604b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-5b574d88-eec7-4db4-b78d-26e01803604b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:12:46.911310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:46.912871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:12:46.913938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:12:46.913938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:46.913938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:46.913938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 630/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:46.918622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacfcbb-4fd2-4685-a758-3709e84a4751 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:47.021542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacfcbb-4fd2-4685-a758-3709e84a4751 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:47.055262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d2367-8b36-468f-86ff-8ee9fed1e6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:47.055859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d2367-8b36-468f-86ff-8ee9fed1e6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:47.056136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d2367-8b36-468f-86ff-8ee9fed1e6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:47.056401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d2367-8b36-468f-86ff-8ee9fed1e6a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:47.057064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d2367-8b36-468f-86ff-8ee9fed1e6a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:47.057364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d2367-8b36-468f-86ff-8ee9fed1e6a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:47.058710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d2367-8b36-468f-86ff-8ee9fed1e6a2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:47.070269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 649/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:12:47.076546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b574d88-eec7-4db4-b78d-26e01803604b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:47.108870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:47.179248 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b574d88-eec7-4db4-b78d-26e01803604b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:47.212360 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb249b5-a282-4596-83b7-eb4ae35c22de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:47.213003 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb249b5-a282-4596-83b7-eb4ae35c22de None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:47.213275 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb249b5-a282-4596-83b7-eb4ae35c22de None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:47.213537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb249b5-a282-4596-83b7-eb4ae35c22de None admin] PATH_INFO: `/v3/users/placement` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:47.221376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb249b5-a282-4596-83b7-eb4ae35c22de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:47.222793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb249b5-a282-4596-83b7-eb4ae35c22de None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-3cb249b5-a282-4596-83b7-eb4ae35c22de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 16:12:47.234359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:47.235582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:47.236771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:47.236771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:47.236771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 16:12:47.236771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 16:12:47.236771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 16:12:47.236771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 16:12:47.236771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 16:12:47.236771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 16:12:47.236771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 16:12:47.236771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:47.236771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 631/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:47.241407 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d2367-8b36-468f-86ff-8ee9fed1e6a2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:47.245250 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:47.339937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d2367-8b36-468f-86ff-8ee9fed1e6a2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:47.373977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf53a2-833c-4b4e-b060-beb644d94d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:47.374575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf53a2-833c-4b4e-b060-beb644d94d18 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:47.374845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf53a2-833c-4b4e-b060-beb644d94d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:47.375110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf53a2-833c-4b4e-b060-beb644d94d18 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:47.375824 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf53a2-833c-4b4e-b060-beb644d94d18 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:47.376122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf53a2-833c-4b4e-b060-beb644d94d18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:47.377558 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf53a2-833c-4b4e-b060-beb644d94d18 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:47.394150 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 650/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 21 16:12:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:47.399968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb249b5-a282-4596-83b7-eb4ae35c22de None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:47.492351 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:47.502580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb249b5-a282-4596-83b7-eb4ae35c22de None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:47.536426 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7a038-1473-415b-a423-b31451888b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:47.537062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7a038-1473-415b-a423-b31451888b81 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:47.537336 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7a038-1473-415b-a423-b31451888b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:47.537605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7a038-1473-415b-a423-b31451888b81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:47.604311 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7a038-1473-415b-a423-b31451888b81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:47.605694 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7a038-1473-415b-a423-b31451888b81 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:47.703848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:47.714870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 632/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 21 16:12:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 16:12:47.720770 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf53a2-833c-4b4e-b060-beb644d94d18 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:47.780309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:47.819271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf53a2-833c-4b4e-b060-beb644d94d18 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:47.852431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca367471-e3b0-4a70-9afd-6311575541e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:47.853083 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca367471-e3b0-4a70-9afd-6311575541e5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:47.853360 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca367471-e3b0-4a70-9afd-6311575541e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:47.853628 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca367471-e3b0-4a70-9afd-6311575541e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:47.864182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca367471-e3b0-4a70-9afd-6311575541e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:47.865599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca367471-e3b0-4a70-9afd-6311575541e5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ca367471-e3b0-4a70-9afd-6311575541e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 16:12:47.881376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:47.882411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 16:12:47.883468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 16:12:47.883468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 16:12:47.883468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:47.883468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 651/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:47.889801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7a038-1473-415b-a423-b31451888b81 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:47.995592 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7a038-1473-415b-a423-b31451888b81 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:48.032961 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e767b94-92bf-41e1-a793-9b18cb230a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:48.033571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e767b94-92bf-41e1-a793-9b18cb230a1a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:48.033844 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e767b94-92bf-41e1-a793-9b18cb230a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:48.034110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e767b94-92bf-41e1-a793-9b18cb230a1a None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:48.034761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e767b94-92bf-41e1-a793-9b18cb230a1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:48.035060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e767b94-92bf-41e1-a793-9b18cb230a1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:48.036458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e767b94-92bf-41e1-a793-9b18cb230a1a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:48.052052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 633/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 21 16:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:48.058040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca367471-e3b0-4a70-9afd-6311575541e5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:48.159052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca367471-e3b0-4a70-9afd-6311575541e5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:48.173130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:48.192808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad56fc-2b58-4842-afa5-76c97475cc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:48.193432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad56fc-2b58-4842-afa5-76c97475cc9b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:48.193703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad56fc-2b58-4842-afa5-76c97475cc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:48.193966 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad56fc-2b58-4842-afa5-76c97475cc9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:48.200538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad56fc-2b58-4842-afa5-76c97475cc9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:48.202019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad56fc-2b58-4842-afa5-76c97475cc9b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c9ad56fc-2b58-4842-afa5-76c97475cc9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 16:12:48.213387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:48.214463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:48.216123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 16:12:48.216123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 16:12:48.216123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 16:12:48.216123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 16:12:48.216123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 16:12:48.216123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 16:12:48.216123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 16:12:48.216123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 21 16:12:48.216123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 652/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 21 16:12:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:48.221189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e767b94-92bf-41e1-a793-9b18cb230a1a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:48.269719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:48.319000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e767b94-92bf-41e1-a793-9b18cb230a1a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:48.352047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7855b5-affa-47dd-9743-783fb52bc04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:48.352648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7855b5-affa-47dd-9743-783fb52bc04d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:48.352950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7855b5-affa-47dd-9743-783fb52bc04d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:48.353217 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7855b5-affa-47dd-9743-783fb52bc04d None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:48.353897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7855b5-affa-47dd-9743-783fb52bc04d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:48.354197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7855b5-affa-47dd-9743-783fb52bc04d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:48.355623 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7855b5-affa-47dd-9743-783fb52bc04d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:48.367892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 634/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 21 16:12:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:48.374160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad56fc-2b58-4842-afa5-76c97475cc9b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:48.471403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad56fc-2b58-4842-afa5-76c97475cc9b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:48.503204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc82b3-e771-4197-a86d-22f2f67dabe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:48.503806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc82b3-e771-4197-a86d-22f2f67dabe1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:48.504080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc82b3-e771-4197-a86d-22f2f67dabe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:48.504342 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc82b3-e771-4197-a86d-22f2f67dabe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:48.505085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc82b3-e771-4197-a86d-22f2f67dabe1 None admin] RBAC: Adding query filter params (role.id=beec000223e041209205627bfa0dbed1, scope.project.id=78142a67f69a4ba58113cc7c8dc269b1, user.id=7cd3076ca5a84ff7ada13065f9531f52) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:48.505385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc82b3-e771-4197-a86d-22f2f67dabe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:48.506788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc82b3-e771-4197-a86d-22f2f67dabe1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:48.513284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 653/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 21 16:12:48 2022] GET /identity/v3/role_assignments?user.id=7cd3076ca5a84ff7ada13065f9531f52&scope.project.id=78142a67f69a4ba58113cc7c8dc269b1&role.id=beec000223e041209205627bfa0dbed1 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:50.656463 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e73a6d-1624-4830-84b2-aad208cab239 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:50.657066 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e73a6d-1624-4830-84b2-aad208cab239 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:50.657066 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e73a6d-1624-4830-84b2-aad208cab239 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:50.658354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 635/1288] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:12:50.665624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cf957-a233-4b91-a477-078123f2e4b6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:50.666306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cf957-a233-4b91-a477-078123f2e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:50.666306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cf957-a233-4b91-a477-078123f2e4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:50.687493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-189cf957-a233-4b91-a477-078123f2e4b6 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:12:50.688713 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-189cf957-a233-4b91-a477-078123f2e4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:12:50.718472 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:50.756757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 654/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:12:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:12:51.036338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e73a6d-1624-4830-84b2-aad208cab239 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:51.153539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e73a6d-1624-4830-84b2-aad208cab239 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:51.165084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:51.189556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ce245-3080-4ba7-b847-fafb718f395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:51.189892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ce245-3080-4ba7-b847-fafb718f395f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:51.190733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ce245-3080-4ba7-b847-fafb718f395f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:51.190733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ce245-3080-4ba7-b847-fafb718f395f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:51.191033 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ce245-3080-4ba7-b847-fafb718f395f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:51.192324 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ce245-3080-4ba7-b847-fafb718f395f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-6d7ce245-3080-4ba7-b847-fafb718f395f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:51.201345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:51.202597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:51.203471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 636/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 21 16:12:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:51.208487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cf957-a233-4b91-a477-078123f2e4b6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:51.305352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cf957-a233-4b91-a477-078123f2e4b6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:51.338457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a204e-b5e6-442e-9d64-103d1be3bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:51.339069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a204e-b5e6-442e-9d64-103d1be3bef4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:51.339346 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a204e-b5e6-442e-9d64-103d1be3bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:51.339616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a204e-b5e6-442e-9d64-103d1be3bef4 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:51.340812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a204e-b5e6-442e-9d64-103d1be3bef4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:51.341158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a204e-b5e6-442e-9d64-103d1be3bef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:51.342526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a204e-b5e6-442e-9d64-103d1be3bef4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:51.347342 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 655/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Sep 21 16:12:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:51.353303 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ce245-3080-4ba7-b847-fafb718f395f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:51.451258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ce245-3080-4ba7-b847-fafb718f395f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:51.486232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438adf4-b372-4865-9a4f-a6233ccf5b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:51.486843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438adf4-b372-4865-9a4f-a6233ccf5b6b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:51.487129 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438adf4-b372-4865-9a4f-a6233ccf5b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:51.487401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438adf4-b372-4865-9a4f-a6233ccf5b6b None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:51.488025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438adf4-b372-4865-9a4f-a6233ccf5b6b None admin] RBAC: Adding query filter params (type=placement) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:51.488329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438adf4-b372-4865-9a4f-a6233ccf5b6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:51.489726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438adf4-b372-4865-9a4f-a6233ccf5b6b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:51.494053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 637/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Sep 21 16:12:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:53.617514 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468c0f1-35a8-46bd-b389-00f32145f371 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:53.618047 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468c0f1-35a8-46bd-b389-00f32145f371 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:53.618047 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468c0f1-35a8-46bd-b389-00f32145f371 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:53.619383 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 656/1293] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:12:53.624832 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca223a28-0d04-4d57-ab86-8b7df851b5bb None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:53.625386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca223a28-0d04-4d57-ab86-8b7df851b5bb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:53.625386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca223a28-0d04-4d57-ab86-8b7df851b5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:53.643858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ca223a28-0d04-4d57-ab86-8b7df851b5bb None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:12:53.645086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ca223a28-0d04-4d57-ab86-8b7df851b5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:12:53.681339 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:53.732844 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 638/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:12:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:12:54.008059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468c0f1-35a8-46bd-b389-00f32145f371 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:54.038678 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:54.108657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468c0f1-35a8-46bd-b389-00f32145f371 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:54.141248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86ccd2-4b6e-43c9-a78e-7bd1cf2877eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:54.141850 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86ccd2-4b6e-43c9-a78e-7bd1cf2877eb None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:54.142125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86ccd2-4b6e-43c9-a78e-7bd1cf2877eb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:54.142393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86ccd2-4b6e-43c9-a78e-7bd1cf2877eb None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:54.143030 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86ccd2-4b6e-43c9-a78e-7bd1cf2877eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:54.144380 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86ccd2-4b6e-43c9-a78e-7bd1cf2877eb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:54.158994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 657/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 21 16:12:54 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:12:56.346052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1b039-a865-47b2-aae7-31b6057229cc None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:56.346597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1b039-a865-47b2-aae7-31b6057229cc None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:56.346597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1b039-a865-47b2-aae7-31b6057229cc None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:56.347921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 639/1296] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:12:56.353122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6b492-2f6c-4bd7-9cb4-0fe6896ab784 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:56.353513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6b492-2f6c-4bd7-9cb4-0fe6896ab784 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:56.353674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6b492-2f6c-4bd7-9cb4-0fe6896ab784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:56.372877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-14f6b492-2f6c-4bd7-9cb4-0fe6896ab784 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:12:56.374073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-14f6b492-2f6c-4bd7-9cb4-0fe6896ab784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:12:56.454486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 658/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:12:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:12:56.725466 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1b039-a865-47b2-aae7-31b6057229cc None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:56.826689 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1b039-a865-47b2-aae7-31b6057229cc None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:56.872122 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8dd9-2d68-49d0-bbc6-fae52546d517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:56.872794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8dd9-2d68-49d0-bbc6-fae52546d517 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:56.873071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8dd9-2d68-49d0-bbc6-fae52546d517 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:56.873336 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8dd9-2d68-49d0-bbc6-fae52546d517 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:56.873928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be8dd9-2d68-49d0-bbc6-fae52546d517 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:56.875325 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be8dd9-2d68-49d0-bbc6-fae52546d517 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-04be8dd9-2d68-49d0-bbc6-fae52546d517 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:12:56.885132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:12:56.886393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:12:56.887319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 640/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 21 16:12:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:12:56.892638 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6b492-2f6c-4bd7-9cb4-0fe6896ab784 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:56.913017 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:56.998438 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6b492-2f6c-4bd7-9cb4-0fe6896ab784 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:57.033004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12f3d3-8c66-44fb-acfe-db26860482d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:57.033615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12f3d3-8c66-44fb-acfe-db26860482d7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:57.033892 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12f3d3-8c66-44fb-acfe-db26860482d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:57.034165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12f3d3-8c66-44fb-acfe-db26860482d7 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:57.034792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12f3d3-8c66-44fb-acfe-db26860482d7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:57.035095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12f3d3-8c66-44fb-acfe-db26860482d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:57.036459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12f3d3-8c66-44fb-acfe-db26860482d7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:57.041854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 659/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Sep 21 16:12:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:12:57.048236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8dd9-2d68-49d0-bbc6-fae52546d517 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:57.078811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:57.146978 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8dd9-2d68-49d0-bbc6-fae52546d517 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:57.180258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8e286-fa0f-4bb8-8fa6-bd25fa207643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:57.180882 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8e286-fa0f-4bb8-8fa6-bd25fa207643 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:57.181161 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8e286-fa0f-4bb8-8fa6-bd25fa207643 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:57.181430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8e286-fa0f-4bb8-8fa6-bd25fa207643 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:57.182121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8e286-fa0f-4bb8-8fa6-bd25fa207643 None admin] RBAC: Adding query filter params (interface=public, service_id=c007dc9828fd450da807f4212cb6b54a, region_id=RegionOne) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:12:57.182427 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8e286-fa0f-4bb8-8fa6-bd25fa207643 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:57.183822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8e286-fa0f-4bb8-8fa6-bd25fa207643 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:57.188738 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 641/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 21 16:12:57 2022] GET /identity/v3/endpoints?service_id=c007dc9828fd450da807f4212cb6b54a&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:12:57.194432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12f3d3-8c66-44fb-acfe-db26860482d7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:57.273436 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:57.291875 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12f3d3-8c66-44fb-acfe-db26860482d7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:12:57.325674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e66a8f-7b91-4b17-98d2-83c5ffb61c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:12:57.326279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66a8f-7b91-4b17-98d2-83c5ffb61c9a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:57.326560 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66a8f-7b91-4b17-98d2-83c5ffb61c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:57.326831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66a8f-7b91-4b17-98d2-83c5ffb61c9a None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:57.327433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e66a8f-7b91-4b17-98d2-83c5ffb61c9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:12:57.328822 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e66a8f-7b91-4b17-98d2-83c5ffb61c9a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:12:57.336411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 660/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 21 16:12:57 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:12:59.488477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e53669-39c0-4e99-a00a-5c35ddaa9362 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:59.489024 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e53669-39c0-4e99-a00a-5c35ddaa9362 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:59.489024 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e53669-39c0-4e99-a00a-5c35ddaa9362 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:59.490371 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 642/1302] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:12:59.495626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e36ab-1aff-4f2b-a6c5-43a7668d5278 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:12:59.496114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e36ab-1aff-4f2b-a6c5-43a7668d5278 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:12:59.496202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e36ab-1aff-4f2b-a6c5-43a7668d5278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:12:59.514850 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6d7e36ab-1aff-4f2b-a6c5-43a7668d5278 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:12:59.516058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6d7e36ab-1aff-4f2b-a6c5-43a7668d5278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:12:59.581608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 661/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:12:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 16:12:59.857115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e53669-39c0-4e99-a00a-5c35ddaa9362 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:12:59.957621 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:12:59.966172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e53669-39c0-4e99-a00a-5c35ddaa9362 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:13:00.001533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdcb70-38be-43e5-a7c3-9dd12649493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:13:00.002170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdcb70-38be-43e5-a7c3-9dd12649493c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:13:00.002441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdcb70-38be-43e5-a7c3-9dd12649493c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:13:00.002706 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdcb70-38be-43e5-a7c3-9dd12649493c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:13:00.003290 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdcb70-38be-43e5-a7c3-9dd12649493c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:13:00.004659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdcb70-38be-43e5-a7c3-9dd12649493c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-09bdcb70-38be-43e5-a7c3-9dd12649493c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 16:13:00.014451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 16:13:00.016363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 21 16:13:00.017645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 643/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 21 16:12:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 16:13:00.023347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e36ab-1aff-4f2b-a6c5-43a7668d5278 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:13:00.107437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:13:00.131486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e36ab-1aff-4f2b-a6c5-43a7668d5278 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:13:00.165122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebaedb-90f5-45f9-817b-c973bb7ea12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:13:00.165728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebaedb-90f5-45f9-817b-c973bb7ea12c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:13:00.166005 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebaedb-90f5-45f9-817b-c973bb7ea12c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:13:00.166273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebaedb-90f5-45f9-817b-c973bb7ea12c None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:13:00.166902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebaedb-90f5-45f9-817b-c973bb7ea12c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:13:00.167206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebaedb-90f5-45f9-817b-c973bb7ea12c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:13:00.169210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebaedb-90f5-45f9-817b-c973bb7ea12c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:13:00.174425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 662/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Sep 21 16:13:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:13:00.180252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdcb70-38be-43e5-a7c3-9dd12649493c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:13:00.281995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdcb70-38be-43e5-a7c3-9dd12649493c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:13:00.317551 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab110f4-5816-412e-bfdc-73d3adf79d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:13:00.318156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab110f4-5816-412e-bfdc-73d3adf79d2e None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:13:00.318435 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab110f4-5816-412e-bfdc-73d3adf79d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:13:00.318705 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab110f4-5816-412e-bfdc-73d3adf79d2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:13:00.319377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab110f4-5816-412e-bfdc-73d3adf79d2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:13:00.320769 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab110f4-5816-412e-bfdc-73d3adf79d2e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:13:00.341837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 644/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:13:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:13:10.171952 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=30 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:13:10.336628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:09.967839 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa88d-c690-4bc9-a1dd-86299d8d6987 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:09.968409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa88d-c690-4bc9-a1dd-86299d8d6987 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:09.968726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa88d-c690-4bc9-a1dd-86299d8d6987 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:09.971211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 663/1307] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:14:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:14:09.979902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc6d54-d047-4896-a38c-3c4d278e3280 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:09.980733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc6d54-d047-4896-a38c-3c4d278e3280 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:09.980733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc6d54-d047-4896-a38c-3c4d278e3280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:10.068524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-02cc6d54-d047-4896-a38c-3c4d278e3280 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:10.070425 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-02cc6d54-d047-4896-a38c-3c4d278e3280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:10.192931 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 645/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:14:10.511909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8334-9691-4542-9591-b64d293bd84e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:10.512469 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8334-9691-4542-9591-b64d293bd84e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:10.513174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8334-9691-4542-9591-b64d293bd84e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:10.515367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 664/1309] 10.222.0.16 () {54 vars in 963 bytes} [Wed Sep 21 16:14:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:14:10.524222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da375-2023-489a-a17f-816f2b92d672 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:10.524821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da375-2023-489a-a17f-816f2b92d672 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:10.525193 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da375-2023-489a-a17f-816f2b92d672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:10.659466 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-796da375-2023-489a-a17f-816f2b92d672 None None] MFA Rules not processed for user `0e765e2cc4c94243b00f919e8f8d01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:10.661525 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-796da375-2023-489a-a17f-816f2b92d672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:10.701188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:10.810005 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 646/1310] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Sep 21 16:14:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:14:10.824105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d8334-9691-4542-9591-b64d293bd84e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:14:10.833357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d72d8334-9691-4542-9591-b64d293bd84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:11.048835 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d8334-9691-4542-9591-b64d293bd84e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:14:11.228270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7725959-3fa7-43ab-ac63-7fbd2e5e06b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:14:11.229520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7725959-3fa7-43ab-ac63-7fbd2e5e06b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:11.230033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7725959-3fa7-43ab-ac63-7fbd2e5e06b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:11.230522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7725959-3fa7-43ab-ac63-7fbd2e5e06b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:11.233354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d7725959-3fa7-43ab-ac63-7fbd2e5e06b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:11.330986 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:11.449475 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7725959-3fa7-43ab-ac63-7fbd2e5e06b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:14:11.452592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7725959-3fa7-43ab-ac63-7fbd2e5e06b0 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:14:11.494300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 665/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:14:14.233110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324c8ca-4300-4596-9006-78afecb8d38b None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:14.233688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324c8ca-4300-4596-9006-78afecb8d38b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:14.233688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324c8ca-4300-4596-9006-78afecb8d38b None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:14.235109 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 647/1312] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:14:14.241358 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a242-c484-4cb5-a252-6341b5009ac7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:14.241955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a242-c484-4cb5-a252-6341b5009ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:14.241955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a242-c484-4cb5-a252-6341b5009ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:14.336361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d7b6a242-c484-4cb5-a252-6341b5009ac7 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:14.338344 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d7b6a242-c484-4cb5-a252-6341b5009ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:14.464139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 666/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:14:14.750801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324c8ca-4300-4596-9006-78afecb8d38b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:14:14.752323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8324c8ca-4300-4596-9006-78afecb8d38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:14.856445 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324c8ca-4300-4596-9006-78afecb8d38b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:14:14.927217 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:14.930432 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a168f7b-e06f-4d17-b908-367e3eae7e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:14:14.931261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a168f7b-e06f-4d17-b908-367e3eae7e35 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:14.931723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a168f7b-e06f-4d17-b908-367e3eae7e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:14.932173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a168f7b-e06f-4d17-b908-367e3eae7e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:14.933857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8a168f7b-e06f-4d17-b908-367e3eae7e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:15.045426 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a168f7b-e06f-4d17-b908-367e3eae7e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:14:15.046872 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a168f7b-e06f-4d17-b908-367e3eae7e35 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:14:15.067430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 648/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:14:17.545724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eb96a-648b-45e1-88a8-abd90afcd44c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:17.546280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eb96a-648b-45e1-88a8-abd90afcd44c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:17.546280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eb96a-648b-45e1-88a8-abd90afcd44c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:17.547608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 667/1315] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:14:17.553050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ac8bd-399b-46cb-9eed-dbffbbc8c03e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:17.553614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ac8bd-399b-46cb-9eed-dbffbbc8c03e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:17.553614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ac8bd-399b-46cb-9eed-dbffbbc8c03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:17.622505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-be2ac8bd-399b-46cb-9eed-dbffbbc8c03e None None] MFA Rules not processed for user `de5b926665fc4538a717ef556ffe0d72`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:17.623777 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-be2ac8bd-399b-46cb-9eed-dbffbbc8c03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:17.676013 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:17.721311 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 649/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:14:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:14:18.011126 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4eb96a-648b-45e1-88a8-abd90afcd44c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:14:18.012728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9b4eb96a-648b-45e1-88a8-abd90afcd44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:18.024783 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:18.125727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4eb96a-648b-45e1-88a8-abd90afcd44c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:14:18.204188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0895fc-c418-4771-b1ae-122053b56e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:14:18.204826 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0895fc-c418-4771-b1ae-122053b56e9b service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:18.205107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0895fc-c418-4771-b1ae-122053b56e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:18.205373 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0895fc-c418-4771-b1ae-122053b56e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:18.207013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5c0895fc-c418-4771-b1ae-122053b56e9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:18.280934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:18.336257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0895fc-c418-4771-b1ae-122053b56e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:14:18.337753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0895fc-c418-4771-b1ae-122053b56e9b service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:14:18.358451 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 668/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:14:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:14:21.107828 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640789c-c637-45f2-a75b-d36e071855ca None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:21.108350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640789c-c637-45f2-a75b-d36e071855ca None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:21.108350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640789c-c637-45f2-a75b-d36e071855ca None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:21.109658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 650/1318] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:14:21.115139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf4d87-5c22-4a03-8e6a-3ef18aef1282 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:21.115594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf4d87-5c22-4a03-8e6a-3ef18aef1282 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:21.115689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf4d87-5c22-4a03-8e6a-3ef18aef1282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:21.183621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-abbf4d87-5c22-4a03-8e6a-3ef18aef1282 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:21.184900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-abbf4d87-5c22-4a03-8e6a-3ef18aef1282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:21.284325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 669/1319] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:14:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:14:21.565799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640789c-c637-45f2-a75b-d36e071855ca None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:14:21.567373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0640789c-c637-45f2-a75b-d36e071855ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:21.672448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640789c-c637-45f2-a75b-d36e071855ca None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:14:21.748953 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1e913-9bda-435c-8e3a-42dbedd7ae24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:14:21.749473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1e913-9bda-435c-8e3a-42dbedd7ae24 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:21.749752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1e913-9bda-435c-8e3a-42dbedd7ae24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:21.750022 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1e913-9bda-435c-8e3a-42dbedd7ae24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:21.751656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ebd1e913-9bda-435c-8e3a-42dbedd7ae24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:21.759195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:21.872225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1e913-9bda-435c-8e3a-42dbedd7ae24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:14:21.873726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1e913-9bda-435c-8e3a-42dbedd7ae24 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:14:21.894018 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 651/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:14:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:14:24.919915 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9bdd5-69ec-45d1-bc41-6bbb557ef381 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:24.920462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9bdd5-69ec-45d1-bc41-6bbb557ef381 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:24.920462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9bdd5-69ec-45d1-bc41-6bbb557ef381 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:24.922034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 670/1321] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:14:24.927485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebf74d-82c0-44fc-8781-ed9b27f82b88 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:24.928282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebf74d-82c0-44fc-8781-ed9b27f82b88 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:24.928282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebf74d-82c0-44fc-8781-ed9b27f82b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:25.001039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-feebf74d-82c0-44fc-8781-ed9b27f82b88 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:25.002282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-feebf74d-82c0-44fc-8781-ed9b27f82b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:25.068974 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:25.121548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 652/1322] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:14:25.403828 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9bdd5-69ec-45d1-bc41-6bbb557ef381 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:14:25.405385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d9d9bdd5-69ec-45d1-bc41-6bbb557ef381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:25.428262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:25.535666 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9bdd5-69ec-45d1-bc41-6bbb557ef381 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:14:25.613307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029642f-662f-4647-83e4-2a1e77aad9bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:14:25.613910 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029642f-662f-4647-83e4-2a1e77aad9bb service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:25.614182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029642f-662f-4647-83e4-2a1e77aad9bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:25.614446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029642f-662f-4647-83e4-2a1e77aad9bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:25.616059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9029642f-662f-4647-83e4-2a1e77aad9bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:25.690028 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:25.728821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029642f-662f-4647-83e4-2a1e77aad9bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:14:25.730276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029642f-662f-4647-83e4-2a1e77aad9bb service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:14:25.749931 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 671/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:14:28.011523 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651408ab-0c8e-4b0b-ba76-c096daa9ec5a None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:28.012100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651408ab-0c8e-4b0b-ba76-c096daa9ec5a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:28.012100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651408ab-0c8e-4b0b-ba76-c096daa9ec5a None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:28.013472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 653/1324] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:14:28.019240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32944211-f4c7-4aff-8be2-86ec3f61ad4a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:28.019776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32944211-f4c7-4aff-8be2-86ec3f61ad4a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:28.019874 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32944211-f4c7-4aff-8be2-86ec3f61ad4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:28.100354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-32944211-f4c7-4aff-8be2-86ec3f61ad4a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:28.102138 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-32944211-f4c7-4aff-8be2-86ec3f61ad4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:28.217117 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 672/1325] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:14:28.503344 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651408ab-0c8e-4b0b-ba76-c096daa9ec5a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:14:28.505147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-651408ab-0c8e-4b0b-ba76-c096daa9ec5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:28.617118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651408ab-0c8e-4b0b-ba76-c096daa9ec5a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:14:28.693240 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae84f9-72ce-4543-a100-2b5d5a7804b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:14:28.693849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae84f9-72ce-4543-a100-2b5d5a7804b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:28.694130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae84f9-72ce-4543-a100-2b5d5a7804b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:28.694402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae84f9-72ce-4543-a100-2b5d5a7804b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:28.696540 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-49ae84f9-72ce-4543-a100-2b5d5a7804b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:28.715312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:28.832565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae84f9-72ce-4543-a100-2b5d5a7804b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:14:28.834507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae84f9-72ce-4543-a100-2b5d5a7804b9 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:14:28.856834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 654/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:14:31.136614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bab99-ece8-4e26-8a2e-02003fceff2c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:31.137223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bab99-ece8-4e26-8a2e-02003fceff2c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:31.137357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bab99-ece8-4e26-8a2e-02003fceff2c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:31.139719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 673/1327] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:14:31.146379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8225f-4951-430f-8e29-da0c330c4493 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:31.146978 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8225f-4951-430f-8e29-da0c330c4493 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:31.146978 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8225f-4951-430f-8e29-da0c330c4493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:31.224291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-83c8225f-4951-430f-8e29-da0c330c4493 None None] MFA Rules not processed for user `de5b926665fc4538a717ef556ffe0d72`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:31.225482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-83c8225f-4951-430f-8e29-da0c330c4493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:31.296406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:31.333072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 655/1328] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:14:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:14:31.619333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bab99-ece8-4e26-8a2e-02003fceff2c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:14:31.620936 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3b9bab99-ece8-4e26-8a2e-02003fceff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:31.658551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:31.771740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bab99-ece8-4e26-8a2e-02003fceff2c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:14:31.873147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3e44a-3298-4699-a94e-ba3f58d7ed71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:14:31.873749 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3e44a-3298-4699-a94e-ba3f58d7ed71 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:31.874021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3e44a-3298-4699-a94e-ba3f58d7ed71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:31.874282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3e44a-3298-4699-a94e-ba3f58d7ed71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:31.875882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b2d3e44a-3298-4699-a94e-ba3f58d7ed71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:31.977322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:32.014653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3e44a-3298-4699-a94e-ba3f58d7ed71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:14:32.016085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3e44a-3298-4699-a94e-ba3f58d7ed71 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:14:32.036540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 674/1329] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:14:31 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:14:34.462921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517447c5-ce3a-4bb0-8ecf-fe833f3040d9 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:34.463441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517447c5-ce3a-4bb0-8ecf-fe833f3040d9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:34.463441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517447c5-ce3a-4bb0-8ecf-fe833f3040d9 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:34.464820 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 656/1330] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:14:34.470503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175a777-4048-4d38-b232-a549cf7ce042 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:34.470974 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175a777-4048-4d38-b232-a549cf7ce042 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:34.471077 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175a777-4048-4d38-b232-a549cf7ce042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:34.543526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3175a777-4048-4d38-b232-a549cf7ce042 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:34.544772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3175a777-4048-4d38-b232-a549cf7ce042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:34.645421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 675/1331] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:14:34.942087 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517447c5-ce3a-4bb0-8ecf-fe833f3040d9 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:14:34.943636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-517447c5-ce3a-4bb0-8ecf-fe833f3040d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:35.047725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517447c5-ce3a-4bb0-8ecf-fe833f3040d9 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:14:35.128121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c7ecf-09b5-4661-915e-1106060d3228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:14:35.128753 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7ecf-09b5-4661-915e-1106060d3228 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:35.129035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7ecf-09b5-4661-915e-1106060d3228 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:35.129303 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7ecf-09b5-4661-915e-1106060d3228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:35.130921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-934c7ecf-09b5-4661-915e-1106060d3228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:35.158358 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:35.243829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c7ecf-09b5-4661-915e-1106060d3228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:14:35.245295 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c7ecf-09b5-4661-915e-1106060d3228 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:14:35.262926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 657/1332] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:14:37.485582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d5055-fa2e-4386-aed1-d31a12b5ea50 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:37.486282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d5055-fa2e-4386-aed1-d31a12b5ea50 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:37.486282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d5055-fa2e-4386-aed1-d31a12b5ea50 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:37.487554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 676/1333] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:14:37.493646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558393c-b0ed-4672-83ae-25e4405c716a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:37.494110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558393c-b0ed-4672-83ae-25e4405c716a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:37.494211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558393c-b0ed-4672-83ae-25e4405c716a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:37.563982 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5558393c-b0ed-4672-83ae-25e4405c716a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:37.565239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5558393c-b0ed-4672-83ae-25e4405c716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:37.643332 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:37.666278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 658/1334] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:14:37.958444 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d5055-fa2e-4386-aed1-d31a12b5ea50 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:14:37.960024 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-104d5055-fa2e-4386-aed1-d31a12b5ea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:38.006968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:38.086178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d5055-fa2e-4386-aed1-d31a12b5ea50 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:14:38.175806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1b5eb-9dc9-4588-aed5-279fa95c4787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:14:38.176412 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1b5eb-9dc9-4588-aed5-279fa95c4787 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:38.176708 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1b5eb-9dc9-4588-aed5-279fa95c4787 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:38.176978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1b5eb-9dc9-4588-aed5-279fa95c4787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:38.178576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bff1b5eb-9dc9-4588-aed5-279fa95c4787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:38.262482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:38.289133 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1b5eb-9dc9-4588-aed5-279fa95c4787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:14:38.290568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1b5eb-9dc9-4588-aed5-279fa95c4787 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:14:38.308528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 677/1335] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:14:40.797131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cc386-ee9e-4da8-8115-8a24c7aeb97f None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:40.797649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cc386-ee9e-4da8-8115-8a24c7aeb97f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:40.798039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cc386-ee9e-4da8-8115-8a24c7aeb97f None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:40.800440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 659/1336] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:14:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:14:40.805960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e948ae-cf89-41a7-a4d3-45ae3db321b5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:40.806422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e948ae-cf89-41a7-a4d3-45ae3db321b5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:40.806516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e948ae-cf89-41a7-a4d3-45ae3db321b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:40.875834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b3e948ae-cf89-41a7-a4d3-45ae3db321b5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:40.877084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b3e948ae-cf89-41a7-a4d3-45ae3db321b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:40.976907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 678/1337] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:14:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:14:41.260960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cc386-ee9e-4da8-8115-8a24c7aeb97f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:14:41.262511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-821cc386-ee9e-4da8-8115-8a24c7aeb97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:41.367699 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cc386-ee9e-4da8-8115-8a24c7aeb97f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:14:41.441614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf063b9e-c2ed-4b1f-bce4-1f2abdf5967c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:14:41.442215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf063b9e-c2ed-4b1f-bce4-1f2abdf5967c service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:41.442497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf063b9e-c2ed-4b1f-bce4-1f2abdf5967c service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:41.442766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf063b9e-c2ed-4b1f-bce4-1f2abdf5967c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:41.444384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cf063b9e-c2ed-4b1f-bce4-1f2abdf5967c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:41.484078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:41.562726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf063b9e-c2ed-4b1f-bce4-1f2abdf5967c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:14:41.564147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf063b9e-c2ed-4b1f-bce4-1f2abdf5967c service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:14:41.582104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 660/1338] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:14:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:14:45.988515 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83cfc5-c2b0-47b2-855c-fac8fb51d101 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:45.989115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83cfc5-c2b0-47b2-855c-fac8fb51d101 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:45.989115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83cfc5-c2b0-47b2-855c-fac8fb51d101 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:45.990427 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 679/1339] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:14:45.996628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759e093-3c53-454e-9d76-45bab9996584 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:45.997175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759e093-3c53-454e-9d76-45bab9996584 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:45.997265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759e093-3c53-454e-9d76-45bab9996584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:46.084578 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1759e093-3c53-454e-9d76-45bab9996584 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:46.086337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1759e093-3c53-454e-9d76-45bab9996584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:46.186469 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:46.199314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 661/1340] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:14:46.492534 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83cfc5-c2b0-47b2-855c-fac8fb51d101 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:14:46.494145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8c83cfc5-c2b0-47b2-855c-fac8fb51d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:46.548492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:46.612076 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83cfc5-c2b0-47b2-855c-fac8fb51d101 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:14:46.698634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad04734-9c88-4b00-969d-dc3e475841d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:14:46.699247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad04734-9c88-4b00-969d-dc3e475841d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:46.699524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad04734-9c88-4b00-969d-dc3e475841d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:46.699791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad04734-9c88-4b00-969d-dc3e475841d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:46.701453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8ad04734-9c88-4b00-969d-dc3e475841d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:46.802504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:46.821822 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad04734-9c88-4b00-969d-dc3e475841d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:14:46.823568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad04734-9c88-4b00-969d-dc3e475841d2 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:14:46.843680 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 680/1341] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:14:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:14:49.770347 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f116d1a-0c0c-4f1d-99f9-2fc3b416d50a None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:49.770933 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f116d1a-0c0c-4f1d-99f9-2fc3b416d50a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:49.770933 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f116d1a-0c0c-4f1d-99f9-2fc3b416d50a None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:49.773025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 662/1342] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:14:49.777968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac04a1-abd0-4819-8e74-8e9c521e35d8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:49.778511 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac04a1-abd0-4819-8e74-8e9c521e35d8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:49.778511 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac04a1-abd0-4819-8e74-8e9c521e35d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:49.851752 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bcac04a1-abd0-4819-8e74-8e9c521e35d8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:49.852993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bcac04a1-abd0-4819-8e74-8e9c521e35d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:49.969266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 681/1343] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:14:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:14:50.261900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f116d1a-0c0c-4f1d-99f9-2fc3b416d50a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:14:50.263448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0f116d1a-0c0c-4f1d-99f9-2fc3b416d50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:50.425500 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f116d1a-0c0c-4f1d-99f9-2fc3b416d50a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:14:50.515956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cb908-3057-41ed-8cab-d3952dcddb94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:14:50.516489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cb908-3057-41ed-8cab-d3952dcddb94 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:50.516829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cb908-3057-41ed-8cab-d3952dcddb94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:50.517104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cb908-3057-41ed-8cab-d3952dcddb94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:50.518823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8f6cb908-3057-41ed-8cab-d3952dcddb94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:50.571361 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:50.642528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cb908-3057-41ed-8cab-d3952dcddb94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:14:50.643983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cb908-3057-41ed-8cab-d3952dcddb94 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:14:50.664126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 663/1344] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:14:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:14:55.095302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20cc7e-abb1-4d7d-84d4-992a77935639 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:55.095928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20cc7e-abb1-4d7d-84d4-992a77935639 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:55.095928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20cc7e-abb1-4d7d-84d4-992a77935639 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:55.097273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 682/1345] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:14:55.103592 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846af67-0b64-4c8c-8813-b5961686a792 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:55.104784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846af67-0b64-4c8c-8813-b5961686a792 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:55.104784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846af67-0b64-4c8c-8813-b5961686a792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:55.187377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-f846af67-0b64-4c8c-8813-b5961686a792 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:55.188616 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f846af67-0b64-4c8c-8813-b5961686a792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:55.294828 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:55.297347 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 664/1346] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:14:55.600425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c7367-7afb-4398-8bd6-576b0ab2041e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:55.602287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c7367-7afb-4398-8bd6-576b0ab2041e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:55.602287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c7367-7afb-4398-8bd6-576b0ab2041e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:55.605305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 683/1347] 10.222.0.16 () {54 vars in 963 bytes} [Wed Sep 21 16:14:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:14:55.609734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe54ed5-de52-48e5-a837-2bcc78c4a754 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:55.610034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe54ed5-de52-48e5-a837-2bcc78c4a754 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:55.610309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe54ed5-de52-48e5-a837-2bcc78c4a754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:55.694277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-efe54ed5-de52-48e5-a837-2bcc78c4a754 None None] MFA Rules not processed for user `0e765e2cc4c94243b00f919e8f8d01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:14:55.695718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-efe54ed5-de52-48e5-a837-2bcc78c4a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:55.778219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 665/1348] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Sep 21 16:14:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:14:55.787422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c7367-7afb-4398-8bd6-576b0ab2041e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:14:55.789608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b00c7367-7afb-4398-8bd6-576b0ab2041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:55.849372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:55.897277 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c7367-7afb-4398-8bd6-576b0ab2041e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:14:55.974614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739e887-9684-404f-af85-e06d97e11e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:14:55.975124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739e887-9684-404f-af85-e06d97e11e16 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:14:55.975407 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739e887-9684-404f-af85-e06d97e11e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:14:55.975677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739e887-9684-404f-af85-e06d97e11e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:14:55.977313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f739e887-9684-404f-af85-e06d97e11e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:14:56.087619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:14:56.091128 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739e887-9684-404f-af85-e06d97e11e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:14:56.094111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739e887-9684-404f-af85-e06d97e11e16 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:14:56.112668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 684/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:15:02.098849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e795cd-dd78-4164-8955-b3a70306900d None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:02.099376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e795cd-dd78-4164-8955-b3a70306900d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:02.099644 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e795cd-dd78-4164-8955-b3a70306900d None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:02.101670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 666/1350] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 21 16:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:02.106731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa553-dec1-4f63-b712-e4dd5e07708e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:02.107234 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa553-dec1-4f63-b712-e4dd5e07708e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:02.107327 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa553-dec1-4f63-b712-e4dd5e07708e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:02.229233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4effa553-dec1-4f63-b712-e4dd5e07708e None None] MFA Rules not processed for user `7cd3076ca5a84ff7ada13065f9531f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:02.231101 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4effa553-dec1-4f63-b712-e4dd5e07708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:02.412962 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 685/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 21 16:15:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:05.776726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=59 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:07.084675 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461bce-0486-4f05-8800-76228ab5d805 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:07.085326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461bce-0486-4f05-8800-76228ab5d805 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:07.085326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461bce-0486-4f05-8800-76228ab5d805 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:07.087459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 667/1352] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 21 16:15:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:07.093080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dad3d-1a96-4a8d-934e-80a99106826d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:07.093899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dad3d-1a96-4a8d-934e-80a99106826d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:07.093899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dad3d-1a96-4a8d-934e-80a99106826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:07.154381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:07.182253 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-650dad3d-1a96-4a8d-934e-80a99106826d None None] MFA Rules not processed for user `7cd3076ca5a84ff7ada13065f9531f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:07.183463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-650dad3d-1a96-4a8d-934e-80a99106826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:07.306226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 686/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 21 16:15:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:15:08.726057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a692a-460d-44ba-986f-838bc348174f None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:08.726710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a692a-460d-44ba-986f-838bc348174f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:08.726710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a692a-460d-44ba-986f-838bc348174f None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:08.728012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 668/1354] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 21 16:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:08.734091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a219-5ac8-43fc-b6ee-665b45b6f798 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:08.734792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a219-5ac8-43fc-b6ee-665b45b6f798 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:08.734792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a219-5ac8-43fc-b6ee-665b45b6f798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:08.821173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6155a219-5ac8-43fc-b6ee-665b45b6f798 None None] MFA Rules not processed for user `7cd3076ca5a84ff7ada13065f9531f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:08.822398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6155a219-5ac8-43fc-b6ee-665b45b6f798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:08.868034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:08.942753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 687/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 21 16:15:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:13.431280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaa7c5-eb1b-4ecd-bc43-a7fc7148467f None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:13.431856 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaa7c5-eb1b-4ecd-bc43-a7fc7148467f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:13.431856 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaa7c5-eb1b-4ecd-bc43-a7fc7148467f None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:13.433174 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 669/1356] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:13.438851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52bcaf-1ba9-4e9a-9024-28d918cc8010 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:13.439305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52bcaf-1ba9-4e9a-9024-28d918cc8010 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:13.439420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52bcaf-1ba9-4e9a-9024-28d918cc8010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:13.529906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fd52bcaf-1ba9-4e9a-9024-28d918cc8010 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:13.531180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fd52bcaf-1ba9-4e9a-9024-28d918cc8010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:13.700265 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 688/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:15:14.183138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e1a83-ec42-43db-8146-5ed616e32271 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:14.183961 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e1a83-ec42-43db-8146-5ed616e32271 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:14.184678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e1a83-ec42-43db-8146-5ed616e32271 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:14.187480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 670/1358] 10.222.0.16 () {54 vars in 965 bytes} [Wed Sep 21 16:15:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:15:14.201022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cf96a-d058-4bd4-a52a-27b33c92eb14 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:14.202629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cf96a-d058-4bd4-a52a-27b33c92eb14 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:14.203427 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cf96a-d058-4bd4-a52a-27b33c92eb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:14.236862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:14.358902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b35cf96a-d058-4bd4-a52a-27b33c92eb14 None None] MFA Rules not processed for user `d7ff08c990dc41b4811f97fecb7c4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:14.361563 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b35cf96a-d058-4bd4-a52a-27b33c92eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:14.597723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 689/1359] 10.222.0.16 () {58 vars in 1062 bytes} [Wed Sep 21 16:15:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:14.607843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e1a83-ec42-43db-8146-5ed616e32271 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:14.609488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-999e1a83-ec42-43db-8146-5ed616e32271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:14.842870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e1a83-ec42-43db-8146-5ed616e32271 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:14.974105 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:15.043372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da23036-8e83-4ab4-a863-298b13574220 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:15.044113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da23036-8e83-4ab4-a863-298b13574220 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:15.044404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da23036-8e83-4ab4-a863-298b13574220 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:15.045127 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da23036-8e83-4ab4-a863-298b13574220 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:15.046990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9da23036-8e83-4ab4-a863-298b13574220 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:15.183814 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da23036-8e83-4ab4-a863-298b13574220 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:15.186093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da23036-8e83-4ab4-a863-298b13574220 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:15.212544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 671/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:15:17.952734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d457c-acee-426e-b599-209585f80175 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:17.954066 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d457c-acee-426e-b599-209585f80175 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:17.954066 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d457c-acee-426e-b599-209585f80175 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:17.961393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 690/1361] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:15:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:15:17.962917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060337a5-7977-4a9d-a902-c7d2b2d10cb9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:17.963419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060337a5-7977-4a9d-a902-c7d2b2d10cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:17.963419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060337a5-7977-4a9d-a902-c7d2b2d10cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:18.065622 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-060337a5-7977-4a9d-a902-c7d2b2d10cb9 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:18.068221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-060337a5-7977-4a9d-a902-c7d2b2d10cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:18.122383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:18.196664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 672/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:15:18.534343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d457c-acee-426e-b599-209585f80175 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:18.535951 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0f8d457c-acee-426e-b599-209585f80175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:18.639527 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:18.780734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d457c-acee-426e-b599-209585f80175 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:18.937097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97daa4-3f54-4bc0-b852-62a422f08e78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:18.937719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97daa4-3f54-4bc0-b852-62a422f08e78 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:18.937994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97daa4-3f54-4bc0-b852-62a422f08e78 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:18.938262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97daa4-3f54-4bc0-b852-62a422f08e78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:18.940002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ed97daa4-3f54-4bc0-b852-62a422f08e78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:18.970197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:19.078429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97daa4-3f54-4bc0-b852-62a422f08e78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:19.080051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97daa4-3f54-4bc0-b852-62a422f08e78 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:19.102493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 691/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:15:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:15:21.657969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2aacd-d562-476c-995b-eaadf07791d5 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:21.658561 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2aacd-d562-476c-995b-eaadf07791d5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:21.658561 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2aacd-d562-476c-995b-eaadf07791d5 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:21.660059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 673/1364] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:21.665679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffb074-2f4e-4f14-8545-38842d837f2a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:21.666191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffb074-2f4e-4f14-8545-38842d837f2a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:21.666806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffb074-2f4e-4f14-8545-38842d837f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:21.740747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-74ffb074-2f4e-4f14-8545-38842d837f2a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:21.742055 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-74ffb074-2f4e-4f14-8545-38842d837f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:21.851342 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:21.860741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 692/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:22.153349 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c2b2d-3564-4be5-bc66-bd734e1a35a8 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:22.153710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c2b2d-3564-4be5-bc66-bd734e1a35a8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:22.153936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c2b2d-3564-4be5-bc66-bd734e1a35a8 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:22.155370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 674/1366] 10.222.0.16 () {54 vars in 965 bytes} [Wed Sep 21 16:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:22.161095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6fc1b-0718-47b0-8408-c5765516504c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:22.161370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6fc1b-0718-47b0-8408-c5765516504c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:22.161740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6fc1b-0718-47b0-8408-c5765516504c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:22.250215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e1e6fc1b-0718-47b0-8408-c5765516504c None None] MFA Rules not processed for user `d7ff08c990dc41b4811f97fecb7c4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:22.251606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e1e6fc1b-0718-47b0-8408-c5765516504c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:22.438954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 693/1367] 10.222.0.16 () {58 vars in 1062 bytes} [Wed Sep 21 16:15:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:22.464494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c2b2d-3564-4be5-bc66-bd734e1a35a8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:22.467339 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-760c2b2d-3564-4be5-bc66-bd734e1a35a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:22.739922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c2b2d-3564-4be5-bc66-bd734e1a35a8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:22.782120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:22.943524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a33de5-6c43-4153-9af0-24dcaf0163ea None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:22.944398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a33de5-6c43-4153-9af0-24dcaf0163ea None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:22.944398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a33de5-6c43-4153-9af0-24dcaf0163ea None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:22.950376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 694/1368] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:15:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:15:22.951710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4869be-d632-4b94-9f53-3bab0e63d6e9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:22.951994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4869be-d632-4b94-9f53-3bab0e63d6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:22.952271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4869be-d632-4b94-9f53-3bab0e63d6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:22.984759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d710e4-0b25-4139-9eca-235b85d2e8f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:22.985890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d710e4-0b25-4139-9eca-235b85d2e8f3 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:22.986387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d710e4-0b25-4139-9eca-235b85d2e8f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:22.986896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d710e4-0b25-4139-9eca-235b85d2e8f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:22.989466 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-01d710e4-0b25-4139-9eca-235b85d2e8f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:23.031514 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:23.042748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6c4869be-d632-4b94-9f53-3bab0e63d6e9 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:23.044266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6c4869be-d632-4b94-9f53-3bab0e63d6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:23.145847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d710e4-0b25-4139-9eca-235b85d2e8f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:23.148452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d710e4-0b25-4139-9eca-235b85d2e8f3 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:23.178156 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 695/1369] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:23.180805 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 675/1370] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:15:23.493517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ebac-6650-46f8-8fea-c41cba70a49c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:23.494168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ebac-6650-46f8-8fea-c41cba70a49c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:23.494645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ebac-6650-46f8-8fea-c41cba70a49c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:23.496719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 696/1371] 10.222.0.16 () {54 vars in 963 bytes} [Wed Sep 21 16:15:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:23.502414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff257e54-a653-4ad7-a796-b950a16f82e8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:23.503051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff257e54-a653-4ad7-a796-b950a16f82e8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:23.503557 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff257e54-a653-4ad7-a796-b950a16f82e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:23.542296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:23.608266 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ff257e54-a653-4ad7-a796-b950a16f82e8 None None] MFA Rules not processed for user `aa61549530e648a0b774a784b0450162`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:23.610343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ff257e54-a653-4ad7-a796-b950a16f82e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:23.726738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ebac-6650-46f8-8fea-c41cba70a49c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:23.729187 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-16d3ebac-6650-46f8-8fea-c41cba70a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:23.740101 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 676/1372] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Sep 21 16:15:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:23.953953 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ebac-6650-46f8-8fea-c41cba70a49c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:24.010219 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:24.110673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f36e6d-779d-426c-9b0c-b1ccc242b215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:24.111704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f36e6d-779d-426c-9b0c-b1ccc242b215 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:24.112215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f36e6d-779d-426c-9b0c-b1ccc242b215 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:24.112738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f36e6d-779d-426c-9b0c-b1ccc242b215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:24.115936 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-86f36e6d-779d-426c-9b0c-b1ccc242b215 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:24.357054 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f36e6d-779d-426c-9b0c-b1ccc242b215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:24.361011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f36e6d-779d-426c-9b0c-b1ccc242b215 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:24.399516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 697/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:15:25.856712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b001-e787-4ee4-b35a-0366ff51f606 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:25.857274 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b001-e787-4ee4-b35a-0366ff51f606 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:25.857274 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b001-e787-4ee4-b35a-0366ff51f606 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:25.858631 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 677/1374] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:25.864561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b37458-7abe-4a46-b8bd-0c61518a86e9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:25.869349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b37458-7abe-4a46-b8bd-0c61518a86e9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:25.869349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b37458-7abe-4a46-b8bd-0c61518a86e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:25.940941 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-03b37458-7abe-4a46-b8bd-0c61518a86e9 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:25.942161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-03b37458-7abe-4a46-b8bd-0c61518a86e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:25.949957 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:26.071059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 698/1375] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:15:26.368404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9b001-e787-4ee4-b35a-0366ff51f606 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:26.370015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c0f9b001-e787-4ee4-b35a-0366ff51f606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:26.538905 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:26.599239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9b001-e787-4ee4-b35a-0366ff51f606 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:26.767804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c224556-f3f3-49f5-b2d8-e66b77d3b52e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:26.768429 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c224556-f3f3-49f5-b2d8-e66b77d3b52e service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:26.768770 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c224556-f3f3-49f5-b2d8-e66b77d3b52e service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:26.769051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c224556-f3f3-49f5-b2d8-e66b77d3b52e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:26.770712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6c224556-f3f3-49f5-b2d8-e66b77d3b52e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:26.873097 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:26.886197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c224556-f3f3-49f5-b2d8-e66b77d3b52e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:26.887832 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c224556-f3f3-49f5-b2d8-e66b77d3b52e service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:26.909424 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 678/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:15:29.314224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0a27b-3285-455f-9b4f-2d96ce1db152 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:29.314833 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0a27b-3285-455f-9b4f-2d96ce1db152 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:29.314833 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0a27b-3285-455f-9b4f-2d96ce1db152 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:29.316364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 699/1377] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:29.323563 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec54065-3912-410f-b9c1-0c5e38cf194f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:29.324376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec54065-3912-410f-b9c1-0c5e38cf194f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:29.324376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec54065-3912-410f-b9c1-0c5e38cf194f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:29.399896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1ec54065-3912-410f-b9c1-0c5e38cf194f None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:29.401307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1ec54065-3912-410f-b9c1-0c5e38cf194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:29.544944 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 679/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:15:29.872380 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0a27b-3285-455f-9b4f-2d96ce1db152 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:29.873921 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fba0a27b-3285-455f-9b4f-2d96ce1db152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:30.091932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:30.114189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0a27b-3285-455f-9b4f-2d96ce1db152 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:30.325924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5c3db-c3cf-454d-a0b0-4f705ae7a115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:30.326996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5c3db-c3cf-454d-a0b0-4f705ae7a115 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:30.327434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5c3db-c3cf-454d-a0b0-4f705ae7a115 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:30.327856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5c3db-c3cf-454d-a0b0-4f705ae7a115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:30.330663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5fc5c3db-c3cf-454d-a0b0-4f705ae7a115 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:30.502255 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5c3db-c3cf-454d-a0b0-4f705ae7a115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:30.503913 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5c3db-c3cf-454d-a0b0-4f705ae7a115 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:30.521671 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:30.534157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 700/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:15:32.929208 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa4131-cdbc-4366-adf0-56958d0a5b52 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:32.931485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa4131-cdbc-4366-adf0-56958d0a5b52 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:32.933342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa4131-cdbc-4366-adf0-56958d0a5b52 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:32.936045 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 680/1380] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:15:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:32.943970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2534788-ae53-4798-9def-a76ee6aad969 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:32.943970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2534788-ae53-4798-9def-a76ee6aad969 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:32.946071 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2534788-ae53-4798-9def-a76ee6aad969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:33.065041 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e2534788-ae53-4798-9def-a76ee6aad969 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:33.069116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e2534788-ae53-4798-9def-a76ee6aad969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:33.195866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 701/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:33.497698 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa4131-cdbc-4366-adf0-56958d0a5b52 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:33.499485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-47aa4131-cdbc-4366-adf0-56958d0a5b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:33.573631 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:33.705747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa4131-cdbc-4366-adf0-56958d0a5b52 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:33.872365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fc72a-92b3-489d-977b-1de078264b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:33.873131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fc72a-92b3-489d-977b-1de078264b00 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:33.873553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fc72a-92b3-489d-977b-1de078264b00 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:33.873924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fc72a-92b3-489d-977b-1de078264b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:33.875724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e93fc72a-92b3-489d-977b-1de078264b00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:33.896847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:33.992302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fc72a-92b3-489d-977b-1de078264b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:33.994014 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fc72a-92b3-489d-977b-1de078264b00 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:34.024819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 681/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:15:36.321178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb78bd8-acdd-43f6-ad7a-3d126c91e7b2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:36.321780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb78bd8-acdd-43f6-ad7a-3d126c91e7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:36.321780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb78bd8-acdd-43f6-ad7a-3d126c91e7b2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:36.323160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 702/1383] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:36.329091 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d111c2a-c12d-4c1d-8b46-0ac890ac1a83 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:36.329732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d111c2a-c12d-4c1d-8b46-0ac890ac1a83 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:36.329732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d111c2a-c12d-4c1d-8b46-0ac890ac1a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:36.405029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9d111c2a-c12d-4c1d-8b46-0ac890ac1a83 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:36.406260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9d111c2a-c12d-4c1d-8b46-0ac890ac1a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:36.524573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:36.531331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 682/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:36.830181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb78bd8-acdd-43f6-ad7a-3d126c91e7b2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:36.832808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-efb78bd8-acdd-43f6-ad7a-3d126c91e7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:36.947485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:37.029708 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb78bd8-acdd-43f6-ad7a-3d126c91e7b2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:37.202017 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da7cf6-2724-471a-af4f-31e05ac4bcfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:37.202830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da7cf6-2724-471a-af4f-31e05ac4bcfa service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:37.203177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da7cf6-2724-471a-af4f-31e05ac4bcfa service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:37.203498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da7cf6-2724-471a-af4f-31e05ac4bcfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:37.205474 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-85da7cf6-2724-471a-af4f-31e05ac4bcfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:37.266399 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:37.340124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da7cf6-2724-471a-af4f-31e05ac4bcfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:37.341770 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da7cf6-2724-471a-af4f-31e05ac4bcfa service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:37.365276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 703/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:15:39.595712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41d291-7f95-4b31-a87a-b845703144bf None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:39.596293 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41d291-7f95-4b31-a87a-b845703144bf None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:39.596293 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41d291-7f95-4b31-a87a-b845703144bf None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:39.597620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 683/1386] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:39.605142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bdc61-a8ff-4017-92c7-535029419b49 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:39.605784 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bdc61-a8ff-4017-92c7-535029419b49 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:39.605784 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bdc61-a8ff-4017-92c7-535029419b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:39.698493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-839bdc61-a8ff-4017-92c7-535029419b49 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:39.699971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-839bdc61-a8ff-4017-92c7-535029419b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:39.834274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 704/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:40.128106 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41d291-7f95-4b31-a87a-b845703144bf None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:40.129502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0f41d291-7f95-4b31-a87a-b845703144bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:40.304250 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41d291-7f95-4b31-a87a-b845703144bf None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:40.393343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:40.454725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad441716-dbfb-4e2f-bb10-d1296b733875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:40.455343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad441716-dbfb-4e2f-bb10-d1296b733875 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:40.455618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad441716-dbfb-4e2f-bb10-d1296b733875 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:40.455879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad441716-dbfb-4e2f-bb10-d1296b733875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:40.457927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ad441716-dbfb-4e2f-bb10-d1296b733875 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:40.593483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad441716-dbfb-4e2f-bb10-d1296b733875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:40.596488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad441716-dbfb-4e2f-bb10-d1296b733875 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:40.630924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 684/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:15:42.911405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc9849-2c77-474b-a9dd-79d0c6bb831e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:42.912249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc9849-2c77-474b-a9dd-79d0c6bb831e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:42.912249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc9849-2c77-474b-a9dd-79d0c6bb831e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:42.914159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 705/1389] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:42.920261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc05008-8b02-4447-a35a-460aa7bb24b4 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:42.920861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc05008-8b02-4447-a35a-460aa7bb24b4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:42.920979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc05008-8b02-4447-a35a-460aa7bb24b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:43.013189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-4bc05008-8b02-4447-a35a-460aa7bb24b4 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:43.014780 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4bc05008-8b02-4447-a35a-460aa7bb24b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:43.056142 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:43.141338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 685/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:43.431288 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc9849-2c77-474b-a9dd-79d0c6bb831e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:43.432862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fedc9849-2c77-474b-a9dd-79d0c6bb831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:43.456921 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:43.597298 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc9849-2c77-474b-a9dd-79d0c6bb831e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:43.695037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:43.723542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542d6ac-076d-4cda-9fe7-6568801a0145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:43.724152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542d6ac-076d-4cda-9fe7-6568801a0145 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:43.724422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542d6ac-076d-4cda-9fe7-6568801a0145 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:43.724707 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542d6ac-076d-4cda-9fe7-6568801a0145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:43.726838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a542d6ac-076d-4cda-9fe7-6568801a0145 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:43.826268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542d6ac-076d-4cda-9fe7-6568801a0145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:43.827889 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542d6ac-076d-4cda-9fe7-6568801a0145 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:43.854827 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 706/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:15:45.407942 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46aeb2-3fa3-4862-9f65-3002c30e2c38 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:45.408818 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46aeb2-3fa3-4862-9f65-3002c30e2c38 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:45.409007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46aeb2-3fa3-4862-9f65-3002c30e2c38 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:45.410574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 686/1392] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:45.417421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5373fe-99b1-4a65-83e2-1440c9afe758 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:45.417923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5373fe-99b1-4a65-83e2-1440c9afe758 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:45.418077 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5373fe-99b1-4a65-83e2-1440c9afe758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:45.494902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1f5373fe-99b1-4a65-83e2-1440c9afe758 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:45.496137 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1f5373fe-99b1-4a65-83e2-1440c9afe758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:45.566505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:45.618574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 707/1393] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:45.937145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ae1df-ef66-47e3-9c43-f437f24c997d None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:45.937434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ae1df-ef66-47e3-9c43-f437f24c997d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:45.937753 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ae1df-ef66-47e3-9c43-f437f24c997d None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:45.939092 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 687/1394] 10.222.0.16 () {54 vars in 962 bytes} [Wed Sep 21 16:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:45.945894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43a6ed-835c-4527-a872-61afb84b1ce0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:45.946383 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43a6ed-835c-4527-a872-61afb84b1ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:45.946847 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43a6ed-835c-4527-a872-61afb84b1ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:46.051359 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5c43a6ed-835c-4527-a872-61afb84b1ce0 None None] MFA Rules not processed for user `2974669e9d1a417892b1d59dbc9e87ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:46.052607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5c43a6ed-835c-4527-a872-61afb84b1ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:46.142495 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3646577-ad7a-4404-b732-91b98ba62b4a None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:46.142767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3646577-ad7a-4404-b732-91b98ba62b4a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:46.143026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3646577-ad7a-4404-b732-91b98ba62b4a None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:46.144358 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 688/1395] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:15:46.150450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5097-fb17-4dcf-9cfb-49ad39aa5a3f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:46.150639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5097-fb17-4dcf-9cfb-49ad39aa5a3f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:46.150907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5097-fb17-4dcf-9cfb-49ad39aa5a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:46.155733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 708/1396] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Sep 21 16:15:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:46.166321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43a6ed-835c-4527-a872-61afb84b1ce0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:46.174698 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43a6ed-835c-4527-a872-61afb84b1ce0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:46.223555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:46.245404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-05cd5097-fb17-4dcf-9cfb-49ad39aa5a3f None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:46.247335 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-05cd5097-fb17-4dcf-9cfb-49ad39aa5a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:46.273292 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23252386-9a12-4009-996b-2106bd3573b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2974669e9d1a417892b1d59dbc9e87ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:46.274596 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23252386-9a12-4009-996b-2106bd3573b8 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:46.275057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23252386-9a12-4009-996b-2106bd3573b8 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:46.275502 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23252386-9a12-4009-996b-2106bd3573b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:46.278251 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-23252386-9a12-4009-996b-2106bd3573b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:46.381201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 689/1397] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:15:46.451786 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23252386-9a12-4009-996b-2106bd3573b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:46.454506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23252386-9a12-4009-996b-2106bd3573b8 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:46.490612 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 709/1398] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:15:46.689050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd5097-fb17-4dcf-9cfb-49ad39aa5a3f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:46.690419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-05cd5097-fb17-4dcf-9cfb-49ad39aa5a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:46.707211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:46.845258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd5097-fb17-4dcf-9cfb-49ad39aa5a3f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:47.025741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02e958-7b5b-4a04-967b-1d4f8df6cf62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:47.026238 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02e958-7b5b-4a04-967b-1d4f8df6cf62 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:47.026513 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02e958-7b5b-4a04-967b-1d4f8df6cf62 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:47.026780 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02e958-7b5b-4a04-967b-1d4f8df6cf62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:47.028397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ce02e958-7b5b-4a04-967b-1d4f8df6cf62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:47.039943 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:47.142069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02e958-7b5b-4a04-967b-1d4f8df6cf62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:47.145032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02e958-7b5b-4a04-967b-1d4f8df6cf62 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:47.170525 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 690/1399] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:15:47.344720 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec2d98-c0de-4f21-b6f9-b896960047b6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:47.345812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec2d98-c0de-4f21-b6f9-b896960047b6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:47.346310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec2d98-c0de-4f21-b6f9-b896960047b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:47.457838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b1ec2d98-c0de-4f21-b6f9-b896960047b6 None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:47.464663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b1ec2d98-c0de-4f21-b6f9-b896960047b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:47.489900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:47.582524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 710/1400] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:15:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:47.639247 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784673-be55-47a3-86d0-8b9f76d3da87 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:47.639624 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784673-be55-47a3-86d0-8b9f76d3da87 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:47.639976 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784673-be55-47a3-86d0-8b9f76d3da87 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:47.641787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 691/1401] 10.222.0.16 () {54 vars in 943 bytes} [Wed Sep 21 16:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:47.651539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576d7d-7f82-4a1d-afe6-d19fb9b232e1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:47.652160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576d7d-7f82-4a1d-afe6-d19fb9b232e1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:47.652537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576d7d-7f82-4a1d-afe6-d19fb9b232e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:47.757775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-76576d7d-7f82-4a1d-afe6-d19fb9b232e1 None None] MFA Rules not processed for user `0b28aaefcb154b228987362921f6476b`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:47.759028 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-76576d7d-7f82-4a1d-afe6-d19fb9b232e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:47.877969 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:47.893102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 711/1402] 10.222.0.16 () {58 vars in 1040 bytes} [Wed Sep 21 16:15:47 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:47.903743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18784673-be55-47a3-86d0-8b9f76d3da87 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:47.905361 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-18784673-be55-47a3-86d0-8b9f76d3da87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:48.088552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:48.090492 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18784673-be55-47a3-86d0-8b9f76d3da87 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:48.220085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cb673-642b-408d-9007-b2970b922c60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:48.220604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cb673-642b-408d-9007-b2970b922c60 service swift] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:48.220912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cb673-642b-408d-9007-b2970b922c60 service swift] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:48.221187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cb673-642b-408d-9007-b2970b922c60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:48.223120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f15cb673-642b-408d-9007-b2970b922c60 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:48.316303 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cb673-642b-408d-9007-b2970b922c60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:48.317951 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cb673-642b-408d-9007-b2970b922c60 service swift] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:48.326538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 692/1403] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:15:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:15:49.538257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322405e-2ef1-48db-9a29-3dd5d618c0ca None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:49.540147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322405e-2ef1-48db-9a29-3dd5d618c0ca None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:49.540556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322405e-2ef1-48db-9a29-3dd5d618c0ca None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:49.543264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 712/1404] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:15:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:49.549646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57136321-020f-42fb-b188-3bf53e51ceca None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:49.550890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57136321-020f-42fb-b188-3bf53e51ceca None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:49.551440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57136321-020f-42fb-b188-3bf53e51ceca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:49.625014 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:49.671873 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-57136321-020f-42fb-b188-3bf53e51ceca None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:49.673179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-57136321-020f-42fb-b188-3bf53e51ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:49.819503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 693/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:15:50.113766 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322405e-2ef1-48db-9a29-3dd5d618c0ca None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:50.115301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c322405e-2ef1-48db-9a29-3dd5d618c0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:50.322753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322405e-2ef1-48db-9a29-3dd5d618c0ca None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:50.441125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:50.510348 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45e487-bb2c-4d2d-9af1-b0edb30e4c0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:50.510983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45e487-bb2c-4d2d-9af1-b0edb30e4c0c service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:50.511263 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45e487-bb2c-4d2d-9af1-b0edb30e4c0c service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:50.511542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45e487-bb2c-4d2d-9af1-b0edb30e4c0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:50.513365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7d45e487-bb2c-4d2d-9af1-b0edb30e4c0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:50.626621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45e487-bb2c-4d2d-9af1-b0edb30e4c0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:50.628246 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45e487-bb2c-4d2d-9af1-b0edb30e4c0c service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:50.649057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 713/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:15:53.046732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afba59c-3bc5-46e6-b41f-ff409f3630b8 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:53.047404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afba59c-3bc5-46e6-b41f-ff409f3630b8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:53.047935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afba59c-3bc5-46e6-b41f-ff409f3630b8 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:53.050989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 694/1407] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:15:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:15:53.056912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92e720-4d7f-4b6d-abbe-6366388f8258 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:53.057691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92e720-4d7f-4b6d-abbe-6366388f8258 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:53.057691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92e720-4d7f-4b6d-abbe-6366388f8258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:53.174590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0e92e720-4d7f-4b6d-abbe-6366388f8258 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:15:53.176145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0e92e720-4d7f-4b6d-abbe-6366388f8258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:53.234239 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:53.364735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 714/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:15:53.670170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afba59c-3bc5-46e6-b41f-ff409f3630b8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:15:53.671764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7afba59c-3bc5-46e6-b41f-ff409f3630b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:53.836670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:53.896156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afba59c-3bc5-46e6-b41f-ff409f3630b8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:15:54.042477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b873c-fa0a-4f1a-afb5-f76481b41d6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:15:54.043120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b873c-fa0a-4f1a-afb5-f76481b41d6e service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:15:54.043414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b873c-fa0a-4f1a-afb5-f76481b41d6e service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:15:54.043668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b873c-fa0a-4f1a-afb5-f76481b41d6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:15:54.045301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-053b873c-fa0a-4f1a-afb5-f76481b41d6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:15:54.173867 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:54.207051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b873c-fa0a-4f1a-afb5-f76481b41d6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:15:54.209291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b873c-fa0a-4f1a-afb5-f76481b41d6e service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:15:54.248638 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 695/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:16:03.359550 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=30 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:04.245297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=13 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:11.892971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca307164-6075-4cd1-a1e0-958799539493 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:11.893549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca307164-6075-4cd1-a1e0-958799539493 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:11.893549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca307164-6075-4cd1-a1e0-958799539493 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:11.894857 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 715/1410] 10.222.0.16 () {54 vars in 918 bytes} [Wed Sep 21 16:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:11.900034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558973ec-98b4-476a-af05-863faab18b1d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:11.900502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558973ec-98b4-476a-af05-863faab18b1d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:11.900617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558973ec-98b4-476a-af05-863faab18b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:11.976963 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-558973ec-98b4-476a-af05-863faab18b1d None None] MFA Rules not processed for user `7cd3076ca5a84ff7ada13065f9531f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:11.978165 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-558973ec-98b4-476a-af05-863faab18b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:12.088715 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 696/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Sep 21 16:16:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:12.104242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a56db1-ef9d-438b-9d19-8992272225c1 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:12.104550 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a56db1-ef9d-438b-9d19-8992272225c1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:12.104857 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a56db1-ef9d-438b-9d19-8992272225c1 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:12.106231 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 716/1412] 10.222.0.16 () {54 vars in 918 bytes} [Wed Sep 21 16:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:12.111276 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdb0a0-ef9a-4d8f-9ebe-5e823745c601 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:12.111560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdb0a0-ef9a-4d8f-9ebe-5e823745c601 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:12.111834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdb0a0-ef9a-4d8f-9ebe-5e823745c601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:12.192019 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:12.194880 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-eabdb0a0-ef9a-4d8f-9ebe-5e823745c601 None None] MFA Rules not processed for user `d7ff08c990dc41b4811f97fecb7c4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:12.196664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-eabdb0a0-ef9a-4d8f-9ebe-5e823745c601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:12.315785 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 697/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Sep 21 16:16:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:14.940190 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c008f2-603a-40e6-88e1-11efc97e8471 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:14.940764 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c008f2-603a-40e6-88e1-11efc97e8471 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:14.940764 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c008f2-603a-40e6-88e1-11efc97e8471 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:14.942094 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:14.948364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5351e61-94de-4c02-ae03-64c4aac22b3d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:14.948913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5351e61-94de-4c02-ae03-64c4aac22b3d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:14.948913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5351e61-94de-4c02-ae03-64c4aac22b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:15.017866 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a5351e61-94de-4c02-ae03-64c4aac22b3d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:15.019222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a5351e61-94de-4c02-ae03-64c4aac22b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:15.080167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:15.124122 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:16:15.411536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c008f2-603a-40e6-88e1-11efc97e8471 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:15.413121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c8c008f2-603a-40e6-88e1-11efc97e8471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:15.564495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c008f2-603a-40e6-88e1-11efc97e8471 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:15.637585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:15.683883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4a0ba-2a62-4af6-af24-38cbc1a56afc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:15.684399 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4a0ba-2a62-4af6-af24-38cbc1a56afc service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:15.684729 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4a0ba-2a62-4af6-af24-38cbc1a56afc service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:15.684994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4a0ba-2a62-4af6-af24-38cbc1a56afc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:15.686594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5bb4a0ba-2a62-4af6-af24-38cbc1a56afc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:15.776646 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4a0ba-2a62-4af6-af24-38cbc1a56afc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:15.778264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4a0ba-2a62-4af6-af24-38cbc1a56afc service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:15.797097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 718/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:16.964242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae4a92-160c-47ec-8a7e-c71eeb562dee None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:16.964847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae4a92-160c-47ec-8a7e-c71eeb562dee None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:16.964847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae4a92-160c-47ec-8a7e-c71eeb562dee None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:16.966211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 16:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:16.973267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd1e34-ca32-414e-bfe2-60d33acddc0a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:16.973821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd1e34-ca32-414e-bfe2-60d33acddc0a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:16.973821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd1e34-ca32-414e-bfe2-60d33acddc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:17.060450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c3dd1e34-ca32-414e-bfe2-60d33acddc0a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:17.061743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c3dd1e34-ca32-414e-bfe2-60d33acddc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:17.092488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:17.163536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 16:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:17.315060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae4a92-160c-47ec-8a7e-c71eeb562dee None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:17.316596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-37ae4a92-160c-47ec-8a7e-c71eeb562dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:17.461386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae4a92-160c-47ec-8a7e-c71eeb562dee None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:17.503035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:17.584160 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c3328-f14a-4db5-b511-3f6320fbf434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:17.584794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c3328-f14a-4db5-b511-3f6320fbf434 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:17.585569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c3328-f14a-4db5-b511-3f6320fbf434 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:17.586113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c3328-f14a-4db5-b511-3f6320fbf434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:17.587964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-831c3328-f14a-4db5-b511-3f6320fbf434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:17.682676 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c3328-f14a-4db5-b511-3f6320fbf434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:17.684280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c3328-f14a-4db5-b511-3f6320fbf434 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:17.702553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 700/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:18.873224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8904-b2ce-43b9-84e3-54414e1484d7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:18.873785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8904-b2ce-43b9-84e3-54414e1484d7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:18.873785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8904-b2ce-43b9-84e3-54414e1484d7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:18.875125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 16:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:18.882525 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b87a8-1891-497a-8fa6-a3ca7c725b97 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:18.883125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b87a8-1891-497a-8fa6-a3ca7c725b97 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:18.883125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b87a8-1891-497a-8fa6-a3ca7c725b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:18.945806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:18.971560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0a6b87a8-1891-497a-8fa6-a3ca7c725b97 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:18.972810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0a6b87a8-1891-497a-8fa6-a3ca7c725b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:19.073217 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 16:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:19.223158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca8904-b2ce-43b9-84e3-54414e1484d7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:19.224600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-16ca8904-b2ce-43b9-84e3-54414e1484d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:19.369650 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca8904-b2ce-43b9-84e3-54414e1484d7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:19.381863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:19.484448 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f17da-8511-4ab8-94fb-0259be8c1e92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:19.485007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f17da-8511-4ab8-94fb-0259be8c1e92 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:19.485287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f17da-8511-4ab8-94fb-0259be8c1e92 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:19.485579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f17da-8511-4ab8-94fb-0259be8c1e92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:19.487154 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3a8f17da-8511-4ab8-94fb-0259be8c1e92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:19.578961 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f17da-8511-4ab8-94fb-0259be8c1e92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:19.580565 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f17da-8511-4ab8-94fb-0259be8c1e92 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:19.601526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 721/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:20.754392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa0fc7-3e21-4d78-be32-ed2e2a9c1bda None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:20.754989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa0fc7-3e21-4d78-be32-ed2e2a9c1bda None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:20.754989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa0fc7-3e21-4d78-be32-ed2e2a9c1bda None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:20.756269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 16:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:20.763950 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546043ed-4b50-4525-9ea8-ebb413f3ae0b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:20.764538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546043ed-4b50-4525-9ea8-ebb413f3ae0b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:20.764538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546043ed-4b50-4525-9ea8-ebb413f3ae0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:20.785789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:20.843999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-546043ed-4b50-4525-9ea8-ebb413f3ae0b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:20.845248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-546043ed-4b50-4525-9ea8-ebb413f3ae0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:20.943443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 16:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:21.095680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa0fc7-3e21-4d78-be32-ed2e2a9c1bda None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:21.097162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-aeaa0fc7-3e21-4d78-be32-ed2e2a9c1bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:21.213969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:21.251508 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa0fc7-3e21-4d78-be32-ed2e2a9c1bda None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:21.364971 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b3769-ec4c-4145-85be-559dec5e67a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:21.365495 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b3769-ec4c-4145-85be-559dec5e67a0 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:21.365772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b3769-ec4c-4145-85be-559dec5e67a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:21.366039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b3769-ec4c-4145-85be-559dec5e67a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:21.367748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-db4b3769-ec4c-4145-85be-559dec5e67a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:21.445461 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:21.460566 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b3769-ec4c-4145-85be-559dec5e67a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:21.462475 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b3769-ec4c-4145-85be-559dec5e67a0 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:21.481173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 703/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:22.622174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921f956-25cb-4f47-8b43-0b20043e53d9 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:22.622744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921f956-25cb-4f47-8b43-0b20043e53d9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:22.622744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921f956-25cb-4f47-8b43-0b20043e53d9 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:22.624059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 16:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:22.630737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c825138-90e0-4e9b-af11-c39130070b3c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:22.631224 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c825138-90e0-4e9b-af11-c39130070b3c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:22.631346 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c825138-90e0-4e9b-af11-c39130070b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:22.708273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3c825138-90e0-4e9b-af11-c39130070b3c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:22.709453 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3c825138-90e0-4e9b-af11-c39130070b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:22.807786 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 16:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:22.965174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921f956-25cb-4f47-8b43-0b20043e53d9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:22.966822 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c921f956-25cb-4f47-8b43-0b20043e53d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:23.075361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:23.140581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921f956-25cb-4f47-8b43-0b20043e53d9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:23.256098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0cb2d-87b7-4a7d-a434-aef0af531b5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:23.256611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0cb2d-87b7-4a7d-a434-aef0af531b5b service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:23.257436 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0cb2d-87b7-4a7d-a434-aef0af531b5b service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:23.257705 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0cb2d-87b7-4a7d-a434-aef0af531b5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:23.259320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-98a0cb2d-87b7-4a7d-a434-aef0af531b5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:23.425432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:23.471281 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0cb2d-87b7-4a7d-a434-aef0af531b5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:23.472905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0cb2d-87b7-4a7d-a434-aef0af531b5b service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:23.490797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 724/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:24.581284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f23a1-4a20-4956-8ef0-dd440364893e None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:24.581859 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f23a1-4a20-4956-8ef0-dd440364893e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:24.581859 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f23a1-4a20-4956-8ef0-dd440364893e None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:24.583197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 16:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:24.590353 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774cca1-2ea2-4a78-9e6f-c91df4cda2ef None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:24.590822 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774cca1-2ea2-4a78-9e6f-c91df4cda2ef None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:24.590920 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774cca1-2ea2-4a78-9e6f-c91df4cda2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:24.669495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1774cca1-2ea2-4a78-9e6f-c91df4cda2ef None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:24.670888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1774cca1-2ea2-4a78-9e6f-c91df4cda2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:24.770265 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:24.921749 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f23a1-4a20-4956-8ef0-dd440364893e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:24.923229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b25f23a1-4a20-4956-8ef0-dd440364893e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:24.981884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:25.095196 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f23a1-4a20-4956-8ef0-dd440364893e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:25.216835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76315d-f752-4586-96e7-cb732cd08242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:25.217374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76315d-f752-4586-96e7-cb732cd08242 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:25.217652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76315d-f752-4586-96e7-cb732cd08242 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:25.217920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76315d-f752-4586-96e7-cb732cd08242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:25.219889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4c76315d-f752-4586-96e7-cb732cd08242 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:25.229526 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:25.330489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76315d-f752-4586-96e7-cb732cd08242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:25.332136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76315d-f752-4586-96e7-cb732cd08242 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:25.353130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 706/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:26.457188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b302d6-cb4a-41f9-8354-d3f4a14a5e66 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:26.457703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b302d6-cb4a-41f9-8354-d3f4a14a5e66 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:26.457810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b302d6-cb4a-41f9-8354-d3f4a14a5e66 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:26.459078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 16:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:26.466648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecabd3c-feed-4af3-a665-731fbe46ac3c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:26.467154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecabd3c-feed-4af3-a665-731fbe46ac3c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:26.467278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecabd3c-feed-4af3-a665-731fbe46ac3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:26.542854 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3ecabd3c-feed-4af3-a665-731fbe46ac3c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:26.544069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3ecabd3c-feed-4af3-a665-731fbe46ac3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:26.611601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:26.641801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:26.792359 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b302d6-cb4a-41f9-8354-d3f4a14a5e66 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:26.793863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-57b302d6-cb4a-41f9-8354-d3f4a14a5e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:26.811920 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:26.940761 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b302d6-cb4a-41f9-8354-d3f4a14a5e66 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:27.029621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:27.056653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a7685-3137-4dbd-bf9d-4a62b8682a09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:27.057191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a7685-3137-4dbd-bf9d-4a62b8682a09 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:27.057463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a7685-3137-4dbd-bf9d-4a62b8682a09 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:27.057726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a7685-3137-4dbd-bf9d-4a62b8682a09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:27.059316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a69a7685-3137-4dbd-bf9d-4a62b8682a09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:27.148741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a7685-3137-4dbd-bf9d-4a62b8682a09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:27.150317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a7685-3137-4dbd-bf9d-4a62b8682a09 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:27.167726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 727/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:28.249411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e490a-243d-4e63-b8ae-ae9c33a278c0 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:28.249997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e490a-243d-4e63-b8ae-ae9c33a278c0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:28.249997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e490a-243d-4e63-b8ae-ae9c33a278c0 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:28.251336 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 16:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:28.258506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be769a-1f01-4724-a58c-bb13118abf03 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:28.258991 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be769a-1f01-4724-a58c-bb13118abf03 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:28.259097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be769a-1f01-4724-a58c-bb13118abf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:28.334597 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d6be769a-1f01-4724-a58c-bb13118abf03 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:28.336570 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d6be769a-1f01-4724-a58c-bb13118abf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:28.377562 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:28.432335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 16:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:28.583460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e490a-243d-4e63-b8ae-ae9c33a278c0 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:28.585490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e25e490a-243d-4e63-b8ae-ae9c33a278c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:28.734117 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e490a-243d-4e63-b8ae-ae9c33a278c0 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:28.788774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:28.853635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce21e9-6016-412f-ad00-76aa5a128e6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:28.854155 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce21e9-6016-412f-ad00-76aa5a128e6a service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:28.854432 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce21e9-6016-412f-ad00-76aa5a128e6a service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:28.854699 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce21e9-6016-412f-ad00-76aa5a128e6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:28.856319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a8ce21e9-6016-412f-ad00-76aa5a128e6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:28.951272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce21e9-6016-412f-ad00-76aa5a128e6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:28.952940 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce21e9-6016-412f-ad00-76aa5a128e6a service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:28.971761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 709/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:30.038374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3853a58-53ad-4451-8bdd-fbff3823c272 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:30.038999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3853a58-53ad-4451-8bdd-fbff3823c272 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:30.038999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3853a58-53ad-4451-8bdd-fbff3823c272 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:30.040281 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 16:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:30.047497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672fb32-346d-4505-9154-4476aba4c28b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:30.048064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672fb32-346d-4505-9154-4476aba4c28b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:30.048064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672fb32-346d-4505-9154-4476aba4c28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:30.127173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a672fb32-346d-4505-9154-4476aba4c28b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:30.128411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a672fb32-346d-4505-9154-4476aba4c28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:30.131990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:30.229273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 16:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:30.380979 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3853a58-53ad-4451-8bdd-fbff3823c272 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:30.382520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d3853a58-53ad-4451-8bdd-fbff3823c272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:30.534954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3853a58-53ad-4451-8bdd-fbff3823c272 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:30.563218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:30.659570 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1e287-c4cc-4c1e-9f7d-9df7c1704004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:30.660070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1e287-c4cc-4c1e-9f7d-9df7c1704004 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:30.660341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1e287-c4cc-4c1e-9f7d-9df7c1704004 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:30.660602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1e287-c4cc-4c1e-9f7d-9df7c1704004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:30.662226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-abe1e287-c4cc-4c1e-9f7d-9df7c1704004 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:30.756320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1e287-c4cc-4c1e-9f7d-9df7c1704004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:30.758013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1e287-c4cc-4c1e-9f7d-9df7c1704004 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:30.776201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 730/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:32.860747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009e60-24fd-4180-aefc-e32b047aa862 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:32.861341 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009e60-24fd-4180-aefc-e32b047aa862 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:32.861341 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009e60-24fd-4180-aefc-e32b047aa862 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:32.862581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:32.868096 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a9357-07d0-46be-8b7d-fb2059f59c0b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:32.868579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a9357-07d0-46be-8b7d-fb2059f59c0b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:32.868716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a9357-07d0-46be-8b7d-fb2059f59c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:32.910341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:32.938040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-253a9357-07d0-46be-8b7d-fb2059f59c0b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:32.939253 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-253a9357-07d0-46be-8b7d-fb2059f59c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:33.043613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:33.329566 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee009e60-24fd-4180-aefc-e32b047aa862 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:33.331676 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ee009e60-24fd-4180-aefc-e32b047aa862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:33.440709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee009e60-24fd-4180-aefc-e32b047aa862 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:33.474950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:33.519892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875032e-38d6-40bf-bc6b-d2a542402ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:33.520498 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875032e-38d6-40bf-bc6b-d2a542402ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:33.520837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875032e-38d6-40bf-bc6b-d2a542402ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:33.521111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875032e-38d6-40bf-bc6b-d2a542402ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:33.522776 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a875032e-38d6-40bf-bc6b-d2a542402ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:33.637406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875032e-38d6-40bf-bc6b-d2a542402ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:33.638975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875032e-38d6-40bf-bc6b-d2a542402ba5 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:33.660143 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 712/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:36.077753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b272dd-30df-48af-8aad-ac201d3c2752 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:36.078307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b272dd-30df-48af-8aad-ac201d3c2752 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:36.078307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b272dd-30df-48af-8aad-ac201d3c2752 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:36.079632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:36.085141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d495d-71c3-4822-aea5-cb2394464ad6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:36.085601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d495d-71c3-4822-aea5-cb2394464ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:36.085738 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d495d-71c3-4822-aea5-cb2394464ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:36.152346 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-966d495d-71c3-4822-aea5-cb2394464ad6 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:36.153623 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-966d495d-71c3-4822-aea5-cb2394464ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:36.166995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:36.252225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:36.535036 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b272dd-30df-48af-8aad-ac201d3c2752 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:36.536613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-24b272dd-30df-48af-8aad-ac201d3c2752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:36.644022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b272dd-30df-48af-8aad-ac201d3c2752 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:36.657376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:36.721706 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1c2c1-6c0d-42fb-93a1-09583cd95ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:36.722216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1c2c1-6c0d-42fb-93a1-09583cd95ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:36.722489 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1c2c1-6c0d-42fb-93a1-09583cd95ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:36.722771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1c2c1-6c0d-42fb-93a1-09583cd95ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:36.724347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cdd1c2c1-6c0d-42fb-93a1-09583cd95ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:36.839775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1c2c1-6c0d-42fb-93a1-09583cd95ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:36.841239 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1c2c1-6c0d-42fb-93a1-09583cd95ae8 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:36.859955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 733/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:39.460774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b122-df8f-4b14-be98-be386cb5fbde None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:39.461461 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b122-df8f-4b14-be98-be386cb5fbde None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:39.461569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b122-df8f-4b14-be98-be386cb5fbde None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:39.462967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:39.468454 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cbce7-9351-4a79-a89a-3b72493045ff None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:39.468911 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cbce7-9351-4a79-a89a-3b72493045ff None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:39.469014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cbce7-9351-4a79-a89a-3b72493045ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:39.516864 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:39.536101 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-619cbce7-9351-4a79-a89a-3b72493045ff None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:39.537394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-619cbce7-9351-4a79-a89a-3b72493045ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:39.634827 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:39.925697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587b122-df8f-4b14-be98-be386cb5fbde None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:39.927254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6587b122-df8f-4b14-be98-be386cb5fbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:40.043690 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587b122-df8f-4b14-be98-be386cb5fbde None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:40.089052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:40.124220 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f7f97-1900-49ba-aebc-8ae354e19555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:40.124861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f7f97-1900-49ba-aebc-8ae354e19555 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:40.125141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f7f97-1900-49ba-aebc-8ae354e19555 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:40.125414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f7f97-1900-49ba-aebc-8ae354e19555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:40.127012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-230f7f97-1900-49ba-aebc-8ae354e19555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:40.237093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f7f97-1900-49ba-aebc-8ae354e19555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:40.238450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f7f97-1900-49ba-aebc-8ae354e19555 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:40.257252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 715/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:42.583384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f256996-4c80-4a55-bcc3-ee5ac832c787 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:42.583951 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f256996-4c80-4a55-bcc3-ee5ac832c787 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:42.583951 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f256996-4c80-4a55-bcc3-ee5ac832c787 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:42.585815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:42.591408 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967b976-9c75-48dc-9991-df8fc948fad8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:42.591881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967b976-9c75-48dc-9991-df8fc948fad8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:42.591989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967b976-9c75-48dc-9991-df8fc948fad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:42.665791 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3967b976-9c75-48dc-9991-df8fc948fad8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:42.667590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3967b976-9c75-48dc-9991-df8fc948fad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:42.689321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:42.775562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:43.059039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f256996-4c80-4a55-bcc3-ee5ac832c787 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:43.060549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8f256996-4c80-4a55-bcc3-ee5ac832c787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:43.161644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f256996-4c80-4a55-bcc3-ee5ac832c787 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:43.182193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:43.234534 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c536eb8-e5db-40b2-94b9-bb87d1104521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:43.235131 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c536eb8-e5db-40b2-94b9-bb87d1104521 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:43.235403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c536eb8-e5db-40b2-94b9-bb87d1104521 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:43.235665 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c536eb8-e5db-40b2-94b9-bb87d1104521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:43.237265 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6c536eb8-e5db-40b2-94b9-bb87d1104521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:43.346985 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c536eb8-e5db-40b2-94b9-bb87d1104521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:43.348342 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c536eb8-e5db-40b2-94b9-bb87d1104521 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:43.367476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 736/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:45.716823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa287-b465-4b33-8966-d05300bc6ba6 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:45.717348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa287-b465-4b33-8966-d05300bc6ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:45.717348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa287-b465-4b33-8966-d05300bc6ba6 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:45.719186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:45.724762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc192d8-cd6d-4441-809b-0734b7d0b177 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:45.725238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc192d8-cd6d-4441-809b-0734b7d0b177 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:45.725335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc192d8-cd6d-4441-809b-0734b7d0b177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:45.792987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:45.796611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3fc192d8-cd6d-4441-809b-0734b7d0b177 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:45.798377 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3fc192d8-cd6d-4441-809b-0734b7d0b177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:45.897879 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:46.182005 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aa287-b465-4b33-8966-d05300bc6ba6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:46.183540 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-404aa287-b465-4b33-8966-d05300bc6ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:46.285903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aa287-b465-4b33-8966-d05300bc6ba6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:46.336118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:46.370708 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723dff5-9d8f-43e8-92e2-a34a5222517c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:46.371324 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723dff5-9d8f-43e8-92e2-a34a5222517c service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:46.371604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723dff5-9d8f-43e8-92e2-a34a5222517c service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:46.372032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723dff5-9d8f-43e8-92e2-a34a5222517c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:46.373596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9723dff5-9d8f-43e8-92e2-a34a5222517c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:46.488578 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723dff5-9d8f-43e8-92e2-a34a5222517c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:46.490060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723dff5-9d8f-43e8-92e2-a34a5222517c service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:46.509583 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 718/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:48.833406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0a18-ec01-4037-b733-3856b39dc785 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:48.833984 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0a18-ec01-4037-b733-3856b39dc785 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:48.833984 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0a18-ec01-4037-b733-3856b39dc785 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:48.835282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:48.841852 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac91fc2-121a-4ccf-a178-fe0d371f2731 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:48.842399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac91fc2-121a-4ccf-a178-fe0d371f2731 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:48.842399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac91fc2-121a-4ccf-a178-fe0d371f2731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:48.908499 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-fac91fc2-121a-4ccf-a178-fe0d371f2731 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:48.909763 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-fac91fc2-121a-4ccf-a178-fe0d371f2731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:48.941765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:49.013958 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:16:49.302674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a0a18-ec01-4037-b733-3856b39dc785 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:49.304755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-986a0a18-ec01-4037-b733-3856b39dc785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:49.412305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a0a18-ec01-4037-b733-3856b39dc785 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:49.443903 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:49.490449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5a034-49d2-4a5a-9e96-3506f7689678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:49.491675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5a034-49d2-4a5a-9e96-3506f7689678 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:49.491947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5a034-49d2-4a5a-9e96-3506f7689678 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:49.492235 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5a034-49d2-4a5a-9e96-3506f7689678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:49.494053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-46b5a034-49d2-4a5a-9e96-3506f7689678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:49.609482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5a034-49d2-4a5a-9e96-3506f7689678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:49.610825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5a034-49d2-4a5a-9e96-3506f7689678 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:49.629859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 739/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:51.894586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4869e3-8d11-4425-b907-cbde1b2378d7 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:51.895195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4869e3-8d11-4425-b907-cbde1b2378d7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:51.895195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4869e3-8d11-4425-b907-cbde1b2378d7 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:51.896648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:51.902721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f68c9-9ffd-4706-8169-e7fd8e35fc9a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:51.903186 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f68c9-9ffd-4706-8169-e7fd8e35fc9a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:51.903305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f68c9-9ffd-4706-8169-e7fd8e35fc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:51.971154 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a35f68c9-9ffd-4706-8169-e7fd8e35fc9a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:51.972397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a35f68c9-9ffd-4706-8169-e7fd8e35fc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:51.982498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:52.077972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:52.360252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4869e3-8d11-4425-b907-cbde1b2378d7 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:52.361979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1e4869e3-8d11-4425-b907-cbde1b2378d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:52.469194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4869e3-8d11-4425-b907-cbde1b2378d7 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:52.529001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:52.549007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe69f90-8967-4f27-8b86-172e0186b297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:52.549637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe69f90-8967-4f27-8b86-172e0186b297 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:52.549915 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe69f90-8967-4f27-8b86-172e0186b297 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:52.550182 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe69f90-8967-4f27-8b86-172e0186b297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:52.552108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ffe69f90-8967-4f27-8b86-172e0186b297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:52.664360 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe69f90-8967-4f27-8b86-172e0186b297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:52.665833 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe69f90-8967-4f27-8b86-172e0186b297 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:52.684053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 721/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:54.946267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff205963-7723-4955-b947-de9df1a2bad9 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:54.946816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff205963-7723-4955-b947-de9df1a2bad9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:54.946816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff205963-7723-4955-b947-de9df1a2bad9 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:54.948188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:54.953970 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014980-f757-415a-a090-c2304a3ec0e6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:54.954481 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014980-f757-415a-a090-c2304a3ec0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:54.954587 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014980-f757-415a-a090-c2304a3ec0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:55.023853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a8014980-f757-415a-a090-c2304a3ec0e6 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:55.025111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a8014980-f757-415a-a090-c2304a3ec0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:55.065110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:55.125197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:16:55.410410 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff205963-7723-4955-b947-de9df1a2bad9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:55.411955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ff205963-7723-4955-b947-de9df1a2bad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:55.523227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff205963-7723-4955-b947-de9df1a2bad9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:55.560878 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:55.597654 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37c369-ea90-424e-9d35-134f706dadca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:55.598251 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37c369-ea90-424e-9d35-134f706dadca service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:55.598522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37c369-ea90-424e-9d35-134f706dadca service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:55.598785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37c369-ea90-424e-9d35-134f706dadca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:55.600435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dc37c369-ea90-424e-9d35-134f706dadca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:55.714965 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37c369-ea90-424e-9d35-134f706dadca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:55.716852 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37c369-ea90-424e-9d35-134f706dadca service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:55.735820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 742/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:57.968771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad1490-4b32-4472-b669-cd7ff0b04b53 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:57.969362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad1490-4b32-4472-b669-cd7ff0b04b53 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:57.969362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad1490-4b32-4472-b669-cd7ff0b04b53 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:57.970647 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:16:57.976954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd64d-5a17-4ddf-8375-f1ff9a391e33 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:57.977416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd64d-5a17-4ddf-8375-f1ff9a391e33 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:57.977526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd64d-5a17-4ddf-8375-f1ff9a391e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:58.050989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-59cbd64d-5a17-4ddf-8375-f1ff9a391e33 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:16:58.052241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-59cbd64d-5a17-4ddf-8375-f1ff9a391e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:58.071493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:58.159306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:16:58.446841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad1490-4b32-4472-b669-cd7ff0b04b53 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:16:58.448391 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b5ad1490-4b32-4472-b669-cd7ff0b04b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:58.560613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad1490-4b32-4472-b669-cd7ff0b04b53 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:16:58.630285 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:58.637913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15786bd0-c150-4ec4-84cb-3221bcc0b982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:16:58.638561 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15786bd0-c150-4ec4-84cb-3221bcc0b982 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:16:58.638836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15786bd0-c150-4ec4-84cb-3221bcc0b982 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:16:58.639107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15786bd0-c150-4ec4-84cb-3221bcc0b982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:16:58.640763 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-15786bd0-c150-4ec4-84cb-3221bcc0b982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:16:58.752274 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15786bd0-c150-4ec4-84cb-3221bcc0b982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:16:58.753648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15786bd0-c150-4ec4-84cb-3221bcc0b982 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:16:58.772936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 724/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:17:00.979401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b7789-d66e-4d16-9369-04ad0a659807 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:00.980002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b7789-d66e-4d16-9369-04ad0a659807 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:00.980002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b7789-d66e-4d16-9369-04ad0a659807 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:00.981470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:17:00.987072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a467f-3923-4069-98e1-039dc596d9ed None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:00.987587 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a467f-3923-4069-98e1-039dc596d9ed None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:00.987587 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a467f-3923-4069-98e1-039dc596d9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:01.057360 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-926a467f-3923-4069-98e1-039dc596d9ed None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:17:01.058583 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-926a467f-3923-4069-98e1-039dc596d9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:01.108003 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:01.156348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:17:01.436135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b7789-d66e-4d16-9369-04ad0a659807 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:17:01.437691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4b2b7789-d66e-4d16-9369-04ad0a659807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:01.543347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b7789-d66e-4d16-9369-04ad0a659807 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:17:01.592018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:01.619912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318055c7-3df2-49f2-a67b-09f842c947ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:17:01.620579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318055c7-3df2-49f2-a67b-09f842c947ce service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:01.620900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318055c7-3df2-49f2-a67b-09f842c947ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:01.621168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318055c7-3df2-49f2-a67b-09f842c947ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:01.622769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-318055c7-3df2-49f2-a67b-09f842c947ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:01.737104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318055c7-3df2-49f2-a67b-09f842c947ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:17:01.738438 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318055c7-3df2-49f2-a67b-09f842c947ce service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:17:01.756671 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 745/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:17:11.154764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=22 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:11.754390 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=66 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:22.028526 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a22767-3627-4e2c-9f6e-f96a658c0c87 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:22.029258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a22767-3627-4e2c-9f6e-f96a658c0c87 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:22.029258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a22767-3627-4e2c-9f6e-f96a658c0c87 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:22.030501 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 726/1471] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:17:22.036249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe3f76-60ee-411f-9c9d-f6d05393ac90 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:22.036249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe3f76-60ee-411f-9c9d-f6d05393ac90 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:22.036249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe3f76-60ee-411f-9c9d-f6d05393ac90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:22.105125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-18fe3f76-60ee-411f-9c9d-f6d05393ac90 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:17:22.106339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-18fe3f76-60ee-411f-9c9d-f6d05393ac90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:22.205905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 746/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:17:22.509541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1c8e4-fcb5-4856-bf82-59a8157720f0 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:22.509834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1c8e4-fcb5-4856-bf82-59a8157720f0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:22.510113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1c8e4-fcb5-4856-bf82-59a8157720f0 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:22.511448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 727/1473] 10.222.0.16 () {54 vars in 962 bytes} [Wed Sep 21 16:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:17:22.516355 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe4c3a-a669-4c20-9bda-399b9ea3f8c0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:22.516637 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe4c3a-a669-4c20-9bda-399b9ea3f8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:22.516929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe4c3a-a669-4c20-9bda-399b9ea3f8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:22.594942 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-68fe4c3a-a669-4c20-9bda-399b9ea3f8c0 None None] MFA Rules not processed for user `2974669e9d1a417892b1d59dbc9e87ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:17:22.596155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-68fe4c3a-a669-4c20-9bda-399b9ea3f8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:22.617058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:22.676476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 747/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Sep 21 16:17:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:17:22.684618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1c8e4-fcb5-4856-bf82-59a8157720f0 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:17:22.686189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-33b1c8e4-fcb5-4856-bf82-59a8157720f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:22.801239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1c8e4-fcb5-4856-bf82-59a8157720f0 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:17:22.876964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebace9-13ec-4778-b87e-1090b92ca796 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2974669e9d1a417892b1d59dbc9e87ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:17:22.877885 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebace9-13ec-4778-b87e-1090b92ca796 service glance] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:22.878160 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebace9-13ec-4778-b87e-1090b92ca796 service glance] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:22.878427 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebace9-13ec-4778-b87e-1090b92ca796 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:22.880032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-00ebace9-13ec-4778-b87e-1090b92ca796 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:22.937319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:22.994743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebace9-13ec-4778-b87e-1090b92ca796 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:17:22.996190 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebace9-13ec-4778-b87e-1090b92ca796 service glance] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:17:23.015530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 728/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:17:25.317038 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3a926-90b2-4543-a17c-98b2265bbdd0 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:25.317613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3a926-90b2-4543-a17c-98b2265bbdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:25.317613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3a926-90b2-4543-a17c-98b2265bbdd0 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:25.319418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 748/1476] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:17:25.325008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39eceb-0a45-4ba7-ba1f-385419567314 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:25.325503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39eceb-0a45-4ba7-ba1f-385419567314 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:25.325612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39eceb-0a45-4ba7-ba1f-385419567314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:25.394566 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5c39eceb-0a45-4ba7-ba1f-385419567314 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:17:25.395799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5c39eceb-0a45-4ba7-ba1f-385419567314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:25.497802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 729/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:17:25.787812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3a926-90b2-4543-a17c-98b2265bbdd0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:17:25.789428 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-85f3a926-90b2-4543-a17c-98b2265bbdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:25.918648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3a926-90b2-4543-a17c-98b2265bbdd0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:17:25.969478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:26.013969 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952710e-9f76-4fe7-9365-0b39dd88905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:17:26.014571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952710e-9f76-4fe7-9365-0b39dd88905d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:26.014841 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952710e-9f76-4fe7-9365-0b39dd88905d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:26.015103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952710e-9f76-4fe7-9365-0b39dd88905d admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:26.015729 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952710e-9f76-4fe7-9365-0b39dd88905d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:17:26.017498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-1952710e-9f76-4fe7-9365-0b39dd88905d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:17:26.017498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 21 16:17:26.017498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: Sep 21 16:17:26.018621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952710e-9f76-4fe7-9365-0b39dd88905d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:17:26.038022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 749/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 21 16:17:25 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:17:28.240555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcb86f-017a-4765-b878-65f90a2e762c None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:28.241171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcb86f-017a-4765-b878-65f90a2e762c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:28.241171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcb86f-017a-4765-b878-65f90a2e762c None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:28.242447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 730/1479] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:17:28.248093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06427ed-1dad-4e94-9b0c-8e85e7bfe7c2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:28.248552 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06427ed-1dad-4e94-9b0c-8e85e7bfe7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:28.248661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06427ed-1dad-4e94-9b0c-8e85e7bfe7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:28.312834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b06427ed-1dad-4e94-9b0c-8e85e7bfe7c2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:17:28.314040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b06427ed-1dad-4e94-9b0c-8e85e7bfe7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:28.409965 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 750/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:17:28.704168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcb86f-017a-4765-b878-65f90a2e762c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:17:28.705741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1bbcb86f-017a-4765-b878-65f90a2e762c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:28.715938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:28.861880 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcb86f-017a-4765-b878-65f90a2e762c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:17:28.944488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:28.982133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fbedb-093c-40d9-aa32-ff1a5f99171d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:17:28.982747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fbedb-093c-40d9-aa32-ff1a5f99171d service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:28.983028 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fbedb-093c-40d9-aa32-ff1a5f99171d service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:28.983300 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fbedb-093c-40d9-aa32-ff1a5f99171d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:28.984967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d52fbedb-093c-40d9-aa32-ff1a5f99171d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:29.079329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fbedb-093c-40d9-aa32-ff1a5f99171d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:17:29.080996 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fbedb-093c-40d9-aa32-ff1a5f99171d service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:17:29.100883 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 731/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:17:31.464725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277aab-6a81-41d0-8f32-89726f470aa4 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:31.465175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277aab-6a81-41d0-8f32-89726f470aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:31.465284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277aab-6a81-41d0-8f32-89726f470aa4 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:31.466588 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 751/1482] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:17:31.471962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f855-f36c-4273-bb0f-3e3632036380 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:31.472422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f855-f36c-4273-bb0f-3e3632036380 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:31.472516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f855-f36c-4273-bb0f-3e3632036380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:31.542738 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-edf3f855-f36c-4273-bb0f-3e3632036380 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:17:31.543971 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-edf3f855-f36c-4273-bb0f-3e3632036380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:31.591256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:31.642584 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 732/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:17:31.936755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97277aab-6a81-41d0-8f32-89726f470aa4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:17:31.938301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-97277aab-6a81-41d0-8f32-89726f470aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:31.964261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:32.045532 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97277aab-6a81-41d0-8f32-89726f470aa4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:17:32.124905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9cb4e-9a5b-4161-809d-69381f458821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:17:32.125516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9cb4e-9a5b-4161-809d-69381f458821 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:32.125791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9cb4e-9a5b-4161-809d-69381f458821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:32.126064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9cb4e-9a5b-4161-809d-69381f458821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:32.127668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-37b9cb4e-9a5b-4161-809d-69381f458821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:32.204107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:32.241636 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9cb4e-9a5b-4161-809d-69381f458821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:17:32.243060 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9cb4e-9a5b-4161-809d-69381f458821 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:17:32.261117 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 752/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:17:34.491462 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb567ef-8afe-4e0f-a41b-3af867167725 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:34.492033 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb567ef-8afe-4e0f-a41b-3af867167725 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:34.492033 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb567ef-8afe-4e0f-a41b-3af867167725 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:34.493368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 733/1485] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:17:34.498968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c481-339a-4441-81ff-3c0f16b085c7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:34.499444 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c481-339a-4441-81ff-3c0f16b085c7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:34.499555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c481-339a-4441-81ff-3c0f16b085c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:34.569187 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e378c481-339a-4441-81ff-3c0f16b085c7 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:17:34.570409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e378c481-339a-4441-81ff-3c0f16b085c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:34.675250 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 753/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:17:34.972497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb567ef-8afe-4e0f-a41b-3af867167725 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:17:34.974684 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8bb567ef-8afe-4e0f-a41b-3af867167725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:35.096257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb567ef-8afe-4e0f-a41b-3af867167725 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:17:35.173136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:35.174743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673ff9f-ac2e-447d-8d0c-7ea26bad785c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:17:35.175600 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673ff9f-ac2e-447d-8d0c-7ea26bad785c service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:35.176119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673ff9f-ac2e-447d-8d0c-7ea26bad785c service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:35.176576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673ff9f-ac2e-447d-8d0c-7ea26bad785c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:35.179001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3673ff9f-ac2e-447d-8d0c-7ea26bad785c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:35.290425 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673ff9f-ac2e-447d-8d0c-7ea26bad785c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:17:35.291766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673ff9f-ac2e-447d-8d0c-7ea26bad785c service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:17:35.310081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 734/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:17:37.586568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d0c5-8cd5-4159-b522-14a1a82e80c3 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:37.587406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d0c5-8cd5-4159-b522-14a1a82e80c3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:37.587406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d0c5-8cd5-4159-b522-14a1a82e80c3 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:37.588744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 754/1488] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:17:37.594104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366417fa-6ca9-40f5-9999-63523ac58029 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:37.594559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366417fa-6ca9-40f5-9999-63523ac58029 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:37.594678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366417fa-6ca9-40f5-9999-63523ac58029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:37.660985 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-366417fa-6ca9-40f5-9999-63523ac58029 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:17:37.662314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-366417fa-6ca9-40f5-9999-63523ac58029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:37.833457 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:37.878444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 735/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:17:38.174593 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98d0c5-8cd5-4159-b522-14a1a82e80c3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:17:38.176178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6a98d0c5-8cd5-4159-b522-14a1a82e80c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:38.217953 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:38.298792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98d0c5-8cd5-4159-b522-14a1a82e80c3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:17:38.375368 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234614c9-c1ff-44eb-8346-379d1a59cf90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:17:38.375983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234614c9-c1ff-44eb-8346-379d1a59cf90 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:38.376261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234614c9-c1ff-44eb-8346-379d1a59cf90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:38.376530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234614c9-c1ff-44eb-8346-379d1a59cf90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:38.378175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-234614c9-c1ff-44eb-8346-379d1a59cf90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:38.461043 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:38.492837 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234614c9-c1ff-44eb-8346-379d1a59cf90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:17:38.494258 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234614c9-c1ff-44eb-8346-379d1a59cf90 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:17:38.512943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 755/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:17:41.026591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff89a1-1789-44e0-9e53-65a4542e89be None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:41.027332 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff89a1-1789-44e0-9e53-65a4542e89be None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:41.027332 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff89a1-1789-44e0-9e53-65a4542e89be None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:41.028512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 736/1491] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 21 16:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:17:41.036106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228871b6-2388-4461-a4a3-5f130cd22ae3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:41.036733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228871b6-2388-4461-a4a3-5f130cd22ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:41.036733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228871b6-2388-4461-a4a3-5f130cd22ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:41.123070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-228871b6-2388-4461-a4a3-5f130cd22ae3 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:17:41.124318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-228871b6-2388-4461-a4a3-5f130cd22ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:41.239039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 756/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 21 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:17:41.538268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff89a1-1789-44e0-9e53-65a4542e89be None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:17:41.539828 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-48ff89a1-1789-44e0-9e53-65a4542e89be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:41.653138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff89a1-1789-44e0-9e53-65a4542e89be None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:17:41.731576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d407326-7f59-4c94-9d9e-bd94fd4b676f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:17:41.732361 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d407326-7f59-4c94-9d9e-bd94fd4b676f service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:17:41.732612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d407326-7f59-4c94-9d9e-bd94fd4b676f service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:17:41.732739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d407326-7f59-4c94-9d9e-bd94fd4b676f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:17:41.734368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6d407326-7f59-4c94-9d9e-bd94fd4b676f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:17:41.745808 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:41.863999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d407326-7f59-4c94-9d9e-bd94fd4b676f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:17:41.866017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d407326-7f59-4c94-9d9e-bd94fd4b676f service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:17:41.884432 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 737/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:17:51.237198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=82 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:51.882096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=50 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:19:26.937394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c5159-964b-404a-bcac-185ea3237fa5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:26.938027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c5159-964b-404a-bcac-185ea3237fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:26.938027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c5159-964b-404a-bcac-185ea3237fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:27.022542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5c9c5159-964b-404a-bcac-185ea3237fa5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:19:27.023765 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5c9c5159-964b-404a-bcac-185ea3237fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:19:27.133483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 757/1494] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:19:27.141747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d2b8b-2068-4e4a-8d71-e7da7c7933cb None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:27.142313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d2b8b-2068-4e4a-8d71-e7da7c7933cb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:27.142313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d2b8b-2068-4e4a-8d71-e7da7c7933cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:27.165127 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-259d2b8b-2068-4e4a-8d71-e7da7c7933cb None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:19:27.166474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-259d2b8b-2068-4e4a-8d71-e7da7c7933cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:19:27.175145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 738/1495] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:19:27.179842 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c5159-964b-404a-bcac-185ea3237fa5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:19:27.189749 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c5159-964b-404a-bcac-185ea3237fa5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:19:27.194300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d38c6-f366-40fb-9996-3d822fe52d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:19:27.194901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d38c6-f366-40fb-9996-3d822fe52d48 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:27.195174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d38c6-f366-40fb-9996-3d822fe52d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:27.195447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d38c6-f366-40fb-9996-3d822fe52d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:27.196093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d38c6-f366-40fb-9996-3d822fe52d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:19:27.196389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d38c6-f366-40fb-9996-3d822fe52d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:19:27.197423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-be2d38c6-f366-40fb-9996-3d822fe52d48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:19:27.197423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 21 16:19:27.197423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: Sep 21 16:19:27.198299 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d38c6-f366-40fb-9996-3d822fe52d48 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:19:27.210451 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 758/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:19:27.219218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d2b8b-2068-4e4a-8d71-e7da7c7933cb None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:19:27.229215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d2b8b-2068-4e4a-8d71-e7da7c7933cb None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:19:27.233886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677f5b1-276f-47f0-93a3-0e008f85b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:19:27.234497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677f5b1-276f-47f0-93a3-0e008f85b2fa admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:27.234775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677f5b1-276f-47f0-93a3-0e008f85b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:27.235047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677f5b1-276f-47f0-93a3-0e008f85b2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:27.235691 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677f5b1-276f-47f0-93a3-0e008f85b2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:19:27.237480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: WARNING py.warnings [None req-9677f5b1-276f-47f0-93a3-0e008f85b2fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:19:27.237480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: warnings.warn(msg) Sep 21 16:19:27.237480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: Sep 21 16:19:27.238677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677f5b1-276f-47f0-93a3-0e008f85b2fa admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:19:27.279481 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 739/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:19:27 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:19:27.284194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d38c6-f366-40fb-9996-3d822fe52d48 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:19:27.294222 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d38c6-f366-40fb-9996-3d822fe52d48 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:19:27.346158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:19:27.353933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7b208-6952-4351-9481-02fb0525374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:19:27.354552 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7b208-6952-4351-9481-02fb0525374b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:27.354833 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7b208-6952-4351-9481-02fb0525374b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:27.355104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7b208-6952-4351-9481-02fb0525374b admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:27.355733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7b208-6952-4351-9481-02fb0525374b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:19:27.356772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-99e7b208-6952-4351-9481-02fb0525374b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:19:27.356772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 21 16:19:27.356772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: Sep 21 16:19:27.358052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7b208-6952-4351-9481-02fb0525374b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:19:27.380991 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 759/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:19:27 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:19:27.386026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677f5b1-276f-47f0-93a3-0e008f85b2fa admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:19:27.397242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677f5b1-276f-47f0-93a3-0e008f85b2fa admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:19:27.402069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa19649-4b0a-432f-a64f-8b019f715d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:19:27.402672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19649-4b0a-432f-a64f-8b019f715d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:27.402950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19649-4b0a-432f-a64f-8b019f715d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:27.403218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19649-4b0a-432f-a64f-8b019f715d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:27.403869 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa19649-4b0a-432f-a64f-8b019f715d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:19:27.404916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: WARNING py.warnings [None req-7fa19649-4b0a-432f-a64f-8b019f715d5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:19:27.404916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: warnings.warn(msg) Sep 21 16:19:27.404916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: Sep 21 16:19:27.405799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa19649-4b0a-432f-a64f-8b019f715d5c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:19:27.418848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 740/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:19:27.423357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7b208-6952-4351-9481-02fb0525374b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:19:27.433608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7b208-6952-4351-9481-02fb0525374b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:19:27.438278 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602ad3f-7c11-43eb-b64f-99ef23099b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:19:27.438854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602ad3f-7c11-43eb-b64f-99ef23099b3f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:27.439129 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602ad3f-7c11-43eb-b64f-99ef23099b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:27.439403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602ad3f-7c11-43eb-b64f-99ef23099b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:27.440087 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602ad3f-7c11-43eb-b64f-99ef23099b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:19:27.441076 dv-cinder-858621-1-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-d602ad3f-7c11-43eb-b64f-99ef23099b3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:19:27.441076 dv-cinder-858621-1-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 21 16:19:27.441076 dv-cinder-858621-1-smb devstack@keystone.service[81472]: Sep 21 16:19:27.442456 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602ad3f-7c11-43eb-b64f-99ef23099b3f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:19:27.458201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 760/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:19:27.462912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa19649-4b0a-432f-a64f-8b019f715d5c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:19:27.473044 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa19649-4b0a-432f-a64f-8b019f715d5c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:19:27.477745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71d645-d72f-49ef-ac6f-3788af799161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:19:27.478404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d645-d72f-49ef-ac6f-3788af799161 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:27.478685 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d645-d72f-49ef-ac6f-3788af799161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:27.478968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d645-d72f-49ef-ac6f-3788af799161 admin admin] PATH_INFO: `/v3/projects/3c6512441aa54d9ca22982c4d39d36e8/users/b4d2c1b34de0465a8130a75f33f761bd/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:27.494850 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71d645-d72f-49ef-ac6f-3788af799161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6512441aa54d9ca22982c4d39d36e8, user_id=b4d2c1b34de0465a8130a75f33f761bd, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:19:27.495884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: WARNING py.warnings [None req-7c71d645-d72f-49ef-ac6f-3788af799161 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:19:27.495884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: warnings.warn(msg) Sep 21 16:19:27.495884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: Sep 21 16:19:27.497845 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71d645-d72f-49ef-ac6f-3788af799161 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:19:27.511764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 741/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:19:27 2022] PUT /identity/v3/projects/3c6512441aa54d9ca22982c4d39d36e8/users/b4d2c1b34de0465a8130a75f33f761bd/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:19:27.524909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd43d7-775d-4963-af6a-7567a97e6144 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:27.525350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd43d7-775d-4963-af6a-7567a97e6144 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:27.525925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd43d7-775d-4963-af6a-7567a97e6144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:27.555130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b6fd43d7-775d-4963-af6a-7567a97e6144 None None] MFA Rules not processed for user `b4d2c1b34de0465a8130a75f33f761bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:19:27.556350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b6fd43d7-775d-4963-af6a-7567a97e6144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:19:27.622626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 761/1502] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:19:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:19:27.636840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251322dc-320e-4ff8-a630-0b3207044cfa None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:27.637125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251322dc-320e-4ff8-a630-0b3207044cfa None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:27.637473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251322dc-320e-4ff8-a630-0b3207044cfa None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:27.638877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 742/1503] 10.222.0.16 () {54 vars in 963 bytes} [Wed Sep 21 16:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:19:27.643949 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77313c16-eb85-40a3-bf0c-68afb0766958 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:27.644239 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77313c16-eb85-40a3-bf0c-68afb0766958 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:27.644498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77313c16-eb85-40a3-bf0c-68afb0766958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:27.705497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-77313c16-eb85-40a3-bf0c-68afb0766958 None None] MFA Rules not processed for user `aa61549530e648a0b774a784b0450162`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:19:27.706611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-77313c16-eb85-40a3-bf0c-68afb0766958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:19:27.784807 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 762/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Sep 21 16:19:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:19:27.795298 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251322dc-320e-4ff8-a630-0b3207044cfa None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:19:27.807910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251322dc-320e-4ff8-a630-0b3207044cfa None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:19:27.812744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003ddaa-509e-47c5-943f-223b83202997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:19:27.813340 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003ddaa-509e-47c5-943f-223b83202997 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:27.813610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003ddaa-509e-47c5-943f-223b83202997 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:27.813876 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003ddaa-509e-47c5-943f-223b83202997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:27.826350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003ddaa-509e-47c5-943f-223b83202997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:19:27.827846 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003ddaa-509e-47c5-943f-223b83202997 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:19:27.837165 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 743/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:19:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:19:27.884579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2bdb4-9216-4242-9117-4662a165d910 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:27.884910 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2bdb4-9216-4242-9117-4662a165d910 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:27.885187 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2bdb4-9216-4242-9117-4662a165d910 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:27.886474 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 763/1506] 10.222.0.16 () {52 vars in 830 bytes} [Wed Sep 21 16:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:19:27.890344 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003ddaa-509e-47c5-943f-223b83202997 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:19:27.953656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003ddaa-509e-47c5-943f-223b83202997 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:19:27.958364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:19:27.958931 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:27.959203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:27.959595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] PATH_INFO: `/v3/users/b4d2c1b34de0465a8130a75f33f761bd` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:27.960759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d2c1b34de0465a8130a75f33f761bd)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:19:27.962030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: WARNING py.warnings [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:19:27.962030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: warnings.warn(msg) Sep 21 16:19:27.962030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: Sep 21 16:19:27.963214 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:19:28.037206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d2c1b34de0465a8130a75f33f761bd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:19:28.037890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d2c1b34de0465a8130a75f33f761bd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:19:28.039057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d2c1b34de0465a8130a75f33f761bd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:19:28.055370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d2c1b34de0465a8130a75f33f761bd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:19:28.089368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d2c1b34de0465a8130a75f33f761bd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:19:28.093415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:19:28.107659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 744/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:19:27 2022] DELETE /identity/v3/users/b4d2c1b34de0465a8130a75f33f761bd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:19:28.113015 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099be4e-67cd-4832-91b0-9e4a7456432a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:28.114113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099be4e-67cd-4832-91b0-9e4a7456432a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:28.114113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099be4e-67cd-4832-91b0-9e4a7456432a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:28.133882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6099be4e-67cd-4832-91b0-9e4a7456432a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:19:28.134941 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6099be4e-67cd-4832-91b0-9e4a7456432a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:19:28.146882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:19:28.204960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 764/1508] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:19:28.215856 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:19:28.217314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:19:28.300615 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b45a1f-df68-4c21-81ed-638abfa67794 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:19:28.305108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbfcb1-e14f-405e-a058-cf52c764cba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:19:28.305714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbfcb1-e14f-405e-a058-cf52c764cba4 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:28.305995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbfcb1-e14f-405e-a058-cf52c764cba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:28.306268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbfcb1-e14f-405e-a058-cf52c764cba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:28.316130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbfcb1-e14f-405e-a058-cf52c764cba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:19:28.317621 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbfcb1-e14f-405e-a058-cf52c764cba4 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:19:28.328454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 745/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:19:28.765467 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099be4e-67cd-4832-91b0-9e4a7456432a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:19:28.766929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6099be4e-67cd-4832-91b0-9e4a7456432a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:19:28.783959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099be4e-67cd-4832-91b0-9e4a7456432a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:19:28.790064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34514a8-3f9a-498a-840e-a5b1eb63031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:19:28.790742 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34514a8-3f9a-498a-840e-a5b1eb63031d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:19:28.791019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34514a8-3f9a-498a-840e-a5b1eb63031d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:19:28.791351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34514a8-3f9a-498a-840e-a5b1eb63031d admin admin] PATH_INFO: `/v3/projects/3c6512441aa54d9ca22982c4d39d36e8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:19:28.793223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34514a8-3f9a-498a-840e-a5b1eb63031d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c6512441aa54d9ca22982c4d39d36e8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:19:28.794260 dv-cinder-858621-1-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-a34514a8-3f9a-498a-840e-a5b1eb63031d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:19:28.794260 dv-cinder-858621-1-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 21 16:19:28.794260 dv-cinder-858621-1-smb devstack@keystone.service[81472]: Sep 21 16:19:28.795485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34514a8-3f9a-498a-840e-a5b1eb63031d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:19:28.867825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a34514a8-3f9a-498a-840e-a5b1eb63031d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c6512441aa54d9ca22982c4d39d36e8', 'request_id': 'req-a34514a8-3f9a-498a-840e-a5b1eb63031d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:19:28.873971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a34514a8-3f9a-498a-840e-a5b1eb63031d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c6512441aa54d9ca22982c4d39d36e8', 'request_id': 'req-a34514a8-3f9a-498a-840e-a5b1eb63031d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:19:28.886228 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a34514a8-3f9a-498a-840e-a5b1eb63031d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c6512441aa54d9ca22982c4d39d36e8', 'request_id': 'req-a34514a8-3f9a-498a-840e-a5b1eb63031d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:19:28.908043 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a34514a8-3f9a-498a-840e-a5b1eb63031d admin admin] The token cache is being invalidate because project 3c6512441aa54d9ca22982c4d39d36e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:19:28.909753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a34514a8-3f9a-498a-840e-a5b1eb63031d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:19:28.909753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a34514a8-3f9a-498a-840e-a5b1eb63031d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:19:28.910732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 765/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:19:28 2022] DELETE /identity/v3/projects/3c6512441aa54d9ca22982c4d39d36e8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:19:38.323418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:19:38.904093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:21:04.564708 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a7e22-a8f6-4651-8c29-db8c6d68e842 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:04.565424 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a7e22-a8f6-4651-8c29-db8c6d68e842 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:04.565424 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a7e22-a8f6-4651-8c29-db8c6d68e842 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:04.566980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 16:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:21:04.572388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2126c0-436d-47a5-b492-0a4056d2f37b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:04.572874 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2126c0-436d-47a5-b492-0a4056d2f37b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:04.572984 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2126c0-436d-47a5-b492-0a4056d2f37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:04.594560 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0d2126c0-436d-47a5-b492-0a4056d2f37b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:21:04.595757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0d2126c0-436d-47a5-b492-0a4056d2f37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:21:04.653528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 16:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:21:04.812249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a7e22-a8f6-4651-8c29-db8c6d68e842 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:21:04.813970 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f55a7e22-a8f6-4651-8c29-db8c6d68e842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:21:04.921289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a7e22-a8f6-4651-8c29-db8c6d68e842 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:21:04.926678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ea8c1-3ca2-4f3e-a3b3-5b8b9c85e4e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:21:04.927282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ea8c1-3ca2-4f3e-a3b3-5b8b9c85e4e8 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:04.927560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ea8c1-3ca2-4f3e-a3b3-5b8b9c85e4e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:04.927834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ea8c1-3ca2-4f3e-a3b3-5b8b9c85e4e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:04.935873 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ea8c1-3ca2-4f3e-a3b3-5b8b9c85e4e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:21:04.937486 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ea8c1-3ca2-4f3e-a3b3-5b8b9c85e4e8 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:21:04.946940 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 747/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:21:06.050474 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced38b25-3b78-4766-9bdc-7466b11839df None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:06.051074 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced38b25-3b78-4766-9bdc-7466b11839df None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:06.051074 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced38b25-3b78-4766-9bdc-7466b11839df None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:06.052366 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 16:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:21:06.058562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252edd6-40dc-4f0d-9649-3523ea2baa37 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:06.058979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252edd6-40dc-4f0d-9649-3523ea2baa37 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:06.059117 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252edd6-40dc-4f0d-9649-3523ea2baa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:06.078872 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8252edd6-40dc-4f0d-9649-3523ea2baa37 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:21:06.080068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8252edd6-40dc-4f0d-9649-3523ea2baa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:21:06.088775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 16:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:21:06.240191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced38b25-3b78-4766-9bdc-7466b11839df None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:21:06.255035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced38b25-3b78-4766-9bdc-7466b11839df None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:21:06.260756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163285f-aae1-441d-bbc6-2909545e5722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:21:06.261350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163285f-aae1-441d-bbc6-2909545e5722 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:06.261628 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163285f-aae1-441d-bbc6-2909545e5722 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:06.261898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163285f-aae1-441d-bbc6-2909545e5722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:06.269977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163285f-aae1-441d-bbc6-2909545e5722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:21:06.271540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163285f-aae1-441d-bbc6-2909545e5722 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:21:06.280746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 768/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:21:07.067088 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836d024-7bd4-423c-92de-326f7a05f9ab None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:07.067510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836d024-7bd4-423c-92de-326f7a05f9ab None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:07.067732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836d024-7bd4-423c-92de-326f7a05f9ab None None] PATH_INFO: `/v3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:07.068905 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 749/1517] 10.222.0.26 () {54 vars in 925 bytes} [Wed Sep 21 16:21:07 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:21:07.075702 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748439c-5988-4f59-b4ce-e810fd89cf3c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:07.076145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748439c-5988-4f59-b4ce-e810fd89cf3c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:07.076252 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748439c-5988-4f59-b4ce-e810fd89cf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:07.126694 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9748439c-5988-4f59-b4ce-e810fd89cf3c None None] MFA Rules not processed for user `7cd3076ca5a84ff7ada13065f9531f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:21:07.127934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9748439c-5988-4f59-b4ce-e810fd89cf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:21:07.199409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 769/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Sep 21 16:21:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:21:16.074063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=49 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:21:16.095872 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e3aeb-de21-4a6a-903f-dbbe61500693 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:16.096153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e3aeb-de21-4a6a-903f-dbbe61500693 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:16.096452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e3aeb-de21-4a6a-903f-dbbe61500693 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:16.097861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 750/1519] 10.222.0.16 () {54 vars in 961 bytes} [Wed Sep 21 16:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:21:16.103127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204db5f1-11c2-45a9-9748-18a745f494da None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:16.103595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204db5f1-11c2-45a9-9748-18a745f494da None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:16.103701 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204db5f1-11c2-45a9-9748-18a745f494da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:16.123921 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-204db5f1-11c2-45a9-9748-18a745f494da None None] MFA Rules not processed for user `7cd3076ca5a84ff7ada13065f9531f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:21:16.125167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-204db5f1-11c2-45a9-9748-18a745f494da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:21:16.135108 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 770/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Sep 21 16:21:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:21:16.144159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e3aeb-de21-4a6a-903f-dbbe61500693 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:21:16.158420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e3aeb-de21-4a6a-903f-dbbe61500693 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:21:16.165046 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da216c-93dc-40a8-9f44-5cbbf7a63e8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd3076ca5a84ff7ada13065f9531f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:21:16.166033 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da216c-93dc-40a8-9f44-5cbbf7a63e8e service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:16.166496 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da216c-93dc-40a8-9f44-5cbbf7a63e8e service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:16.166918 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da216c-93dc-40a8-9f44-5cbbf7a63e8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:16.176760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da216c-93dc-40a8-9f44-5cbbf7a63e8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:21:16.178389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da216c-93dc-40a8-9f44-5cbbf7a63e8e service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:21:16.197561 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 751/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:21:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:21:17.782477 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bb5ce-cfd1-4677-8827-a4c9698bc921 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:17.783013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bb5ce-cfd1-4677-8827-a4c9698bc921 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:17.783013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bb5ce-cfd1-4677-8827-a4c9698bc921 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:17.784866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 16:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:21:17.791297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d3a00-713d-4d58-9fd6-2789beeda8a0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:17.791780 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d3a00-713d-4d58-9fd6-2789beeda8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:17.791877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d3a00-713d-4d58-9fd6-2789beeda8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:17.811895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9f4d3a00-713d-4d58-9fd6-2789beeda8a0 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:21:17.813237 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9f4d3a00-713d-4d58-9fd6-2789beeda8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:21:17.821043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 16:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:21:17.976333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bb5ce-cfd1-4677-8827-a4c9698bc921 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:21:17.991898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bb5ce-cfd1-4677-8827-a4c9698bc921 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:21:17.997422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28c273-5c1f-40ea-8355-db68a9d05150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:21:17.998039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28c273-5c1f-40ea-8355-db68a9d05150 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:17.998311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28c273-5c1f-40ea-8355-db68a9d05150 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:17.998576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28c273-5c1f-40ea-8355-db68a9d05150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:18.007669 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28c273-5c1f-40ea-8355-db68a9d05150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:21:18.009341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28c273-5c1f-40ea-8355-db68a9d05150 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:21:18.020159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 772/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:21:19.085794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73700226-0b33-410a-85a2-d4080160d0a0 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:19.086260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73700226-0b33-410a-85a2-d4080160d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:19.086365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73700226-0b33-410a-85a2-d4080160d0a0 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:19.087667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 16:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:21:19.093831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645a430-7065-4a8c-8b09-5545a5a85e8e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:19.094311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645a430-7065-4a8c-8b09-5545a5a85e8e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:19.094517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645a430-7065-4a8c-8b09-5545a5a85e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:19.114650 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0645a430-7065-4a8c-8b09-5545a5a85e8e None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:21:19.115866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0645a430-7065-4a8c-8b09-5545a5a85e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:21:19.124103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 16:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:21:19.275759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73700226-0b33-410a-85a2-d4080160d0a0 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:21:19.291589 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73700226-0b33-410a-85a2-d4080160d0a0 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:21:19.297079 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaef33-209d-4acc-be20-1f877ae2d584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:21:19.297678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaef33-209d-4acc-be20-1f877ae2d584 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:19.297955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaef33-209d-4acc-be20-1f877ae2d584 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:19.298224 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaef33-209d-4acc-be20-1f877ae2d584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:19.306734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaef33-209d-4acc-be20-1f877ae2d584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:21:19.308323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaef33-209d-4acc-be20-1f877ae2d584 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:21:19.318321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 754/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:21:23.481557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b0c4f-2ca4-4826-9f6e-99b553faacfd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:23.482124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b0c4f-2ca4-4826-9f6e-99b553faacfd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:23.482124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b0c4f-2ca4-4826-9f6e-99b553faacfd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:23.483430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:21:23.489309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73765a-b6db-4dd3-bab6-c02af6048d79 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:23.489739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73765a-b6db-4dd3-bab6-c02af6048d79 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:23.489843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73765a-b6db-4dd3-bab6-c02af6048d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:23.509721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-da73765a-b6db-4dd3-bab6-c02af6048d79 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:21:23.510916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-da73765a-b6db-4dd3-bab6-c02af6048d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:21:23.518687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:21:23.810033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b0c4f-2ca4-4826-9f6e-99b553faacfd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:21:23.811714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-064b0c4f-2ca4-4826-9f6e-99b553faacfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:21:23.839483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:21:23.870557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b0c4f-2ca4-4826-9f6e-99b553faacfd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:21:23.874152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2af1a-1261-4072-b34a-a99f18c9c278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:21:23.874755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2af1a-1261-4072-b34a-a99f18c9c278 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:23.875031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2af1a-1261-4072-b34a-a99f18c9c278 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:23.875300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2af1a-1261-4072-b34a-a99f18c9c278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:23.884455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2af1a-1261-4072-b34a-a99f18c9c278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:21:23.885940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2af1a-1261-4072-b34a-a99f18c9c278 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:21:23.895616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 775/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:21:26.090616 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645494-68ba-4588-ba7e-84c7e07014e6 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:26.091195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645494-68ba-4588-ba7e-84c7e07014e6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:26.091195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645494-68ba-4588-ba7e-84c7e07014e6 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:26.092491 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:21:26.098312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf89a-fc00-4ffe-9e79-19e64099c4b5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:26.098760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf89a-fc00-4ffe-9e79-19e64099c4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:26.098869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf89a-fc00-4ffe-9e79-19e64099c4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:26.119069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ceacf89a-fc00-4ffe-9e79-19e64099c4b5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:21:26.120272 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ceacf89a-fc00-4ffe-9e79-19e64099c4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:21:26.128134 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:21:26.419167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645494-68ba-4588-ba7e-84c7e07014e6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:21:26.429885 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645494-68ba-4588-ba7e-84c7e07014e6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:21:26.433310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0db38-1c47-4b21-82ec-39008fc96909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:21:26.433893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0db38-1c47-4b21-82ec-39008fc96909 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:26.434166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0db38-1c47-4b21-82ec-39008fc96909 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:26.434437 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0db38-1c47-4b21-82ec-39008fc96909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:26.443129 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0db38-1c47-4b21-82ec-39008fc96909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:21:26.444569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0db38-1c47-4b21-82ec-39008fc96909 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:21:26.454419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 757/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:21:30.251713 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c154176-8bfc-4ca9-bf4d-c3dc1bcf712a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:30.252304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c154176-8bfc-4ca9-bf4d-c3dc1bcf712a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:30.252304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c154176-8bfc-4ca9-bf4d-c3dc1bcf712a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:30.254201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:21:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:21:30.259636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f856ad-3ba7-4379-9175-ec7701cff8f2 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:30.260032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f856ad-3ba7-4379-9175-ec7701cff8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:30.260188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f856ad-3ba7-4379-9175-ec7701cff8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:30.279392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-84f856ad-3ba7-4379-9175-ec7701cff8f2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:21:30.280593 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-84f856ad-3ba7-4379-9175-ec7701cff8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:21:30.288395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:21:30.594537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c154176-8bfc-4ca9-bf4d-c3dc1bcf712a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:21:30.596755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5c154176-8bfc-4ca9-bf4d-c3dc1bcf712a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:21:30.653446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c154176-8bfc-4ca9-bf4d-c3dc1bcf712a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:21:30.656958 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabe43a-6ae0-4923-ae4e-62ddd543452e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:21:30.657557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabe43a-6ae0-4923-ae4e-62ddd543452e service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:30.657835 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabe43a-6ae0-4923-ae4e-62ddd543452e service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:30.658110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabe43a-6ae0-4923-ae4e-62ddd543452e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:30.666824 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabe43a-6ae0-4923-ae4e-62ddd543452e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:21:30.668243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabe43a-6ae0-4923-ae4e-62ddd543452e service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:21:30.677500 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 778/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:21:32.870100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81687-5c2c-4900-8d3e-e8102765723d None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:32.870639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81687-5c2c-4900-8d3e-e8102765723d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:32.870639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81687-5c2c-4900-8d3e-e8102765723d None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:32.871903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 16:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:21:32.877371 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f38d5-5ff6-4c1c-9325-23f7bed33847 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:32.877796 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f38d5-5ff6-4c1c-9325-23f7bed33847 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:32.877926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f38d5-5ff6-4c1c-9325-23f7bed33847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:32.898873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c85f38d5-5ff6-4c1c-9325-23f7bed33847 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:21:32.900078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c85f38d5-5ff6-4c1c-9325-23f7bed33847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:21:32.909528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 16:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:21:33.253741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff81687-5c2c-4900-8d3e-e8102765723d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:21:33.255429 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-aff81687-5c2c-4900-8d3e-e8102765723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:21:33.268578 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff81687-5c2c-4900-8d3e-e8102765723d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:21:33.272222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d9815-b1bf-48e3-a129-0edb5ffc7067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:21:33.272840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d9815-b1bf-48e3-a129-0edb5ffc7067 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:21:33.273113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d9815-b1bf-48e3-a129-0edb5ffc7067 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:21:33.273381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d9815-b1bf-48e3-a129-0edb5ffc7067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:21:33.282373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d9815-b1bf-48e3-a129-0edb5ffc7067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:21:33.284434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d9815-b1bf-48e3-a129-0edb5ffc7067 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:21:33.294471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 760/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:21:42.893163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=47 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:21:43.290082 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=33 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:11.871094 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78facf3-9610-471c-b6bb-336be4bb7d8e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:11.872065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78facf3-9610-471c-b6bb-336be4bb7d8e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:11.872065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78facf3-9610-471c-b6bb-336be4bb7d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:11.922582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e78facf3-9610-471c-b6bb-336be4bb7d8e None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:11.924778 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e78facf3-9610-471c-b6bb-336be4bb7d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:11.943624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 780/1540] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:11.957851 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584d9f6-0608-4050-9452-9495d4c9de73 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:11.959731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584d9f6-0608-4050-9452-9495d4c9de73 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:11.960533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584d9f6-0608-4050-9452-9495d4c9de73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.029555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e584d9f6-0608-4050-9452-9495d4c9de73 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:12.032455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e584d9f6-0608-4050-9452-9495d4c9de73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:12.053949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 761/1541] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:23:12.062505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78facf3-9610-471c-b6bb-336be4bb7d8e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:12.123759 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78facf3-9610-471c-b6bb-336be4bb7d8e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:12.150198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6ce8b-b4d5-4484-b9eb-d5626dc7d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:12.151954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6ce8b-b4d5-4484-b9eb-d5626dc7d460 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.152979 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6ce8b-b4d5-4484-b9eb-d5626dc7d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.155295 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6ce8b-b4d5-4484-b9eb-d5626dc7d460 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.157042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6ce8b-b4d5-4484-b9eb-d5626dc7d460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:23:12.157971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6ce8b-b4d5-4484-b9eb-d5626dc7d460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:12.161571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6ce8b-b4d5-4484-b9eb-d5626dc7d460 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:12.192915 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 781/1542] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:23:12.207637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584d9f6-0608-4050-9452-9495d4c9de73 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:12.239103 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584d9f6-0608-4050-9452-9495d4c9de73 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:12.248296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5326f-3c51-4e07-b1a3-ad35abfa40f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:12.253166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5326f-3c51-4e07-b1a3-ad35abfa40f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.254289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5326f-3c51-4e07-b1a3-ad35abfa40f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.255320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5326f-3c51-4e07-b1a3-ad35abfa40f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.256870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5326f-3c51-4e07-b1a3-ad35abfa40f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:12.260588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5326f-3c51-4e07-b1a3-ad35abfa40f5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:12.329297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 762/1543] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:12 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:12.337008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6ce8b-b4d5-4484-b9eb-d5626dc7d460 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:12.359899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6ce8b-b4d5-4484-b9eb-d5626dc7d460 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:12.525134 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24ab9f-9bf6-4213-a729-36c4e6536764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:12.525780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24ab9f-9bf6-4213-a729-36c4e6536764 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.526071 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24ab9f-9bf6-4213-a729-36c4e6536764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.526343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24ab9f-9bf6-4213-a729-36c4e6536764 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.527001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24ab9f-9bf6-4213-a729-36c4e6536764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:12.529510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24ab9f-9bf6-4213-a729-36c4e6536764 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:12.568030 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 782/1544] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:12 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:23:12.575290 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5326f-3c51-4e07-b1a3-ad35abfa40f5 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:12.605243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5326f-3c51-4e07-b1a3-ad35abfa40f5 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:12.625601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ad395-96c3-47c1-acd2-b059a09265e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:12.627235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ad395-96c3-47c1-acd2-b059a09265e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.628096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ad395-96c3-47c1-acd2-b059a09265e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.628937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ad395-96c3-47c1-acd2-b059a09265e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.630514 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ad395-96c3-47c1-acd2-b059a09265e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:12.634462 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ad395-96c3-47c1-acd2-b059a09265e9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:12.650962 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a6cea-dfb0-4c92-be50-5e7940a2046f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.650962 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a6cea-dfb0-4c92-be50-5e7940a2046f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.651398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a6cea-dfb0-4c92-be50-5e7940a2046f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.665094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 763/1545] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:12.668024 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322a483-467e-4100-be10-68b9a9db7108 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.668983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322a483-467e-4100-be10-68b9a9db7108 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.670393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322a483-467e-4100-be10-68b9a9db7108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.706923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f05a6cea-dfb0-4c92-be50-5e7940a2046f None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:12.709095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f05a6cea-dfb0-4c92-be50-5e7940a2046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:12.713260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7322a483-467e-4100-be10-68b9a9db7108 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:12.716435 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7322a483-467e-4100-be10-68b9a9db7108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:12.738534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 764/1546] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:12.743402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963b198-c12b-45f2-982a-11aaa0ad8c43 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.746437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 783/1547] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:12.748153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963b198-c12b-45f2-982a-11aaa0ad8c43 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.750878 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963b198-c12b-45f2-982a-11aaa0ad8c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.751227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a6cea-dfb0-4c92-be50-5e7940a2046f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:12.771371 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a6cea-dfb0-4c92-be50-5e7940a2046f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:12.793546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a963b198-c12b-45f2-982a-11aaa0ad8c43 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:12.797466 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99ea64-c286-4bfa-a06e-d9646ab6a4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:12.799290 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a963b198-c12b-45f2-982a-11aaa0ad8c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:12.801937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99ea64-c286-4bfa-a06e-d9646ab6a4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.802279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99ea64-c286-4bfa-a06e-d9646ab6a4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.804951 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99ea64-c286-4bfa-a06e-d9646ab6a4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.804951 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99ea64-c286-4bfa-a06e-d9646ab6a4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:12.804951 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99ea64-c286-4bfa-a06e-d9646ab6a4d3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:12.824011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 784/1548] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:12.825469 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf523f17-e71c-4b42-aa01-4bba52d473dc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.825791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf523f17-e71c-4b42-aa01-4bba52d473dc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.826093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf523f17-e71c-4b42-aa01-4bba52d473dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.835755 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 765/1549] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:12.837954 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4206013-ebf9-4fab-a888-c770350f5b2d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.838453 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4206013-ebf9-4fab-a888-c770350f5b2d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.838900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4206013-ebf9-4fab-a888-c770350f5b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.859995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cf523f17-e71c-4b42-aa01-4bba52d473dc None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:12.861514 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cf523f17-e71c-4b42-aa01-4bba52d473dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:12.871505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 785/1550] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:12.879384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c4206013-ebf9-4fab-a888-c770350f5b2d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:12.880248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650476d-ed8d-4570-b405-61742c2fb871 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.880545 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650476d-ed8d-4570-b405-61742c2fb871 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.880847 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650476d-ed8d-4570-b405-61742c2fb871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.882328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c4206013-ebf9-4fab-a888-c770350f5b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:12.900139 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 766/1551] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:12.902945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221adf6-1d3b-4ea7-9b86-560ff865bef9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.903541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221adf6-1d3b-4ea7-9b86-560ff865bef9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.904145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221adf6-1d3b-4ea7-9b86-560ff865bef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.909137 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1650476d-ed8d-4570-b405-61742c2fb871 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:12.910391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1650476d-ed8d-4570-b405-61742c2fb871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:12.922982 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 786/1552] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:12.922982 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650476d-ed8d-4570-b405-61742c2fb871 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:12.930676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650476d-ed8d-4570-b405-61742c2fb871 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:12.936430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea66fc0-cfd0-471c-a98e-f8038610925d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:12.937391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea66fc0-cfd0-471c-a98e-f8038610925d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.937712 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea66fc0-cfd0-471c-a98e-f8038610925d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.937976 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea66fc0-cfd0-471c-a98e-f8038610925d admin admin] PATH_INFO: `/v3/projects/1fe4df2ded0c46c983c71b566ba4eb47/users/f30cfb57e19f45f9844de1cf7f932214/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.957289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea66fc0-cfd0-471c-a98e-f8038610925d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe4df2ded0c46c983c71b566ba4eb47, user_id=f30cfb57e19f45f9844de1cf7f932214, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:12.958762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-9ea66fc0-cfd0-471c-a98e-f8038610925d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:23:12.958762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 21 16:23:12.958762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: Sep 21 16:23:12.959735 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9221adf6-1d3b-4ea7-9b86-560ff865bef9 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:12.960751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea66fc0-cfd0-471c-a98e-f8038610925d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:12.962079 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9221adf6-1d3b-4ea7-9b86-560ff865bef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:12.978405 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 767/1553] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:12.980528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e59702-f5c6-4bc9-944d-3a72fb38530b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.981157 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e59702-f5c6-4bc9-944d-3a72fb38530b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.982304 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e59702-f5c6-4bc9-944d-3a72fb38530b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:12.984900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 787/1554] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:12 2022] PUT /identity/v3/projects/1fe4df2ded0c46c983c71b566ba4eb47/users/f30cfb57e19f45f9844de1cf7f932214/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:12.986734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb8a0d-871d-4036-83d6-02d6b664a4ef None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:12.988283 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb8a0d-871d-4036-83d6-02d6b664a4ef None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:12.988936 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb8a0d-871d-4036-83d6-02d6b664a4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.015018 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-75e59702-f5c6-4bc9-944d-3a72fb38530b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:13.015287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cccb8a0d-871d-4036-83d6-02d6b664a4ef None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:13.016299 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cccb8a0d-871d-4036-83d6-02d6b664a4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:13.016415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-75e59702-f5c6-4bc9-944d-3a72fb38530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:13.089351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 788/1555] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:13.090028 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 768/1556] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:13.090714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbbd1b-a199-4db0-84e3-1760c19af67b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.091588 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbbd1b-a199-4db0-84e3-1760c19af67b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.091771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e59702-f5c6-4bc9-944d-3a72fb38530b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.091915 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbbd1b-a199-4db0-84e3-1760c19af67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.104677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e59702-f5c6-4bc9-944d-3a72fb38530b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.111005 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a732d9-ad1b-46c4-96a2-99401b8e5195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.111641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a732d9-ad1b-46c4-96a2-99401b8e5195 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.111921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a732d9-ad1b-46c4-96a2-99401b8e5195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.112193 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a732d9-ad1b-46c4-96a2-99401b8e5195 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.112890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a732d9-ad1b-46c4-96a2-99401b8e5195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:23:13.113195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a732d9-ad1b-46c4-96a2-99401b8e5195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.114252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: WARNING py.warnings [None req-93a732d9-ad1b-46c4-96a2-99401b8e5195 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:23:13.114252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: warnings.warn(msg) Sep 21 16:23:13.114252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: Sep 21 16:23:13.114924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-97bbbd1b-a199-4db0-84e3-1760c19af67b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:13.115167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a732d9-ad1b-46c4-96a2-99401b8e5195 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.116180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-97bbbd1b-a199-4db0-84e3-1760c19af67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:13.125448 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 789/1557] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:13.126684 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbbd1b-a199-4db0-84e3-1760c19af67b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.134223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 769/1558] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:23:13.135906 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7fb18-3d94-471a-a09b-9336cfc83dfc None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.137037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7fb18-3d94-471a-a09b-9336cfc83dfc None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.137530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7fb18-3d94-471a-a09b-9336cfc83dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.142501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbbd1b-a199-4db0-84e3-1760c19af67b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.147235 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652564fc-ac21-4f76-abd8-b5ec25f90b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.147863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652564fc-ac21-4f76-abd8-b5ec25f90b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.148138 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652564fc-ac21-4f76-abd8-b5ec25f90b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.148407 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652564fc-ac21-4f76-abd8-b5ec25f90b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.149362 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652564fc-ac21-4f76-abd8-b5ec25f90b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:23:13.149715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652564fc-ac21-4f76-abd8-b5ec25f90b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.152566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652564fc-ac21-4f76-abd8-b5ec25f90b78 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.156130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:13.163291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-00a7fb18-3d94-471a-a09b-9336cfc83dfc None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:13.164635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-00a7fb18-3d94-471a-a09b-9336cfc83dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:13.176943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 790/1559] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:23:13.176943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ae5e5-76ad-4881-b293-ef8b8308ecbe None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.176943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ae5e5-76ad-4881-b293-ef8b8308ecbe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.176943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ae5e5-76ad-4881-b293-ef8b8308ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.187449 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 770/1560] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:13.187449 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfc090-a893-43e4-a185-52c38c45271f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.187449 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfc090-a893-43e4-a185-52c38c45271f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.187449 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfc090-a893-43e4-a185-52c38c45271f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.202048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2b6ae5e5-76ad-4881-b293-ef8b8308ecbe None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:13.203297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2b6ae5e5-76ad-4881-b293-ef8b8308ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:13.212083 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 791/1561] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:13.213059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ae5e5-76ad-4881-b293-ef8b8308ecbe None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.220706 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a2cfc090-a893-43e4-a185-52c38c45271f None None] MFA Rules not processed for user `f30cfb57e19f45f9844de1cf7f932214`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:13.221975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a2cfc090-a893-43e4-a185-52c38c45271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:13.223680 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ae5e5-76ad-4881-b293-ef8b8308ecbe None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.229330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075e18c-ec74-492c-b164-6a887922c36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.229874 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e18c-ec74-492c-b164-6a887922c36b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.230325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e18c-ec74-492c-b164-6a887922c36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.230601 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e18c-ec74-492c-b164-6a887922c36b admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.231272 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075e18c-ec74-492c-b164-6a887922c36b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:23:13.231574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075e18c-ec74-492c-b164-6a887922c36b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.233802 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075e18c-ec74-492c-b164-6a887922c36b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.247104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 792/1562] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:23:13.248057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075e18c-ec74-492c-b164-6a887922c36b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.259400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075e18c-ec74-492c-b164-6a887922c36b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.264460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e8e8b-38ba-4b1b-90d7-936c536355cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.265139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e8e8b-38ba-4b1b-90d7-936c536355cb admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.265411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e8e8b-38ba-4b1b-90d7-936c536355cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.265682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e8e8b-38ba-4b1b-90d7-936c536355cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.266349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e8e8b-38ba-4b1b-90d7-936c536355cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:23:13.266663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e8e8b-38ba-4b1b-90d7-936c536355cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.268303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e8e8b-38ba-4b1b-90d7-936c536355cb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.283021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 793/1563] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:23:13.284168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d561a-e44b-4965-b8ce-5b4f0768e237 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.284392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d561a-e44b-4965-b8ce-5b4f0768e237 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.284659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d561a-e44b-4965-b8ce-5b4f0768e237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.306682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a18d561a-e44b-4965-b8ce-5b4f0768e237 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:13.307754 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 771/1564] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:13.307947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a18d561a-e44b-4965-b8ce-5b4f0768e237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:13.308605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfc090-a893-43e4-a185-52c38c45271f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.316507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:13.316814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 794/1565] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:13.321361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d561a-e44b-4965-b8ce-5b4f0768e237 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.322568 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfc090-a893-43e4-a185-52c38c45271f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.329863 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70573a33-b3bb-4ccd-b532-4c8b8386defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.330618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70573a33-b3bb-4ccd-b532-4c8b8386defe admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.330826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70573a33-b3bb-4ccd-b532-4c8b8386defe admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.331337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70573a33-b3bb-4ccd-b532-4c8b8386defe admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.332018 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70573a33-b3bb-4ccd-b532-4c8b8386defe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.332535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d561a-e44b-4965-b8ce-5b4f0768e237 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.334367 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70573a33-b3bb-4ccd-b532-4c8b8386defe admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.337728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ebd97-d4e9-4183-a153-373aa95a01c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.338385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ebd97-d4e9-4183-a153-373aa95a01c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.338663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ebd97-d4e9-4183-a153-373aa95a01c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.338932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ebd97-d4e9-4183-a153-373aa95a01c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.339576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ebd97-d4e9-4183-a153-373aa95a01c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.340607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-d54ebd97-d4e9-4183-a153-373aa95a01c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:23:13.340607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 21 16:23:13.340607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: Sep 21 16:23:13.342449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ebd97-d4e9-4183-a153-373aa95a01c9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.366915 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 772/1566] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:13.368430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fca17-3c7c-433b-9636-35114bbe57dc None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.368777 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fca17-3c7c-433b-9636-35114bbe57dc None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.368994 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fca17-3c7c-433b-9636-35114bbe57dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.375034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 795/1567] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:13.375910 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ebd97-d4e9-4183-a153-373aa95a01c9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.396131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-547fca17-3c7c-433b-9636-35114bbe57dc None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:13.397420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-547fca17-3c7c-433b-9636-35114bbe57dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:13.457450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ebd97-d4e9-4183-a153-373aa95a01c9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.462808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a5bfe-4b48-46d9-a72c-0ec2f2600bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.463480 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a5bfe-4b48-46d9-a72c-0ec2f2600bea admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.463759 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a5bfe-4b48-46d9-a72c-0ec2f2600bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.464058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a5bfe-4b48-46d9-a72c-0ec2f2600bea admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.464748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a5bfe-4b48-46d9-a72c-0ec2f2600bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:23:13.465053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a5bfe-4b48-46d9-a72c-0ec2f2600bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.467297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a5bfe-4b48-46d9-a72c-0ec2f2600bea admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.478325 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 773/1568] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:13.479287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fca17-3c7c-433b-9636-35114bbe57dc None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.480343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 796/1569] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:23:13.481002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a5bfe-4b48-46d9-a72c-0ec2f2600bea admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.495580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fca17-3c7c-433b-9636-35114bbe57dc None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.495906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a5bfe-4b48-46d9-a72c-0ec2f2600bea admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.500858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a01a1-8264-431d-999a-b37b5b7bd8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.501132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28402407-1858-47ee-b763-180a40658a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.501573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a01a1-8264-431d-999a-b37b5b7bd8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.501776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28402407-1858-47ee-b763-180a40658a93 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.501890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a01a1-8264-431d-999a-b37b5b7bd8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.502069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28402407-1858-47ee-b763-180a40658a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.502184 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a01a1-8264-431d-999a-b37b5b7bd8a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.502274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28402407-1858-47ee-b763-180a40658a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.502753 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a01a1-8264-431d-999a-b37b5b7bd8a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.502955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28402407-1858-47ee-b763-180a40658a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.504766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a01a1-8264-431d-999a-b37b5b7bd8a9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.504935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28402407-1858-47ee-b763-180a40658a93 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.540941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 774/1570] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/projects => generated 405 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:13.541235 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 797/1571] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:13.541378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a01a1-8264-431d-999a-b37b5b7bd8a9 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.541513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28402407-1858-47ee-b763-180a40658a93 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.615711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a01a1-8264-431d-999a-b37b5b7bd8a9 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.618293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28402407-1858-47ee-b763-180a40658a93 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.620923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2098-e428-43ea-b271-a47ee0cdb995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.621556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2098-e428-43ea-b271-a47ee0cdb995 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.621833 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2098-e428-43ea-b271-a47ee0cdb995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.622114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2098-e428-43ea-b271-a47ee0cdb995 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.622788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff2098-e428-43ea-b271-a47ee0cdb995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.624061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a6781-e81e-432f-aee0-c0a45944ff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.624842 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff2098-e428-43ea-b271-a47ee0cdb995 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.625050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6781-e81e-432f-aee0-c0a45944ff33 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.625323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6781-e81e-432f-aee0-c0a45944ff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.625698 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6781-e81e-432f-aee0-c0a45944ff33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.626471 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a6781-e81e-432f-aee0-c0a45944ff33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:23:13.626947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a6781-e81e-432f-aee0-c0a45944ff33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.628939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a6781-e81e-432f-aee0-c0a45944ff33 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.645880 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:13.649554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 798/1572] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:23:13.650495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a6781-e81e-432f-aee0-c0a45944ff33 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.663522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a6781-e81e-432f-aee0-c0a45944ff33 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.666488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 775/1573] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:13.667359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2098-e428-43ea-b271-a47ee0cdb995 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.673041 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b9d09-e614-4cf2-8c71-0fb072582035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.673670 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9d09-e614-4cf2-8c71-0fb072582035 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.673948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9d09-e614-4cf2-8c71-0fb072582035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.674221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9d09-e614-4cf2-8c71-0fb072582035 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.674911 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b9d09-e614-4cf2-8c71-0fb072582035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.676979 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b9d09-e614-4cf2-8c71-0fb072582035 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.706487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 799/1574] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/users => generated 293 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:13.708040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b9d09-e614-4cf2-8c71-0fb072582035 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.725588 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b9d09-e614-4cf2-8c71-0fb072582035 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.758115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:13.777394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2098-e428-43ea-b271-a47ee0cdb995 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.783531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416ebda-b3a7-4edd-a151-6e38ff36e4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.784674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416ebda-b3a7-4edd-a151-6e38ff36e4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.785194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416ebda-b3a7-4edd-a151-6e38ff36e4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.785642 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416ebda-b3a7-4edd-a151-6e38ff36e4d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.786628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416ebda-b3a7-4edd-a151-6e38ff36e4d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.788401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: WARNING py.warnings [None req-0416ebda-b3a7-4edd-a151-6e38ff36e4d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:23:13.788401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: warnings.warn(msg) Sep 21 16:23:13.788401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: Sep 21 16:23:13.790804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416ebda-b3a7-4edd-a151-6e38ff36e4d2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.800101 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc1f84-898b-4fa6-a9ab-3d65492b4af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.801129 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc1f84-898b-4fa6-a9ab-3d65492b4af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.801606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc1f84-898b-4fa6-a9ab-3d65492b4af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.802064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc1f84-898b-4fa6-a9ab-3d65492b4af1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.803163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc1f84-898b-4fa6-a9ab-3d65492b4af1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:23:13.803948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc1f84-898b-4fa6-a9ab-3d65492b4af1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.808023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc1f84-898b-4fa6-a9ab-3d65492b4af1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.824084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 776/1575] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:13.826689 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416ebda-b3a7-4edd-a151-6e38ff36e4d2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.839168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 800/1576] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:23:13.839168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc1f84-898b-4fa6-a9ab-3d65492b4af1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.846945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416ebda-b3a7-4edd-a151-6e38ff36e4d2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.848280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc1f84-898b-4fa6-a9ab-3d65492b4af1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.854614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a6ca5-1af9-4a9d-b08d-008bdeba0551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.855586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6ca5-1af9-4a9d-b08d-008bdeba0551 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.855741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19681f3-1d4f-44dd-8a50-aaff23641303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.856037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6ca5-1af9-4a9d-b08d-008bdeba0551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.856554 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6ca5-1af9-4a9d-b08d-008bdeba0551 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.856733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19681f3-1d4f-44dd-8a50-aaff23641303 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.857113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19681f3-1d4f-44dd-8a50-aaff23641303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.857587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19681f3-1d4f-44dd-8a50-aaff23641303 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.857750 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a6ca5-1af9-4a9d-b08d-008bdeba0551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.858662 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19681f3-1d4f-44dd-8a50-aaff23641303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:13.861277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a6ca5-1af9-4a9d-b08d-008bdeba0551 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.862134 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19681f3-1d4f-44dd-8a50-aaff23641303 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:13.896201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 801/1577] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/users => generated 303 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:13.901568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19681f3-1d4f-44dd-8a50-aaff23641303 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.910136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 777/1578] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:13.911959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a6ca5-1af9-4a9d-b08d-008bdeba0551 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:13.915418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19681f3-1d4f-44dd-8a50-aaff23641303 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:13.995406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a23f3-e6a9-428c-8733-8244709b8c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:13.996204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a23f3-e6a9-428c-8733-8244709b8c92 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:13.996620 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a23f3-e6a9-428c-8733-8244709b8c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:13.997067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a23f3-e6a9-428c-8733-8244709b8c92 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:13.998556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a23f3-e6a9-428c-8733-8244709b8c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.000924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a23f3-e6a9-428c-8733-8244709b8c92 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.003638 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a6ca5-1af9-4a9d-b08d-008bdeba0551 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.010273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb81d7-b569-4bb2-bb83-c30374962a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.010897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb81d7-b569-4bb2-bb83-c30374962a62 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.011295 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb81d7-b569-4bb2-bb83-c30374962a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.011686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb81d7-b569-4bb2-bb83-c30374962a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.012497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb81d7-b569-4bb2-bb83-c30374962a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.016315 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb81d7-b569-4bb2-bb83-c30374962a62 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.032154 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 802/1579] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:14.033801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a23f3-e6a9-428c-8733-8244709b8c92 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.052597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 778/1580] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:13 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:14.053105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a23f3-e6a9-428c-8733-8244709b8c92 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.053818 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb81d7-b569-4bb2-bb83-c30374962a62 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.135507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:14.135847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb81d7-b569-4bb2-bb83-c30374962a62 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.142578 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a63b1-3e8c-4dec-b074-f10b4e500749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.143327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a63b1-3e8c-4dec-b074-f10b4e500749 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.143850 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a63b1-3e8c-4dec-b074-f10b4e500749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.144292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a63b1-3e8c-4dec-b074-f10b4e500749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.145203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a63b1-3e8c-4dec-b074-f10b4e500749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.146875 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a63b1-3e8c-4dec-b074-f10b4e500749 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.158610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 779/1581] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:14.159314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a63b1-3e8c-4dec-b074-f10b4e500749 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.160654 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f717a2-7aee-40c9-94f3-7bf62e6f760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.161732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f717a2-7aee-40c9-94f3-7bf62e6f760d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.162192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f717a2-7aee-40c9-94f3-7bf62e6f760d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.162956 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f717a2-7aee-40c9-94f3-7bf62e6f760d admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.164232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f717a2-7aee-40c9-94f3-7bf62e6f760d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.168131 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f717a2-7aee-40c9-94f3-7bf62e6f760d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.170636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a63b1-3e8c-4dec-b074-f10b4e500749 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.175834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af0b0f-26af-42ad-b539-eb56b69cc083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.176471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af0b0f-26af-42ad-b539-eb56b69cc083 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.176788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af0b0f-26af-42ad-b539-eb56b69cc083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.177067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af0b0f-26af-42ad-b539-eb56b69cc083 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.177725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af0b0f-26af-42ad-b539-eb56b69cc083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.179409 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af0b0f-26af-42ad-b539-eb56b69cc083 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.192301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 780/1582] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:14.193189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af0b0f-26af-42ad-b539-eb56b69cc083 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.203495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 803/1583] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:14 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:14.204147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af0b0f-26af-42ad-b539-eb56b69cc083 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.204942 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f717a2-7aee-40c9-94f3-7bf62e6f760d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.209983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa92057-9b01-4bae-821f-f657697260b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.210692 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92057-9b01-4bae-821f-f657697260b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.211007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92057-9b01-4bae-821f-f657697260b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.211282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92057-9b01-4bae-821f-f657697260b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.211967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa92057-9b01-4bae-821f-f657697260b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.213989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa92057-9b01-4bae-821f-f657697260b5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.218591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f717a2-7aee-40c9-94f3-7bf62e6f760d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.226501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b59b5-dbbf-4bf5-909f-70174ad381ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.227609 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b59b5-dbbf-4bf5-909f-70174ad381ac admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.228197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b59b5-dbbf-4bf5-909f-70174ad381ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.228846 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b59b5-dbbf-4bf5-909f-70174ad381ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.230213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b59b5-dbbf-4bf5-909f-70174ad381ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.234440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b59b5-dbbf-4bf5-909f-70174ad381ac admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.248369 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 781/1584] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:14 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:14.249910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa92057-9b01-4bae-821f-f657697260b5 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.252606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 804/1585] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:14.253482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b59b5-dbbf-4bf5-909f-70174ad381ac admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.261135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:14.266478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b59b5-dbbf-4bf5-909f-70174ad381ac admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.339148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae512b-b975-4ad8-ba50-3adc6eae6462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.339779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae512b-b975-4ad8-ba50-3adc6eae6462 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.340063 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae512b-b975-4ad8-ba50-3adc6eae6462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.340362 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae512b-b975-4ad8-ba50-3adc6eae6462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.341103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae512b-b975-4ad8-ba50-3adc6eae6462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.343526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae512b-b975-4ad8-ba50-3adc6eae6462 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.350030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa92057-9b01-4bae-821f-f657697260b5 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.354024 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 805/1586] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:14.354910 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae512b-b975-4ad8-ba50-3adc6eae6462 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.358722 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a61be-c618-49de-bd3a-0051953332ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.359761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a61be-c618-49de-bd3a-0051953332ba admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.360256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a61be-c618-49de-bd3a-0051953332ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.360745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a61be-c618-49de-bd3a-0051953332ba admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.361894 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a61be-c618-49de-bd3a-0051953332ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.364027 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a61be-c618-49de-bd3a-0051953332ba admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.366478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae512b-b975-4ad8-ba50-3adc6eae6462 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.371612 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b578fe-685e-4934-a409-c892cc9756c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.373369 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b578fe-685e-4934-a409-c892cc9756c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.373700 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b578fe-685e-4934-a409-c892cc9756c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.374106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b578fe-685e-4934-a409-c892cc9756c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.375547 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b578fe-685e-4934-a409-c892cc9756c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.378267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b578fe-685e-4934-a409-c892cc9756c8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.393873 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 782/1587] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:14 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:14.393873 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a61be-c618-49de-bd3a-0051953332ba admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.402651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a61be-c618-49de-bd3a-0051953332ba admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.410039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4351c02-ead6-4f2c-908d-def48301bea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.411049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4351c02-ead6-4f2c-908d-def48301bea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.411490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4351c02-ead6-4f2c-908d-def48301bea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.411920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4351c02-ead6-4f2c-908d-def48301bea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.413083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4351c02-ead6-4f2c-908d-def48301bea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.415726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 806/1588] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:14 2022] POST /identity/v3/users => generated 289 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:14.416162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4351c02-ead6-4f2c-908d-def48301bea3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.416594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b578fe-685e-4934-a409-c892cc9756c8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.428156 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b578fe-685e-4934-a409-c892cc9756c8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.433563 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e2150-fb0e-4c2c-a24e-a11765c3a011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.434195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e2150-fb0e-4c2c-a24e-a11765c3a011 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.434475 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e2150-fb0e-4c2c-a24e-a11765c3a011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.434813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e2150-fb0e-4c2c-a24e-a11765c3a011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.436279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e2150-fb0e-4c2c-a24e-a11765c3a011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.437052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 783/1589] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:14.437966 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e2150-fb0e-4c2c-a24e-a11765c3a011 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.438427 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4351c02-ead6-4f2c-908d-def48301bea3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.456977 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4351c02-ead6-4f2c-908d-def48301bea3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.458241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 807/1590] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:14.463557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e2150-fb0e-4c2c-a24e-a11765c3a011 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.464772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795767ee-f5b5-4f15-8947-dee1116ab4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.465527 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795767ee-f5b5-4f15-8947-dee1116ab4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.466539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795767ee-f5b5-4f15-8947-dee1116ab4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.466972 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795767ee-f5b5-4f15-8947-dee1116ab4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.467737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795767ee-f5b5-4f15-8947-dee1116ab4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.469855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795767ee-f5b5-4f15-8947-dee1116ab4c3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.477861 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e2150-fb0e-4c2c-a24e-a11765c3a011 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.489370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 784/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:14.489625 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb235715-b642-48fc-beb9-e73fd84d40dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.489792 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795767ee-f5b5-4f15-8947-dee1116ab4c3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.489938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb235715-b642-48fc-beb9-e73fd84d40dc admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.489938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb235715-b642-48fc-beb9-e73fd84d40dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.489938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb235715-b642-48fc-beb9-e73fd84d40dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.489938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb235715-b642-48fc-beb9-e73fd84d40dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.491119 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb235715-b642-48fc-beb9-e73fd84d40dc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.506767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795767ee-f5b5-4f15-8947-dee1116ab4c3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.510943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 808/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:14.512503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb235715-b642-48fc-beb9-e73fd84d40dc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.515062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccab96d-e667-48ec-836d-046798bb1948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.516053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccab96d-e667-48ec-836d-046798bb1948 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.516512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccab96d-e667-48ec-836d-046798bb1948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.517039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccab96d-e667-48ec-836d-046798bb1948 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.518120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccab96d-e667-48ec-836d-046798bb1948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.521650 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccab96d-e667-48ec-836d-046798bb1948 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.528215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb235715-b642-48fc-beb9-e73fd84d40dc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.536504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b526b1-f441-4e0f-9ac8-3098639d7258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.537596 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b526b1-f441-4e0f-9ac8-3098639d7258 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.538149 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b526b1-f441-4e0f-9ac8-3098639d7258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.538924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b526b1-f441-4e0f-9ac8-3098639d7258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.539785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b526b1-f441-4e0f-9ac8-3098639d7258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.542200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b526b1-f441-4e0f-9ac8-3098639d7258 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.557884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 785/1593] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:14 2022] POST /identity/v3/users => generated 288 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:14.557884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccab96d-e667-48ec-836d-046798bb1948 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.563408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 809/1594] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:14.563408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b526b1-f441-4e0f-9ac8-3098639d7258 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.572459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccab96d-e667-48ec-836d-046798bb1948 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.577824 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b526b1-f441-4e0f-9ac8-3098639d7258 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.580186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccd162-962a-40c3-8cee-ffa2ee0a08ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.581212 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccd162-962a-40c3-8cee-ffa2ee0a08ba admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.581677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccd162-962a-40c3-8cee-ffa2ee0a08ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.582141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccd162-962a-40c3-8cee-ffa2ee0a08ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.583252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccd162-962a-40c3-8cee-ffa2ee0a08ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.585611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97501bd-747f-45f2-b0f3-0b685dd4e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.586422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccd162-962a-40c3-8cee-ffa2ee0a08ba admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.586576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97501bd-747f-45f2-b0f3-0b685dd4e0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.586994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97501bd-747f-45f2-b0f3-0b685dd4e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.587433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97501bd-747f-45f2-b0f3-0b685dd4e0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.588492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97501bd-747f-45f2-b0f3-0b685dd4e0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.591830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97501bd-747f-45f2-b0f3-0b685dd4e0f3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.612279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 786/1595] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:14.612279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccd162-962a-40c3-8cee-ffa2ee0a08ba admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.612837 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 810/1596] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:14.614555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97501bd-747f-45f2-b0f3-0b685dd4e0f3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.634941 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97501bd-747f-45f2-b0f3-0b685dd4e0f3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.635208 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccd162-962a-40c3-8cee-ffa2ee0a08ba admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.641847 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073537c-64cc-437f-9918-0841a1f956a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.642231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164eed2-4a0c-4995-bb9a-20dbbf9e4067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.642603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073537c-64cc-437f-9918-0841a1f956a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.642862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073537c-64cc-437f-9918-0841a1f956a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.643113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073537c-64cc-437f-9918-0841a1f956a5 admin admin] PATH_INFO: `/v3/projects/e2b751f170bd4338af1e007f82c9387f/users/b3659c5ec73d4e30b6ba66db1c620609/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.643452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164eed2-4a0c-4995-bb9a-20dbbf9e4067 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.643956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164eed2-4a0c-4995-bb9a-20dbbf9e4067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.644546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164eed2-4a0c-4995-bb9a-20dbbf9e4067 admin admin] PATH_INFO: `/v3/projects/14ffc5ee9226418593622144543ef3be/users/6c29148bc7c74309863349e094d11bc2/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.663823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164eed2-4a0c-4995-bb9a-20dbbf9e4067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ffc5ee9226418593622144543ef3be, user_id=6c29148bc7c74309863349e094d11bc2, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.664319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073537c-64cc-437f-9918-0841a1f956a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b751f170bd4338af1e007f82c9387f, user_id=b3659c5ec73d4e30b6ba66db1c620609, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.666770 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164eed2-4a0c-4995-bb9a-20dbbf9e4067 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.670592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073537c-64cc-437f-9918-0841a1f956a5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.685285 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 787/1597] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:14 2022] PUT /identity/v3/projects/14ffc5ee9226418593622144543ef3be/users/6c29148bc7c74309863349e094d11bc2/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:14.697119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164eed2-4a0c-4995-bb9a-20dbbf9e4067 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.700948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 811/1598] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:14 2022] PUT /identity/v3/projects/e2b751f170bd4338af1e007f82c9387f/users/b3659c5ec73d4e30b6ba66db1c620609/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:14.703131 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073537c-64cc-437f-9918-0841a1f956a5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.769027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:14.771606 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164eed2-4a0c-4995-bb9a-20dbbf9e4067 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.799923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:14.802267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073537c-64cc-437f-9918-0841a1f956a5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.809001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b1f72-8c7e-4c1b-bfe3-58166f372219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.810626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b1f72-8c7e-4c1b-bfe3-58166f372219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.811112 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b1f72-8c7e-4c1b-bfe3-58166f372219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.811475 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b1f72-8c7e-4c1b-bfe3-58166f372219 admin admin] PATH_INFO: `/v3/projects/03a5dd95f9e74d02a82001d80fb24288/users/5e5f2116d43b46ecb395bb4128111c67/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.832800 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b1f72-8c7e-4c1b-bfe3-58166f372219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a5dd95f9e74d02a82001d80fb24288, user_id=5e5f2116d43b46ecb395bb4128111c67, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.836522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b1f72-8c7e-4c1b-bfe3-58166f372219 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.854295 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04684551-05a5-4eaa-a5b7-8bbf548a4055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.855120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04684551-05a5-4eaa-a5b7-8bbf548a4055 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.855467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04684551-05a5-4eaa-a5b7-8bbf548a4055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.855803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04684551-05a5-4eaa-a5b7-8bbf548a4055 admin admin] PATH_INFO: `/v3/projects/0e2ad930d9664966944c2f9edd04906d/users/12b5ca6922e54e64a24d6671df012237/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:14.856132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 812/1599] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:14 2022] PUT /identity/v3/projects/03a5dd95f9e74d02a82001d80fb24288/users/5e5f2116d43b46ecb395bb4128111c67/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:14.857453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b1f72-8c7e-4c1b-bfe3-58166f372219 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.887295 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04684551-05a5-4eaa-a5b7-8bbf548a4055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2ad930d9664966944c2f9edd04906d, user_id=12b5ca6922e54e64a24d6671df012237, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:14.891611 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04684551-05a5-4eaa-a5b7-8bbf548a4055 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:14.910670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 788/1600] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:14 2022] PUT /identity/v3/projects/0e2ad930d9664966944c2f9edd04906d/users/12b5ca6922e54e64a24d6671df012237/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:14.911520 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04684551-05a5-4eaa-a5b7-8bbf548a4055 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:14.961519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b1f72-8c7e-4c1b-bfe3-58166f372219 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.983932 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04684551-05a5-4eaa-a5b7-8bbf548a4055 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:14.989571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77e4b7-7b97-4728-a0f9-6fa8eaa74eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:14.990259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77e4b7-7b97-4728-a0f9-6fa8eaa74eba admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:14.990539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77e4b7-7b97-4728-a0f9-6fa8eaa74eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:14.990818 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77e4b7-7b97-4728-a0f9-6fa8eaa74eba admin admin] PATH_INFO: `/v3/projects/e000d6b64cdc45a0bd071905e4aafc30/users/d6b48a9e72564cefb5a4865d944a9a5e/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.011677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77e4b7-7b97-4728-a0f9-6fa8eaa74eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e000d6b64cdc45a0bd071905e4aafc30, user_id=d6b48a9e72564cefb5a4865d944a9a5e, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:15.018091 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77e4b7-7b97-4728-a0f9-6fa8eaa74eba admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:15.040169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 789/1601] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:14 2022] PUT /identity/v3/projects/e000d6b64cdc45a0bd071905e4aafc30/users/d6b48a9e72564cefb5a4865d944a9a5e/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:15.041301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77e4b7-7b97-4728-a0f9-6fa8eaa74eba admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:15.049302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e11491-7c3e-4ffe-a5d9-2bf958232635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:15.050241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e11491-7c3e-4ffe-a5d9-2bf958232635 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.050615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e11491-7c3e-4ffe-a5d9-2bf958232635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.051006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e11491-7c3e-4ffe-a5d9-2bf958232635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.051807 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e11491-7c3e-4ffe-a5d9-2bf958232635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:15.053830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e11491-7c3e-4ffe-a5d9-2bf958232635 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:15.071651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 813/1602] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:15.073164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e11491-7c3e-4ffe-a5d9-2bf958232635 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:15.088111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e11491-7c3e-4ffe-a5d9-2bf958232635 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:15.156166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77e4b7-7b97-4728-a0f9-6fa8eaa74eba admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:15.163548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a7aa1-25c4-4c07-9b06-0e3828e9aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:15.164512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a7aa1-25c4-4c07-9b06-0e3828e9aa98 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.164997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a7aa1-25c4-4c07-9b06-0e3828e9aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.165435 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a7aa1-25c4-4c07-9b06-0e3828e9aa98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.166548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a7aa1-25c4-4c07-9b06-0e3828e9aa98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:15.169708 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a7aa1-25c4-4c07-9b06-0e3828e9aa98 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:15.191952 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 790/1603] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:15.192264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49199c6-572b-4d6a-9fc5-0498ba944476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:15.192446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161fe21-aab7-4704-9910-4cf6a043afd3 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.192446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161fe21-aab7-4704-9910-4cf6a043afd3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.192874 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49199c6-572b-4d6a-9fc5-0498ba944476 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.193037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161fe21-aab7-4704-9910-4cf6a043afd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.193200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49199c6-572b-4d6a-9fc5-0498ba944476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.193200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49199c6-572b-4d6a-9fc5-0498ba944476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.193200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49199c6-572b-4d6a-9fc5-0498ba944476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:15.196129 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49199c6-572b-4d6a-9fc5-0498ba944476 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:15.206335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:15.224539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 814/1604] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:15.224539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567ffcc-f6fb-42fe-bfc3-fcea056e3188 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.224539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567ffcc-f6fb-42fe-bfc3-fcea056e3188 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.224539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567ffcc-f6fb-42fe-bfc3-fcea056e3188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.233816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0161fe21-aab7-4704-9910-4cf6a043afd3 None None] MFA Rules not processed for user `6c29148bc7c74309863349e094d11bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:15.235562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0161fe21-aab7-4704-9910-4cf6a043afd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:15.254915 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:15.261635 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7567ffcc-f6fb-42fe-bfc3-fcea056e3188 None None] MFA Rules not processed for user `b3659c5ec73d4e30b6ba66db1c620609`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:15.263856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7567ffcc-f6fb-42fe-bfc3-fcea056e3188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:15.326975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 791/1605] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:15.329848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475e8a1-d3fc-42a0-b699-29665f9bd9af None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.330448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475e8a1-d3fc-42a0-b699-29665f9bd9af None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.330804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475e8a1-d3fc-42a0-b699-29665f9bd9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.356923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 815/1606] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:15.359488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567ffcc-f6fb-42fe-bfc3-fcea056e3188 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:15.379566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567ffcc-f6fb-42fe-bfc3-fcea056e3188 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:15.384103 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b475e8a1-d3fc-42a0-b699-29665f9bd9af None None] MFA Rules not processed for user `5e5f2116d43b46ecb395bb4128111c67`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:15.386457 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b475e8a1-d3fc-42a0-b699-29665f9bd9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:15.389710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c84d6b-7b42-4cb7-a5b9-a94a17f9b230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:15.390945 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c84d6b-7b42-4cb7-a5b9-a94a17f9b230 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.391697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c84d6b-7b42-4cb7-a5b9-a94a17f9b230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.392261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c84d6b-7b42-4cb7-a5b9-a94a17f9b230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.393699 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c84d6b-7b42-4cb7-a5b9-a94a17f9b230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:15.396277 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c84d6b-7b42-4cb7-a5b9-a94a17f9b230 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:15.408098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 816/1607] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:15.409498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f136c-8b4e-4ef7-9fd2-fa8d7c205b0d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.409890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f136c-8b4e-4ef7-9fd2-fa8d7c205b0d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.410169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f136c-8b4e-4ef7-9fd2-fa8d7c205b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.431626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-353f136c-8b4e-4ef7-9fd2-fa8d7c205b0d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:15.433111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-353f136c-8b4e-4ef7-9fd2-fa8d7c205b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:15.448097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 817/1608] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:15.449317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f136c-8b4e-4ef7-9fd2-fa8d7c205b0d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:15.469414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f136c-8b4e-4ef7-9fd2-fa8d7c205b0d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:15.478744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364161b8-e10e-4970-8f36-9b97c95b4544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:15.479446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364161b8-e10e-4970-8f36-9b97c95b4544 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.479723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364161b8-e10e-4970-8f36-9b97c95b4544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.479987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364161b8-e10e-4970-8f36-9b97c95b4544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.480653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364161b8-e10e-4970-8f36-9b97c95b4544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:15.482378 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364161b8-e10e-4970-8f36-9b97c95b4544 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:15.493443 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 792/1609] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:15 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:15.498442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 818/1610] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:15.498442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364161b8-e10e-4970-8f36-9b97c95b4544 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:15.498740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475e8a1-d3fc-42a0-b699-29665f9bd9af None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:15.509464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364161b8-e10e-4970-8f36-9b97c95b4544 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:15.511083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475e8a1-d3fc-42a0-b699-29665f9bd9af None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:15.515241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbf460-4276-4b1f-bb6a-11fd6be7a99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:15.515963 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbf460-4276-4b1f-bb6a-11fd6be7a99d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.516240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbf460-4276-4b1f-bb6a-11fd6be7a99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.516514 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbf460-4276-4b1f-bb6a-11fd6be7a99d admin admin] PATH_INFO: `/v3/projects/8129ced583d0478ab61b6564643cf4c5/users/2e22e9e7fbf1419b8359f38b4a0f154e/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.517858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cd8a1-42ea-4838-a38f-7d96dc10ae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:15.518922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cd8a1-42ea-4838-a38f-7d96dc10ae6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.519284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cd8a1-42ea-4838-a38f-7d96dc10ae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.519696 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cd8a1-42ea-4838-a38f-7d96dc10ae6e admin admin] PATH_INFO: `/v3/projects/9a10997d04244abf89426279131ae960/users/b6093246f53b4dcb961f47aea99fb1bd/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.538141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cd8a1-42ea-4838-a38f-7d96dc10ae6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a10997d04244abf89426279131ae960, user_id=b6093246f53b4dcb961f47aea99fb1bd, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:15.540926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cd8a1-42ea-4838-a38f-7d96dc10ae6e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:15.543615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbf460-4276-4b1f-bb6a-11fd6be7a99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8129ced583d0478ab61b6564643cf4c5, user_id=2e22e9e7fbf1419b8359f38b4a0f154e, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:15.549815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbf460-4276-4b1f-bb6a-11fd6be7a99d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:15.557538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 793/1611] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:15 2022] PUT /identity/v3/projects/9a10997d04244abf89426279131ae960/users/b6093246f53b4dcb961f47aea99fb1bd/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:15.558973 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cd8a1-42ea-4838-a38f-7d96dc10ae6e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:15.572243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 819/1612] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:15 2022] PUT /identity/v3/projects/8129ced583d0478ab61b6564643cf4c5/users/2e22e9e7fbf1419b8359f38b4a0f154e/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:15.574703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd0595-0b2f-469d-9dcf-228389a8cf76 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.575248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd0595-0b2f-469d-9dcf-228389a8cf76 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.575722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd0595-0b2f-469d-9dcf-228389a8cf76 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.578954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 820/1613] 10.222.0.16 () {54 vars in 965 bytes} [Wed Sep 21 16:23:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:23:15.586518 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd0595-0b2f-469d-9dcf-228389a8cf76 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:15.644407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cd8a1-42ea-4838-a38f-7d96dc10ae6e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:15.680053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd0595-0b2f-469d-9dcf-228389a8cf76 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:15.680452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:15.688577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb74ca-d073-4d74-8bb1-74b25a9c45a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:15.689571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb74ca-d073-4d74-8bb1-74b25a9c45a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.689989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb74ca-d073-4d74-8bb1-74b25a9c45a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.690459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb74ca-d073-4d74-8bb1-74b25a9c45a0 admin admin] PATH_INFO: `/v3/projects/0e2ad930d9664966944c2f9edd04906d/users/12b5ca6922e54e64a24d6671df012237/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.693203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb74ca-d073-4d74-8bb1-74b25a9c45a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2ad930d9664966944c2f9edd04906d, user_id=12b5ca6922e54e64a24d6671df012237, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:15.696276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb74ca-d073-4d74-8bb1-74b25a9c45a0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:15.711319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 821/1614] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:15 2022] PUT /identity/v3/projects/0e2ad930d9664966944c2f9edd04906d/users/12b5ca6922e54e64a24d6671df012237/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:15.712114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb74ca-d073-4d74-8bb1-74b25a9c45a0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:15.714002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fcfb74ca-d073-4d74-8bb1-74b25a9c45a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:15.729837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3293da-6e83-4d13-87bc-8b204fb13ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:15.730884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3293da-6e83-4d13-87bc-8b204fb13ecc admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.731361 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3293da-6e83-4d13-87bc-8b204fb13ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.735652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3293da-6e83-4d13-87bc-8b204fb13ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.736933 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3293da-6e83-4d13-87bc-8b204fb13ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:15.740609 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3293da-6e83-4d13-87bc-8b204fb13ecc admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:15.765180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:15.787689 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 794/1615] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:15 2022] POST /identity/v3/projects => generated 371 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:15.789130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3293da-6e83-4d13-87bc-8b204fb13ecc admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:15.805703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb74ca-d073-4d74-8bb1-74b25a9c45a0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:15.888746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fb65f-7771-467b-88fb-38115010cab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:15.889401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fb65f-7771-467b-88fb-38115010cab5 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.889679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fb65f-7771-467b-88fb-38115010cab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.889953 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fb65f-7771-467b-88fb-38115010cab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.891306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3293da-6e83-4d13-87bc-8b204fb13ecc admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:15.896579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36954dae-43a8-40c7-b868-897a26840fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:15.897391 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36954dae-43a8-40c7-b868-897a26840fec admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.897750 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36954dae-43a8-40c7-b868-897a26840fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.898084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36954dae-43a8-40c7-b868-897a26840fec admin admin] PATH_INFO: `/v3/projects/ec47ba6becd2422b97e3ff4b7e87734a/users/497c2547b8dd4bd1bbb804a9395dc20e/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.904653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fb65f-7771-467b-88fb-38115010cab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:15.907451 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fb65f-7771-467b-88fb-38115010cab5 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:15.917145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36954dae-43a8-40c7-b868-897a26840fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec47ba6becd2422b97e3ff4b7e87734a, user_id=497c2547b8dd4bd1bbb804a9395dc20e, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:15.919900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 822/1616] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:15.920808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fb65f-7771-467b-88fb-38115010cab5 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:15.921936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36954dae-43a8-40c7-b868-897a26840fec admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:15.931178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fb65f-7771-467b-88fb-38115010cab5 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:15.938268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c984bb-9978-4929-9841-e3740f01a7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:15.938640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c984bb-9978-4929-9841-e3740f01a7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.938849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c984bb-9978-4929-9841-e3740f01a7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.939172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c984bb-9978-4929-9841-e3740f01a7c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.939732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c984bb-9978-4929-9841-e3740f01a7c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:15.941803 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c984bb-9978-4929-9841-e3740f01a7c6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:15.952811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 795/1617] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:15 2022] PUT /identity/v3/projects/ec47ba6becd2422b97e3ff4b7e87734a/users/497c2547b8dd4bd1bbb804a9395dc20e/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:15.952811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0387c-4676-4313-bb2f-370f94558940 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.952811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0387c-4676-4313-bb2f-370f94558940 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.952811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0387c-4676-4313-bb2f-370f94558940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:15.991390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8dd0387c-4676-4313-bb2f-370f94558940 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:15.995610 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 823/1618] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:15 2022] POST /identity/v3/projects => generated 405 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:15.996205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8dd0387c-4676-4313-bb2f-370f94558940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:15.996322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f238237-747b-4b43-bbec-fca8554b0139 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:15.996322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f238237-747b-4b43-bbec-fca8554b0139 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:15.996322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f238237-747b-4b43-bbec-fca8554b0139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:16.030333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3f238237-747b-4b43-bbec-fca8554b0139 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:16.032060 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3f238237-747b-4b43-bbec-fca8554b0139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:16.112048 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 796/1619] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:16.117667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ef4f0-8007-4fca-9479-dd168d360ecf None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:16.117667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ef4f0-8007-4fca-9479-dd168d360ecf None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:16.117667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ef4f0-8007-4fca-9479-dd168d360ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:16.161543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 824/1620] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:16.163008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07fbd1-3b2d-4930-9422-ca48f04a69a5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:16.163330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07fbd1-3b2d-4930-9422-ca48f04a69a5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:16.163606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07fbd1-3b2d-4930-9422-ca48f04a69a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:16.198913 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-be07fbd1-3b2d-4930-9422-ca48f04a69a5 None None] MFA Rules not processed for user `12b5ca6922e54e64a24d6671df012237`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:16.200974 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-be07fbd1-3b2d-4930-9422-ca48f04a69a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:16.201910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-327ef4f0-8007-4fca-9479-dd168d360ecf None None] MFA Rules not processed for user `d7ff08c990dc41b4811f97fecb7c4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:16.204430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-327ef4f0-8007-4fca-9479-dd168d360ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:16.249207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:16.283930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:16.324854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 825/1621] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:16.324854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07fbd1-3b2d-4930-9422-ca48f04a69a5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:16.342716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07fbd1-3b2d-4930-9422-ca48f04a69a5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:16.356259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123bb92-8e66-497e-8e24-eb24f2058f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:16.357940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123bb92-8e66-497e-8e24-eb24f2058f25 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:16.358430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123bb92-8e66-497e-8e24-eb24f2058f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:16.358897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123bb92-8e66-497e-8e24-eb24f2058f25 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:16.360336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123bb92-8e66-497e-8e24-eb24f2058f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:16.364002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 797/1622] 10.222.0.16 () {58 vars in 1062 bytes} [Wed Sep 21 16:23:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:16.364251 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123bb92-8e66-497e-8e24-eb24f2058f25 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:16.373496 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050079a3-1026-4653-852f-fb2d452a201c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:16.373931 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050079a3-1026-4653-852f-fb2d452a201c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:16.374308 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050079a3-1026-4653-852f-fb2d452a201c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:16.415458 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 826/1623] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:16 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:16.416840 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123bb92-8e66-497e-8e24-eb24f2058f25 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:16.437252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-050079a3-1026-4653-852f-fb2d452a201c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:16.440264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-050079a3-1026-4653-852f-fb2d452a201c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:16.441346 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123bb92-8e66-497e-8e24-eb24f2058f25 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:16.464672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 798/1624] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:16.466774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050079a3-1026-4653-852f-fb2d452a201c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:16.478002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622db361-9403-40af-a85e-f6530a2d4f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:16.479138 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622db361-9403-40af-a85e-f6530a2d4f43 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:16.479853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622db361-9403-40af-a85e-f6530a2d4f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:16.480389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622db361-9403-40af-a85e-f6530a2d4f43 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:16.482250 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622db361-9403-40af-a85e-f6530a2d4f43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:16.486065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622db361-9403-40af-a85e-f6530a2d4f43 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:16.527876 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 827/1625] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:16 2022] POST /identity/v3/users => generated 309 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:16.529946 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622db361-9403-40af-a85e-f6530a2d4f43 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:16.594336 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050079a3-1026-4653-852f-fb2d452a201c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:16.601144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a82704-c780-438d-8c53-263e8669d7e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:16.601928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a82704-c780-438d-8c53-263e8669d7e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:16.603057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a82704-c780-438d-8c53-263e8669d7e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:16.603057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a82704-c780-438d-8c53-263e8669d7e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:16.616494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a82704-c780-438d-8c53-263e8669d7e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:16.619015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a82704-c780-438d-8c53-263e8669d7e9 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:16.647567 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 799/1626] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:16.649329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a82704-c780-438d-8c53-263e8669d7e9 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:16.661278 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622db361-9403-40af-a85e-f6530a2d4f43 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:16.669539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0e4d-0a48-4067-b441-cbcfa969e635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:16.670595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0e4d-0a48-4067-b441-cbcfa969e635 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:16.671078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0e4d-0a48-4067-b441-cbcfa969e635 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:16.671568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0e4d-0a48-4067-b441-cbcfa969e635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:16.686049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d0e4d-0a48-4067-b441-cbcfa969e635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:16.687621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d0e4d-0a48-4067-b441-cbcfa969e635 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:16.701898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 828/1627] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:16.702788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0e4d-0a48-4067-b441-cbcfa969e635 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:16.720575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0e4d-0a48-4067-b441-cbcfa969e635 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:16.730456 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcadbed-6a88-4fda-abac-45a26db0f2d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:16.731090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcadbed-6a88-4fda-abac-45a26db0f2d8 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:16.731416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcadbed-6a88-4fda-abac-45a26db0f2d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:16.732257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcadbed-6a88-4fda-abac-45a26db0f2d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:16.765168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a82704-c780-438d-8c53-263e8669d7e9 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:16.775696 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0c1b4-46b3-4ae8-a942-30581cf9e570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:16.777379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0c1b4-46b3-4ae8-a942-30581cf9e570 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:16.779379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0c1b4-46b3-4ae8-a942-30581cf9e570 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:16.780158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0c1b4-46b3-4ae8-a942-30581cf9e570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:16.803934 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0c1b4-46b3-4ae8-a942-30581cf9e570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:16.807659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0c1b4-46b3-4ae8-a942-30581cf9e570 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:16.820732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcadbed-6a88-4fda-abac-45a26db0f2d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:16.822464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcadbed-6a88-4fda-abac-45a26db0f2d8 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:16.830052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 800/1628] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:16.831465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0c1b4-46b3-4ae8-a942-30581cf9e570 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:16.847189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 829/1629] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:16.848306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcadbed-6a88-4fda-abac-45a26db0f2d8 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:16.851819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0c1b4-46b3-4ae8-a942-30581cf9e570 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:16.860320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565c1ed-3c76-4789-a9bb-8a77737d652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:16.861871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565c1ed-3c76-4789-a9bb-8a77737d652f admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:16.863047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565c1ed-3c76-4789-a9bb-8a77737d652f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:16.863047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565c1ed-3c76-4789-a9bb-8a77737d652f admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:16.864377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565c1ed-3c76-4789-a9bb-8a77737d652f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:16.867793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565c1ed-3c76-4789-a9bb-8a77737d652f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:16.873529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcadbed-6a88-4fda-abac-45a26db0f2d8 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:16.886717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5380e-722f-4c6f-88ad-f758a0f779b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:16.889016 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5380e-722f-4c6f-88ad-f758a0f779b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:16.889586 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5380e-722f-4c6f-88ad-f758a0f779b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:16.890956 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5380e-722f-4c6f-88ad-f758a0f779b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:16.898368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 801/1630] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:16.900927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565c1ed-3c76-4789-a9bb-8a77737d652f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:16.920650 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5380e-722f-4c6f-88ad-f758a0f779b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:16.921265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565c1ed-3c76-4789-a9bb-8a77737d652f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:16.922365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5380e-722f-4c6f-88ad-f758a0f779b5 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:16.945925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852dae7-a6df-45ff-81d1-c9c4cfb8ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:16.946305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 830/1631] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:16.947078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5380e-722f-4c6f-88ad-f758a0f779b5 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:16.948343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852dae7-a6df-45ff-81d1-c9c4cfb8ac03 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:16.949000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852dae7-a6df-45ff-81d1-c9c4cfb8ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:16.949622 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852dae7-a6df-45ff-81d1-c9c4cfb8ac03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:16.952137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852dae7-a6df-45ff-81d1-c9c4cfb8ac03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:16.955981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852dae7-a6df-45ff-81d1-c9c4cfb8ac03 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:16.976239 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5380e-722f-4c6f-88ad-f758a0f779b5 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:16.981669 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 802/1632] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:16.989287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852dae7-a6df-45ff-81d1-c9c4cfb8ac03 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:16.991661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc116b9c-68ce-45ce-909a-4f17d1840ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:16.993031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc116b9c-68ce-45ce-909a-4f17d1840ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:16.993315 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc116b9c-68ce-45ce-909a-4f17d1840ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:16.993584 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc116b9c-68ce-45ce-909a-4f17d1840ac3 admin admin] PATH_INFO: `/v3/projects/8f88526e95cf42adb3e5f391f34973c9/users/b3f962d6166847f69f7fa9bdf99a129b/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:17.021178 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852dae7-a6df-45ff-81d1-c9c4cfb8ac03 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:17.035899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc116b9c-68ce-45ce-909a-4f17d1840ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f88526e95cf42adb3e5f391f34973c9, user_id=b3f962d6166847f69f7fa9bdf99a129b, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:17.037787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf8883-9f8d-4236-9dbb-165f51c4f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:17.039203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc116b9c-68ce-45ce-909a-4f17d1840ac3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:17.040335 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8883-9f8d-4236-9dbb-165f51c4f650 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:17.041784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8883-9f8d-4236-9dbb-165f51c4f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:17.042434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8883-9f8d-4236-9dbb-165f51c4f650 admin admin] PATH_INFO: `/v3/projects/9de21b31751c492f9509e16d6fec51ba/users/fa967107dc2448c3adedb55fbb545908/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:17.069631 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 831/1633] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:16 2022] PUT /identity/v3/projects/8f88526e95cf42adb3e5f391f34973c9/users/b3f962d6166847f69f7fa9bdf99a129b/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:17.076863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc116b9c-68ce-45ce-909a-4f17d1840ac3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:17.135705 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:17.167314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf8883-9f8d-4236-9dbb-165f51c4f650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de21b31751c492f9509e16d6fec51ba, user_id=fa967107dc2448c3adedb55fbb545908, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:17.191711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf8883-9f8d-4236-9dbb-165f51c4f650 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:17.241170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 803/1634] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:16 2022] PUT /identity/v3/projects/9de21b31751c492f9509e16d6fec51ba/users/fa967107dc2448c3adedb55fbb545908/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:23:17.243622 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf8883-9f8d-4236-9dbb-165f51c4f650 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:17.266155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc116b9c-68ce-45ce-909a-4f17d1840ac3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:17.273221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:17.387095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf8883-9f8d-4236-9dbb-165f51c4f650 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:17.395186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eec58c-f365-4e0b-a194-0bb9bf2c96cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:17.396237 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eec58c-f365-4e0b-a194-0bb9bf2c96cf service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:17.396954 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eec58c-f365-4e0b-a194-0bb9bf2c96cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:17.397521 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eec58c-f365-4e0b-a194-0bb9bf2c96cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:17.527664 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dd508-ba53-4d01-b8b7-a1d838360f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:17.529281 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dd508-ba53-4d01-b8b7-a1d838360f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:17.529780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dd508-ba53-4d01-b8b7-a1d838360f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:17.530267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dd508-ba53-4d01-b8b7-a1d838360f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:17.535928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dd508-ba53-4d01-b8b7-a1d838360f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:17.542009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dd508-ba53-4d01-b8b7-a1d838360f5a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:17.585155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 832/1635] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:23:17.586489 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dd508-ba53-4d01-b8b7-a1d838360f5a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:17.597297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eec58c-f365-4e0b-a194-0bb9bf2c96cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:17.599491 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dd508-ba53-4d01-b8b7-a1d838360f5a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:17.600939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eec58c-f365-4e0b-a194-0bb9bf2c96cf service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:17.616435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e962a-8448-4899-a2e6-0000d310c931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:17.619016 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e962a-8448-4899-a2e6-0000d310c931 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:17.619668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e962a-8448-4899-a2e6-0000d310c931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:17.620287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e962a-8448-4899-a2e6-0000d310c931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:17.621902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e962a-8448-4899-a2e6-0000d310c931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:17.626794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e962a-8448-4899-a2e6-0000d310c931 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:17.645590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 804/1636] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:17.658546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab47803-99e7-4c87-8fa6-727e12b0c588 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:17.660801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab47803-99e7-4c87-8fa6-727e12b0c588 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:17.660801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab47803-99e7-4c87-8fa6-727e12b0c588 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:17.670004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 805/1637] 10.222.0.16 () {54 vars in 912 bytes} [Wed Sep 21 16:23:17 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:23:17.672853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab47803-99e7-4c87-8fa6-727e12b0c588 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:17.681841 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 833/1638] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:17.691307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c4127-5cc9-4151-a86b-11c04ed49cf5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:17.691810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c4127-5cc9-4151-a86b-11c04ed49cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:17.693558 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c4127-5cc9-4151-a86b-11c04ed49cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:17.739691 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab47803-99e7-4c87-8fa6-727e12b0c588 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:17.751997 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9c3c4127-5cc9-4151-a86b-11c04ed49cf5 None None] MFA Rules not processed for user `d7ff08c990dc41b4811f97fecb7c4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:17.758127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9c3c4127-5cc9-4151-a86b-11c04ed49cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:17.761611 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2810785-aafc-4bd1-84a8-d53c13a252b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:17.763500 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2810785-aafc-4bd1-84a8-d53c13a252b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:17.764109 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2810785-aafc-4bd1-84a8-d53c13a252b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:17.766766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2810785-aafc-4bd1-84a8-d53c13a252b9 admin admin] PATH_INFO: `/v3/projects/8f88526e95cf42adb3e5f391f34973c9/users/b3f962d6166847f69f7fa9bdf99a129b/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:17.782440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2810785-aafc-4bd1-84a8-d53c13a252b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f88526e95cf42adb3e5f391f34973c9, user_id=b3f962d6166847f69f7fa9bdf99a129b, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:17.803255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2810785-aafc-4bd1-84a8-d53c13a252b9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:17.876194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 806/1639] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:17 2022] PUT /identity/v3/projects/8f88526e95cf42adb3e5f391f34973c9/users/b3f962d6166847f69f7fa9bdf99a129b/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:17.878053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2810785-aafc-4bd1-84a8-d53c13a252b9 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:17.965136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 834/1640] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:23:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:17.967735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d45f9a-99ef-4e85-a618-9af7d4ff2a1e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:17.968515 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d45f9a-99ef-4e85-a618-9af7d4ff2a1e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:17.969428 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d45f9a-99ef-4e85-a618-9af7d4ff2a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:18.050264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2810785-aafc-4bd1-84a8-d53c13a252b9 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:18.058673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-48d45f9a-99ef-4e85-a618-9af7d4ff2a1e None None] MFA Rules not processed for user `b3f962d6166847f69f7fa9bdf99a129b`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:18.063223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-48d45f9a-99ef-4e85-a618-9af7d4ff2a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:18.064445 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48db24-b264-4858-be02-372484a9d617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:18.065819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48db24-b264-4858-be02-372484a9d617 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:18.066454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48db24-b264-4858-be02-372484a9d617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:18.067039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48db24-b264-4858-be02-372484a9d617 admin admin] PATH_INFO: `/v3/projects/9de21b31751c492f9509e16d6fec51ba/users/fa967107dc2448c3adedb55fbb545908/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:18.071225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48db24-b264-4858-be02-372484a9d617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de21b31751c492f9509e16d6fec51ba, user_id=fa967107dc2448c3adedb55fbb545908, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:18.078875 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48db24-b264-4858-be02-372484a9d617 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:18.110652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 807/1641] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:17 2022] PUT /identity/v3/projects/9de21b31751c492f9509e16d6fec51ba/users/fa967107dc2448c3adedb55fbb545908/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:18.113145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48db24-b264-4858-be02-372484a9d617 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:18.159458 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:18.269748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 835/1642] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:18.271837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:18.274332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972c507-28e6-45fb-98a8-f30d5230b1a0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:18.274332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972c507-28e6-45fb-98a8-f30d5230b1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:18.274989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972c507-28e6-45fb-98a8-f30d5230b1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:18.307090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48db24-b264-4858-be02-372484a9d617 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:18.318913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb96cba-1697-4505-b689-a1d0f81205f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:18.320673 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb96cba-1697-4505-b689-a1d0f81205f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:18.322101 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb96cba-1697-4505-b689-a1d0f81205f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:18.322926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb96cba-1697-4505-b689-a1d0f81205f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:18.348534 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a972c507-28e6-45fb-98a8-f30d5230b1a0 None None] MFA Rules not processed for user `fa967107dc2448c3adedb55fbb545908`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:18.350125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a972c507-28e6-45fb-98a8-f30d5230b1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:18.518917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb96cba-1697-4505-b689-a1d0f81205f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:18.522594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb96cba-1697-4505-b689-a1d0f81205f9 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:18.540775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 836/1643] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:18 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:18.542608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972c507-28e6-45fb-98a8-f30d5230b1a0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:18.547926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 808/1644] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:18.573229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972c507-28e6-45fb-98a8-f30d5230b1a0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:18.584215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc681f4-a7af-4845-a5d7-eecbb8b95f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:18.584963 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc681f4-a7af-4845-a5d7-eecbb8b95f6e service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:18.585249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc681f4-a7af-4845-a5d7-eecbb8b95f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:18.585559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc681f4-a7af-4845-a5d7-eecbb8b95f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:18.761954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc681f4-a7af-4845-a5d7-eecbb8b95f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:18.765173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc681f4-a7af-4845-a5d7-eecbb8b95f6e service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:18.787198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 837/1645] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:18.885476 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb96cba-1697-4505-b689-a1d0f81205f9 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:18.915603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb96cba-1697-4505-b689-a1d0f81205f9 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:18.929436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7622a07-9c58-427f-ae7a-a0dc4cb3917a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:18.930754 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7622a07-9c58-427f-ae7a-a0dc4cb3917a service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:18.935434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7622a07-9c58-427f-ae7a-a0dc4cb3917a service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:18.936166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7622a07-9c58-427f-ae7a-a0dc4cb3917a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:18.968946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7622a07-9c58-427f-ae7a-a0dc4cb3917a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:18.970735 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7622a07-9c58-427f-ae7a-a0dc4cb3917a service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:19.003060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 809/1646] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:18 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:19.764592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc681f4-a7af-4845-a5d7-eecbb8b95f6e service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:20.120556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:20.167363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc681f4-a7af-4845-a5d7-eecbb8b95f6e service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:20.197075 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408afac-8815-4f0e-9555-f0e67e88f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:20.198133 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408afac-8815-4f0e-9555-f0e67e88f65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:20.198604 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408afac-8815-4f0e-9555-f0e67e88f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:20.199097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408afac-8815-4f0e-9555-f0e67e88f65d admin admin] PATH_INFO: `/v3/users/5e5f2116d43b46ecb395bb4128111c67` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:20.208785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408afac-8815-4f0e-9555-f0e67e88f65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e5f2116d43b46ecb395bb4128111c67)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:20.226613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-2408afac-8815-4f0e-9555-f0e67e88f65d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:23:20.226613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 21 16:23:20.226613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: Sep 21 16:23:20.229384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408afac-8815-4f0e-9555-f0e67e88f65d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:20.645924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2408afac-8815-4f0e-9555-f0e67e88f65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e5f2116d43b46ecb395bb4128111c67'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:20.648428 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2408afac-8815-4f0e-9555-f0e67e88f65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e5f2116d43b46ecb395bb4128111c67'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:20.781602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2408afac-8815-4f0e-9555-f0e67e88f65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e5f2116d43b46ecb395bb4128111c67'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:20.866454 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2408afac-8815-4f0e-9555-f0e67e88f65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e5f2116d43b46ecb395bb4128111c67'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:20.876229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2408afac-8815-4f0e-9555-f0e67e88f65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e5f2116d43b46ecb395bb4128111c67'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:20.935084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 838/1647] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:23:19 2022] DELETE /identity/v3/users/5e5f2116d43b46ecb395bb4128111c67 => generated 0 bytes in 1173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:20.942627 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77120d-a6ed-4a79-be83-969cf05cfeba None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:20.944067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77120d-a6ed-4a79-be83-969cf05cfeba None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:20.944831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77120d-a6ed-4a79-be83-969cf05cfeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:21.047019 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2e77120d-a6ed-4a79-be83-969cf05cfeba None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:21.049575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2e77120d-a6ed-4a79-be83-969cf05cfeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:21.470092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45393b1a-0aca-4593-9dbd-09bb50c16748 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:21.471089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45393b1a-0aca-4593-9dbd-09bb50c16748 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:21.471195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45393b1a-0aca-4593-9dbd-09bb50c16748 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:21.477501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 839/1648] 10.222.0.16 () {54 vars in 965 bytes} [Wed Sep 21 16:23:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:23:21.490145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd05f69-1f83-4054-9c40-8a9dec42dda7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:21.492498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd05f69-1f83-4054-9c40-8a9dec42dda7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:21.493021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd05f69-1f83-4054-9c40-8a9dec42dda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:21.600031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 810/1649] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 661 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:21.603763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7cd05f69-1f83-4054-9c40-8a9dec42dda7 None None] MFA Rules not processed for user `d7ff08c990dc41b4811f97fecb7c4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:21.605329 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7cd05f69-1f83-4054-9c40-8a9dec42dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:21.745485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77120d-a6ed-4a79-be83-969cf05cfeba None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:21.750042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2e77120d-a6ed-4a79-be83-969cf05cfeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:21.801003 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 840/1650] 10.222.0.16 () {58 vars in 1062 bytes} [Wed Sep 21 16:23:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:23:21.804859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd05f69-1f83-4054-9c40-8a9dec42dda7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:21.809199 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7cd05f69-1f83-4054-9c40-8a9dec42dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:21.844158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd05f69-1f83-4054-9c40-8a9dec42dda7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:21.862601 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38a642-7690-4dc6-9672-c4912cfd26b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:21.863829 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38a642-7690-4dc6-9672-c4912cfd26b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:21.864480 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38a642-7690-4dc6-9672-c4912cfd26b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:21.865040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38a642-7690-4dc6-9672-c4912cfd26b8 admin admin] PATH_INFO: `/v3/users/b3659c5ec73d4e30b6ba66db1c620609` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:21.870714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38a642-7690-4dc6-9672-c4912cfd26b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3659c5ec73d4e30b6ba66db1c620609)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:21.877161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38a642-7690-4dc6-9672-c4912cfd26b8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:22.030018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a38a642-7690-4dc6-9672-c4912cfd26b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3659c5ec73d4e30b6ba66db1c620609'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:22.030900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77120d-a6ed-4a79-be83-969cf05cfeba None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:22.032139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a38a642-7690-4dc6-9672-c4912cfd26b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3659c5ec73d4e30b6ba66db1c620609'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:22.039317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35103dc7-e5c2-4cc4-8ffd-99e779a94eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:22.040267 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103dc7-e5c2-4cc4-8ffd-99e779a94eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:22.040638 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103dc7-e5c2-4cc4-8ffd-99e779a94eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:22.041254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103dc7-e5c2-4cc4-8ffd-99e779a94eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:22.045302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-35103dc7-e5c2-4cc4-8ffd-99e779a94eb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:22.057011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:22.083715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a38a642-7690-4dc6-9672-c4912cfd26b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3659c5ec73d4e30b6ba66db1c620609'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:22.085102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35103dc7-e5c2-4cc4-8ffd-99e779a94eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:22.087397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35103dc7-e5c2-4cc4-8ffd-99e779a94eb2 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:22.110485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a38a642-7690-4dc6-9672-c4912cfd26b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3659c5ec73d4e30b6ba66db1c620609'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:22.117737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a38a642-7690-4dc6-9672-c4912cfd26b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3659c5ec73d4e30b6ba66db1c620609'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:22.120525 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 811/1651] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:22.124542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3bbd-ef01-42d5-966f-dfb69f5f9825 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:22.125137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3bbd-ef01-42d5-966f-dfb69f5f9825 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:22.126092 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3bbd-ef01-42d5-966f-dfb69f5f9825 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:22.133278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 812/1652] 10.222.0.16 () {54 vars in 912 bytes} [Wed Sep 21 16:23:22 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:23:22.145934 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256284e-55ce-4420-b97e-23d4a7749bc7 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:22.146743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256284e-55ce-4420-b97e-23d4a7749bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:22.148268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256284e-55ce-4420-b97e-23d4a7749bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:22.162764 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 841/1653] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:23:21 2022] DELETE /identity/v3/users/b3659c5ec73d4e30b6ba66db1c620609 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:22.169220 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a07cf-9e38-48df-87be-d48b92d557c8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:22.169729 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a07cf-9e38-48df-87be-d48b92d557c8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:22.171464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a07cf-9e38-48df-87be-d48b92d557c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:22.230226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-234a07cf-9e38-48df-87be-d48b92d557c8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:22.232910 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-234a07cf-9e38-48df-87be-d48b92d557c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:22.252928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a256284e-55ce-4420-b97e-23d4a7749bc7 None None] MFA Rules not processed for user `d7ff08c990dc41b4811f97fecb7c4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:22.255512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a256284e-55ce-4420-b97e-23d4a7749bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:22.303529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:22.416057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 842/1654] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:23:22.424058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 813/1655] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:23:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:22.440070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a07cf-9e38-48df-87be-d48b92d557c8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:22.442153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-234a07cf-9e38-48df-87be-d48b92d557c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:22.443904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256284e-55ce-4420-b97e-23d4a7749bc7 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:22.446697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a256284e-55ce-4420-b97e-23d4a7749bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:22.602272 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a07cf-9e38-48df-87be-d48b92d557c8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:22.611531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256284e-55ce-4420-b97e-23d4a7749bc7 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:22.614815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e252a22-9a57-4fe8-8d11-8bab53efc949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:22.615771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e252a22-9a57-4fe8-8d11-8bab53efc949 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:22.616197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e252a22-9a57-4fe8-8d11-8bab53efc949 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:22.616598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e252a22-9a57-4fe8-8d11-8bab53efc949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:22.623918 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070a5fc-bf54-4040-bd43-4cae78b896a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:22.626750 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070a5fc-bf54-4040-bd43-4cae78b896a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:22.627455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070a5fc-bf54-4040-bd43-4cae78b896a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:22.628273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070a5fc-bf54-4040-bd43-4cae78b896a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:22.644606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e252a22-9a57-4fe8-8d11-8bab53efc949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:22.648127 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070a5fc-bf54-4040-bd43-4cae78b896a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:22.650858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e252a22-9a57-4fe8-8d11-8bab53efc949 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:22.651551 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070a5fc-bf54-4040-bd43-4cae78b896a0 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:22.678083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 814/1656] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:22.679913 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 843/1657] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:23:22.885598 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070a5fc-bf54-4040-bd43-4cae78b896a0 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:22.887913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0070a5fc-bf54-4040-bd43-4cae78b896a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:22.919386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070a5fc-bf54-4040-bd43-4cae78b896a0 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:22.938361 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:22.939357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:22.939635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:22.939906 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] PATH_INFO: `/v3/projects/03a5dd95f9e74d02a82001d80fb24288` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:22.941587 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a5dd95f9e74d02a82001d80fb24288)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:22.944221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: WARNING py.warnings [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 16:23:22.944221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: warnings.warn(msg) Sep 21 16:23:22.944221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: Sep 21 16:23:22.946670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:23.160597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a5dd95f9e74d02a82001d80fb24288', 'request_id': 'req-6e93987b-ba69-486e-b500-bd282c46dc6f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:23.191533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a5dd95f9e74d02a82001d80fb24288', 'request_id': 'req-6e93987b-ba69-486e-b500-bd282c46dc6f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:23.211500 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a5dd95f9e74d02a82001d80fb24288', 'request_id': 'req-6e93987b-ba69-486e-b500-bd282c46dc6f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:23.245441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] The token cache is being invalidate because project 03a5dd95f9e74d02a82001d80fb24288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:23:23.245789 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:23.246907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:23.249932 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 815/1658] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:23:22 2022] DELETE /identity/v3/projects/03a5dd95f9e74d02a82001d80fb24288 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:23:23.254193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e252a22-9a57-4fe8-8d11-8bab53efc949 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:23.269890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e252a22-9a57-4fe8-8d11-8bab53efc949 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:23.511328 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec52fa3-685c-417b-9d2e-8520fd9f3a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:23.512921 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec52fa3-685c-417b-9d2e-8520fd9f3a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:23.514094 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec52fa3-685c-417b-9d2e-8520fd9f3a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:23.514389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec52fa3-685c-417b-9d2e-8520fd9f3a9e admin admin] PATH_INFO: `/v3/users/fa967107dc2448c3adedb55fbb545908` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:23.518176 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec52fa3-685c-417b-9d2e-8520fd9f3a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa967107dc2448c3adedb55fbb545908)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:23.521481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec52fa3-685c-417b-9d2e-8520fd9f3a9e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:23.577059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:23.632246 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ec52fa3-685c-417b-9d2e-8520fd9f3a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa967107dc2448c3adedb55fbb545908'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:23.633011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ec52fa3-685c-417b-9d2e-8520fd9f3a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa967107dc2448c3adedb55fbb545908'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:23.675282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ec52fa3-685c-417b-9d2e-8520fd9f3a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa967107dc2448c3adedb55fbb545908'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:23.704360 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ec52fa3-685c-417b-9d2e-8520fd9f3a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa967107dc2448c3adedb55fbb545908'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:23.706333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ec52fa3-685c-417b-9d2e-8520fd9f3a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa967107dc2448c3adedb55fbb545908'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:23.746050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 844/1659] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:23:23 2022] DELETE /identity/v3/users/fa967107dc2448c3adedb55fbb545908 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:24.403984 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:24.405363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:24.448646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93987b-ba69-486e-b500-bd282c46dc6f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:24.511848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:24.579834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:24.581381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:24.581883 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:24.583656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] PATH_INFO: `/v3/projects/e2b751f170bd4338af1e007f82c9387f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:24.585581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b751f170bd4338af1e007f82c9387f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:24.588663 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:24.743897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b751f170bd4338af1e007f82c9387f', 'request_id': 'req-3c66f759-540f-422a-b4e7-6f33035e8abb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:24.761678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b751f170bd4338af1e007f82c9387f', 'request_id': 'req-3c66f759-540f-422a-b4e7-6f33035e8abb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:24.779370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b751f170bd4338af1e007f82c9387f', 'request_id': 'req-3c66f759-540f-422a-b4e7-6f33035e8abb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:24.829239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] The token cache is being invalidate because project e2b751f170bd4338af1e007f82c9387f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:23:24.829596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:24.830402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:24.835545 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 816/1660] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:23:24 2022] DELETE /identity/v3/projects/e2b751f170bd4338af1e007f82c9387f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:24.837263 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec52fa3-685c-417b-9d2e-8520fd9f3a9e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:24.840000 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2ec52fa3-685c-417b-9d2e-8520fd9f3a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:24.867480 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec52fa3-685c-417b-9d2e-8520fd9f3a9e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:25.129882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e48b1-20ec-4149-87c9-5a28c5abde04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:25.131537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e48b1-20ec-4149-87c9-5a28c5abde04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:25.132501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e48b1-20ec-4149-87c9-5a28c5abde04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:25.133239 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e48b1-20ec-4149-87c9-5a28c5abde04 admin admin] PATH_INFO: `/v3/users/b3f962d6166847f69f7fa9bdf99a129b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:25.135860 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e48b1-20ec-4149-87c9-5a28c5abde04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f962d6166847f69f7fa9bdf99a129b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:25.143816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e48b1-20ec-4149-87c9-5a28c5abde04 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:25.381405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e69e48b1-20ec-4149-87c9-5a28c5abde04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f962d6166847f69f7fa9bdf99a129b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:25.401787 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e69e48b1-20ec-4149-87c9-5a28c5abde04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f962d6166847f69f7fa9bdf99a129b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:25.455513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e69e48b1-20ec-4149-87c9-5a28c5abde04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f962d6166847f69f7fa9bdf99a129b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:25.478708 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e69e48b1-20ec-4149-87c9-5a28c5abde04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f962d6166847f69f7fa9bdf99a129b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:25.482044 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e69e48b1-20ec-4149-87c9-5a28c5abde04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f962d6166847f69f7fa9bdf99a129b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:25.542802 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 845/1661] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:23:24 2022] DELETE /identity/v3/users/b3f962d6166847f69f7fa9bdf99a129b => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:23:25.573406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:25.575611 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:25.603761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66f759-540f-422a-b4e7-6f33035e8abb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:25.781799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394c9c7-48b6-4851-a097-c299e6771461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:25.782270 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394c9c7-48b6-4851-a097-c299e6771461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:25.782573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394c9c7-48b6-4851-a097-c299e6771461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:25.782954 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394c9c7-48b6-4851-a097-c299e6771461 admin admin] PATH_INFO: `/v3/projects/9de21b31751c492f9509e16d6fec51ba` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:25.796928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394c9c7-48b6-4851-a097-c299e6771461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de21b31751c492f9509e16d6fec51ba)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:25.800008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394c9c7-48b6-4851-a097-c299e6771461 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:25.990378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2394c9c7-48b6-4851-a097-c299e6771461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de21b31751c492f9509e16d6fec51ba', 'request_id': 'req-2394c9c7-48b6-4851-a097-c299e6771461'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:26.014308 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2394c9c7-48b6-4851-a097-c299e6771461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de21b31751c492f9509e16d6fec51ba', 'request_id': 'req-2394c9c7-48b6-4851-a097-c299e6771461'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:26.036175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2394c9c7-48b6-4851-a097-c299e6771461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de21b31751c492f9509e16d6fec51ba', 'request_id': 'req-2394c9c7-48b6-4851-a097-c299e6771461'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:26.046570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:26.080229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2394c9c7-48b6-4851-a097-c299e6771461 admin admin] The token cache is being invalidate because project 9de21b31751c492f9509e16d6fec51ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:23:26.080767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2394c9c7-48b6-4851-a097-c299e6771461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:26.081966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2394c9c7-48b6-4851-a097-c299e6771461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:26.087599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 817/1662] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:23:25 2022] DELETE /identity/v3/projects/9de21b31751c492f9509e16d6fec51ba => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:26.097708 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce37b-0c6f-4d0d-85b4-be076e9fce87 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:26.098573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce37b-0c6f-4d0d-85b4-be076e9fce87 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:26.098573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce37b-0c6f-4d0d-85b4-be076e9fce87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:26.164155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7f4ce37b-0c6f-4d0d-85b4-be076e9fce87 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:26.166948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7f4ce37b-0c6f-4d0d-85b4-be076e9fce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:26.210125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:26.329468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 846/1663] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:26.335339 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bfb58-7a0e-4d96-9ca3-59df39533c5e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:26.335934 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bfb58-7a0e-4d96-9ca3-59df39533c5e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:26.336184 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bfb58-7a0e-4d96-9ca3-59df39533c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:26.397104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e46bfb58-7a0e-4d96-9ca3-59df39533c5e None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:26.398696 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e46bfb58-7a0e-4d96-9ca3-59df39533c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:26.448780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ce37b-0c6f-4d0d-85b4-be076e9fce87 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:26.457032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 818/1664] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:26.467887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ce37b-0c6f-4d0d-85b4-be076e9fce87 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:26.493257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0c21-4d50-4cd3-b98f-aaf5be9c5197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:26.494280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0c21-4d50-4cd3-b98f-aaf5be9c5197 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:26.494731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0c21-4d50-4cd3-b98f-aaf5be9c5197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:26.494990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0c21-4d50-4cd3-b98f-aaf5be9c5197 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:26.495703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e0c21-4d50-4cd3-b98f-aaf5be9c5197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:23:26.496046 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e0c21-4d50-4cd3-b98f-aaf5be9c5197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:26.505308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e0c21-4d50-4cd3-b98f-aaf5be9c5197 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:26.560495 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bfb58-7a0e-4d96-9ca3-59df39533c5e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:26.576538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bfb58-7a0e-4d96-9ca3-59df39533c5e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:26.577463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 847/1665] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:23:26.611401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5e69d-3da8-4da3-a869-678cbbe52172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:26.612935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5e69d-3da8-4da3-a869-678cbbe52172 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:26.614152 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5e69d-3da8-4da3-a869-678cbbe52172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:26.614887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5e69d-3da8-4da3-a869-678cbbe52172 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:26.621093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5e69d-3da8-4da3-a869-678cbbe52172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:26.624433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5e69d-3da8-4da3-a869-678cbbe52172 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:26.734507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0c21-4d50-4cd3-b98f-aaf5be9c5197 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:26.749945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 819/1666] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:26 2022] POST /identity/v3/projects => generated 405 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:26.781842 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0c21-4d50-4cd3-b98f-aaf5be9c5197 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:27.085589 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b5733-dfa6-46de-9610-e753e30d7725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:27.086549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b5733-dfa6-46de-9610-e753e30d7725 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:27.086972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b5733-dfa6-46de-9610-e753e30d7725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:27.087485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b5733-dfa6-46de-9610-e753e30d7725 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:27.088538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b5733-dfa6-46de-9610-e753e30d7725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:27.094827 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b5733-dfa6-46de-9610-e753e30d7725 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:27.235053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 848/1667] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:26 2022] POST /identity/v3/users => generated 303 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:27.241553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5e69d-3da8-4da3-a869-678cbbe52172 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:27.287971 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5e69d-3da8-4da3-a869-678cbbe52172 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:27.311051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de3587-8f27-4ece-8bee-d3cd4c156497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:27.311554 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de3587-8f27-4ece-8bee-d3cd4c156497 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:27.312098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de3587-8f27-4ece-8bee-d3cd4c156497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:27.312576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de3587-8f27-4ece-8bee-d3cd4c156497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:27.318268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de3587-8f27-4ece-8bee-d3cd4c156497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:27.321810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de3587-8f27-4ece-8bee-d3cd4c156497 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:27.410939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b5733-dfa6-46de-9610-e753e30d7725 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:27.422338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 820/1668] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:27.443634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b5733-dfa6-46de-9610-e753e30d7725 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:27.476118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248281d-efa9-4434-b331-80b679a1efc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:27.478307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248281d-efa9-4434-b331-80b679a1efc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:27.483528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248281d-efa9-4434-b331-80b679a1efc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:27.484283 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248281d-efa9-4434-b331-80b679a1efc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:27.488494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248281d-efa9-4434-b331-80b679a1efc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:27.502662 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248281d-efa9-4434-b331-80b679a1efc5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:27.549246 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 849/1669] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:27.552107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de3587-8f27-4ece-8bee-d3cd4c156497 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:27.578580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de3587-8f27-4ece-8bee-d3cd4c156497 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:27.599826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141ff7a-285f-48ed-bda2-586c120bd667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:27.601279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141ff7a-285f-48ed-bda2-586c120bd667 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:27.603876 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141ff7a-285f-48ed-bda2-586c120bd667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:27.604498 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141ff7a-285f-48ed-bda2-586c120bd667 admin admin] PATH_INFO: `/v3/projects/b92232752fec4668aedfaf6dbee07231/users/e8101d5e67194a4cad4391c9a66ad971/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:27.679969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141ff7a-285f-48ed-bda2-586c120bd667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92232752fec4668aedfaf6dbee07231, user_id=e8101d5e67194a4cad4391c9a66ad971, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:27.687995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141ff7a-285f-48ed-bda2-586c120bd667 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:27.721227 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 821/1670] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:27 2022] PUT /identity/v3/projects/b92232752fec4668aedfaf6dbee07231/users/e8101d5e67194a4cad4391c9a66ad971/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:27.733310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13634742-a9aa-4667-ac33-cc1443d7957f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:27.733677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13634742-a9aa-4667-ac33-cc1443d7957f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:27.733882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13634742-a9aa-4667-ac33-cc1443d7957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:27.770884 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-13634742-a9aa-4667-ac33-cc1443d7957f None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:27.772283 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-13634742-a9aa-4667-ac33-cc1443d7957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:27.925956 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 850/1671] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:27.960566 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141ff7a-285f-48ed-bda2-586c120bd667 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:28.003803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4141ff7a-285f-48ed-bda2-586c120bd667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:28.245887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13634742-a9aa-4667-ac33-cc1443d7957f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:28.247883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-13634742-a9aa-4667-ac33-cc1443d7957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:28.270382 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13634742-a9aa-4667-ac33-cc1443d7957f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:28.302659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa79f7-7122-44e6-baf8-3b3ef54888f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:28.303338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa79f7-7122-44e6-baf8-3b3ef54888f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:28.303622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa79f7-7122-44e6-baf8-3b3ef54888f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:28.303899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa79f7-7122-44e6-baf8-3b3ef54888f5 admin admin] PATH_INFO: `/v3/users/6c29148bc7c74309863349e094d11bc2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:28.312710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141ff7a-285f-48ed-bda2-586c120bd667 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:28.313182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa79f7-7122-44e6-baf8-3b3ef54888f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c29148bc7c74309863349e094d11bc2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:28.317743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa79f7-7122-44e6-baf8-3b3ef54888f5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:28.323385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e9200-ff03-4789-a0db-131f371bb8bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:28.326310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e9200-ff03-4789-a0db-131f371bb8bd service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:28.327197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e9200-ff03-4789-a0db-131f371bb8bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:28.328068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e9200-ff03-4789-a0db-131f371bb8bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:28.366703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e9200-ff03-4789-a0db-131f371bb8bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:28.376556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e9200-ff03-4789-a0db-131f371bb8bd service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:28.395643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:28.422692 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 822/1672] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:28.619681 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e9200-ff03-4789-a0db-131f371bb8bd service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:28.621345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-029e9200-ff03-4789-a0db-131f371bb8bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:28.674383 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5eaa79f7-7122-44e6-baf8-3b3ef54888f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c29148bc7c74309863349e094d11bc2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:28.676330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e9200-ff03-4789-a0db-131f371bb8bd service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:28.676536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5eaa79f7-7122-44e6-baf8-3b3ef54888f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c29148bc7c74309863349e094d11bc2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:28.718395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5eaa79f7-7122-44e6-baf8-3b3ef54888f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c29148bc7c74309863349e094d11bc2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:28.725110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:28.726437 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:28.726924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:28.727393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] PATH_INFO: `/v3/projects/8f88526e95cf42adb3e5f391f34973c9` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:28.744359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f88526e95cf42adb3e5f391f34973c9)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:28.747843 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5eaa79f7-7122-44e6-baf8-3b3ef54888f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c29148bc7c74309863349e094d11bc2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:28.750605 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5eaa79f7-7122-44e6-baf8-3b3ef54888f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c29148bc7c74309863349e094d11bc2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:28.756894 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:28.802431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 851/1673] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:23:28 2022] DELETE /identity/v3/users/6c29148bc7c74309863349e094d11bc2 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:28.809792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059dc8a-f71d-4b15-b7b1-715d0603575d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:28.810082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059dc8a-f71d-4b15-b7b1-715d0603575d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:28.810351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059dc8a-f71d-4b15-b7b1-715d0603575d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:28.868127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b059dc8a-f71d-4b15-b7b1-715d0603575d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:28.870475 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b059dc8a-f71d-4b15-b7b1-715d0603575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:29.052846 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 852/1674] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:23:29.064577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f88526e95cf42adb3e5f391f34973c9', 'request_id': 'req-8a38e218-ccd7-42e3-b48b-cb823c687037'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:29.098929 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f88526e95cf42adb3e5f391f34973c9', 'request_id': 'req-8a38e218-ccd7-42e3-b48b-cb823c687037'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:29.116389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f88526e95cf42adb3e5f391f34973c9', 'request_id': 'req-8a38e218-ccd7-42e3-b48b-cb823c687037'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:29.144411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] The token cache is being invalidate because project 8f88526e95cf42adb3e5f391f34973c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:23:29.145565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:29.147187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:29.149975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 823/1675] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:23:28 2022] DELETE /identity/v3/projects/8f88526e95cf42adb3e5f391f34973c9 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:29.160297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3dce-a1e9-49d4-94e7-994e0aba9ded None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:29.161084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3dce-a1e9-49d4-94e7-994e0aba9ded None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:29.162040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3dce-a1e9-49d4-94e7-994e0aba9ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:29.218038 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-de2a3dce-a1e9-49d4-94e7-994e0aba9ded None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:29.219869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-de2a3dce-a1e9-49d4-94e7-994e0aba9ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:29.231808 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:29.234446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:29.297154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:29.437013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 853/1676] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:29.438567 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e218-ccd7-42e3-b48b-cb823c687037 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:29.463816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4af29-506f-469e-bcfa-e733dcd14452 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:29.464284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4af29-506f-469e-bcfa-e733dcd14452 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:29.465080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4af29-506f-469e-bcfa-e733dcd14452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:29.476353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32fa57-72ce-4d05-b8e9-1d2e420a1f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:29.476353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32fa57-72ce-4d05-b8e9-1d2e420a1f65 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:29.476353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32fa57-72ce-4d05-b8e9-1d2e420a1f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:29.476353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32fa57-72ce-4d05-b8e9-1d2e420a1f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:29.496782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ef32fa57-72ce-4d05-b8e9-1d2e420a1f65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:29.535698 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32fa57-72ce-4d05-b8e9-1d2e420a1f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:29.539538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32fa57-72ce-4d05-b8e9-1d2e420a1f65 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:29.541425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-73f4af29-506f-469e-bcfa-e733dcd14452 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:29.545921 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-73f4af29-506f-469e-bcfa-e733dcd14452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:29.572736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 854/1677] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:29.573947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 824/1678] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:23:29.579906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4af29-506f-469e-bcfa-e733dcd14452 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:29.601940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4af29-506f-469e-bcfa-e733dcd14452 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:29.617004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb8f43-fe7c-4088-9de5-c4680622dbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:29.617855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb8f43-fe7c-4088-9de5-c4680622dbbb admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:29.618215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb8f43-fe7c-4088-9de5-c4680622dbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:29.619273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb8f43-fe7c-4088-9de5-c4680622dbbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:29.620710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb8f43-fe7c-4088-9de5-c4680622dbbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:23:29.621361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb8f43-fe7c-4088-9de5-c4680622dbbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:29.624615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb8f43-fe7c-4088-9de5-c4680622dbbb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:29.666420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32fa57-72ce-4d05-b8e9-1d2e420a1f65 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:29.667175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 855/1679] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:23:29.694853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32fa57-72ce-4d05-b8e9-1d2e420a1f65 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:29.707992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4eaa9-a793-4083-a395-10e7c14581e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:29.710410 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4eaa9-a793-4083-a395-10e7c14581e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:29.712238 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4eaa9-a793-4083-a395-10e7c14581e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:29.712537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4eaa9-a793-4083-a395-10e7c14581e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:29.713323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4eaa9-a793-4083-a395-10e7c14581e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:29.720031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4eaa9-a793-4083-a395-10e7c14581e1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:29.798719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 825/1680] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:29 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:29.801290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb8f43-fe7c-4088-9de5-c4680622dbbb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:29.848261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb8f43-fe7c-4088-9de5-c4680622dbbb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:29.918318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:30.140169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c54a9e-8ab6-4b8b-8ede-9f798efa5bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:30.153279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54a9e-8ab6-4b8b-8ede-9f798efa5bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:30.153279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54a9e-8ab6-4b8b-8ede-9f798efa5bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:30.153279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54a9e-8ab6-4b8b-8ede-9f798efa5bfa admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:30.153279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c54a9e-8ab6-4b8b-8ede-9f798efa5bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:30.160777 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c54a9e-8ab6-4b8b-8ede-9f798efa5bfa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:30.261818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 856/1681] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:29 2022] POST /identity/v3/users => generated 283 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:30.263224 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4eaa9-a793-4083-a395-10e7c14581e1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:30.286793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4eaa9-a793-4083-a395-10e7c14581e1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:30.301827 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a9799-3f55-4245-9cde-0c0b6af77565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:30.302472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a9799-3f55-4245-9cde-0c0b6af77565 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:30.302793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a9799-3f55-4245-9cde-0c0b6af77565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:30.303075 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a9799-3f55-4245-9cde-0c0b6af77565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:30.304170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a9799-3f55-4245-9cde-0c0b6af77565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:30.305910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a9799-3f55-4245-9cde-0c0b6af77565 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:30.333933 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 826/1682] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:30.339827 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c54a9e-8ab6-4b8b-8ede-9f798efa5bfa admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:30.358731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c54a9e-8ab6-4b8b-8ede-9f798efa5bfa admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:30.365689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a5683-6876-44e3-aedc-b1b46daaccf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:30.366727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a5683-6876-44e3-aedc-b1b46daaccf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:30.367217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a5683-6876-44e3-aedc-b1b46daaccf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:30.367772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a5683-6876-44e3-aedc-b1b46daaccf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:30.369098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a5683-6876-44e3-aedc-b1b46daaccf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:30.373001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a5683-6876-44e3-aedc-b1b46daaccf2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:30.403704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 857/1683] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:30.410822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a9799-3f55-4245-9cde-0c0b6af77565 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:30.441819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a9799-3f55-4245-9cde-0c0b6af77565 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:30.486263 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15aac8-8292-4c7c-9764-2040ee7e7e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:30.489240 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15aac8-8292-4c7c-9764-2040ee7e7e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:30.489787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15aac8-8292-4c7c-9764-2040ee7e7e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:30.490625 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15aac8-8292-4c7c-9764-2040ee7e7e10 admin admin] PATH_INFO: `/v3/projects/e48c9da18e4b4bb18534f0eceb61d85a/users/18af8850ed61415dabff9a84d8cc3c9f/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:30.538297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15aac8-8292-4c7c-9764-2040ee7e7e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48c9da18e4b4bb18534f0eceb61d85a, user_id=18af8850ed61415dabff9a84d8cc3c9f, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:30.550624 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15aac8-8292-4c7c-9764-2040ee7e7e10 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:30.610781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 827/1684] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:30 2022] PUT /identity/v3/projects/e48c9da18e4b4bb18534f0eceb61d85a/users/18af8850ed61415dabff9a84d8cc3c9f/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:23:30.632123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af780-fdbd-4167-a66a-9b843edaba89 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:30.632888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af780-fdbd-4167-a66a-9b843edaba89 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:30.634423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af780-fdbd-4167-a66a-9b843edaba89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:30.756594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-809af780-fdbd-4167-a66a-9b843edaba89 None None] MFA Rules not processed for user `18af8850ed61415dabff9a84d8cc3c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:30.757921 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-809af780-fdbd-4167-a66a-9b843edaba89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:30.906393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 858/1685] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:23:30.915571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15aac8-8292-4c7c-9764-2040ee7e7e10 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:31.410229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15aac8-8292-4c7c-9764-2040ee7e7e10 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:31.421639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0acffa-4437-4f21-a6b2-799386659406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:31.422744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0acffa-4437-4f21-a6b2-799386659406 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:31.423237 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0acffa-4437-4f21-a6b2-799386659406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:31.423869 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0acffa-4437-4f21-a6b2-799386659406 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:31.426588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0acffa-4437-4f21-a6b2-799386659406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:31.432749 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0acffa-4437-4f21-a6b2-799386659406 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:31.531102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 828/1686] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:30 2022] POST /identity/v3/projects => generated 363 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:31.532657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809af780-fdbd-4167-a66a-9b843edaba89 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:31.563359 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809af780-fdbd-4167-a66a-9b843edaba89 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:31.753143 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd7280-d83f-4fa4-aa15-a88d3db677de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:31.753772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd7280-d83f-4fa4-aa15-a88d3db677de admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:31.754024 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd7280-d83f-4fa4-aa15-a88d3db677de admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:31.754235 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd7280-d83f-4fa4-aa15-a88d3db677de admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:31.755065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd7280-d83f-4fa4-aa15-a88d3db677de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:31.757434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd7280-d83f-4fa4-aa15-a88d3db677de admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:31.823407 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 859/1687] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:31 2022] POST /identity/v3/users => generated 288 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:31.826961 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0acffa-4437-4f21-a6b2-799386659406 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:31.881043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0acffa-4437-4f21-a6b2-799386659406 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:31.904291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e9521-c3eb-4862-b129-4e9dc306ad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:31.905499 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e9521-c3eb-4862-b129-4e9dc306ad9d admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:31.906007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e9521-c3eb-4862-b129-4e9dc306ad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:31.906504 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e9521-c3eb-4862-b129-4e9dc306ad9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:31.907772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e9521-c3eb-4862-b129-4e9dc306ad9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:31.915904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e9521-c3eb-4862-b129-4e9dc306ad9d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:31.968754 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 829/1688] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:23:31.974586 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd7280-d83f-4fa4-aa15-a88d3db677de admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:31.997469 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd7280-d83f-4fa4-aa15-a88d3db677de admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:32.024521 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af3720-0e52-4797-8b28-f6d96ae0cefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:32.025465 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3720-0e52-4797-8b28-f6d96ae0cefc admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:32.025743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3720-0e52-4797-8b28-f6d96ae0cefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:32.026022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3720-0e52-4797-8b28-f6d96ae0cefc admin admin] PATH_INFO: `/v3/projects/da764cfc2ea3418fafbde4794ae7412c/users/37018f03006a4184b9ef416edc090c7b/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:32.089863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:32.118648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af3720-0e52-4797-8b28-f6d96ae0cefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=da764cfc2ea3418fafbde4794ae7412c, user_id=37018f03006a4184b9ef416edc090c7b, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:32.126368 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af3720-0e52-4797-8b28-f6d96ae0cefc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:32.158383 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 860/1689] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:31 2022] PUT /identity/v3/projects/da764cfc2ea3418fafbde4794ae7412c/users/37018f03006a4184b9ef416edc090c7b/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:32.164493 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e9521-c3eb-4862-b129-4e9dc306ad9d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:32.206517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e9521-c3eb-4862-b129-4e9dc306ad9d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:32.468329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:32.636153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237ad8a-8d83-4f85-8549-1aa7963740ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:32.641808 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237ad8a-8d83-4f85-8549-1aa7963740ec admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:32.642686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237ad8a-8d83-4f85-8549-1aa7963740ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:32.643728 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237ad8a-8d83-4f85-8549-1aa7963740ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:32.646937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237ad8a-8d83-4f85-8549-1aa7963740ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:32.656532 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af3720-0e52-4797-8b28-f6d96ae0cefc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:32.658913 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3af3720-0e52-4797-8b28-f6d96ae0cefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:32.660570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237ad8a-8d83-4f85-8549-1aa7963740ec admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:32.683780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af3720-0e52-4797-8b28-f6d96ae0cefc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:32.703587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d19d7e-a63b-439b-9bfd-80797ed0e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:32.704894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d19d7e-a63b-439b-9bfd-80797ed0e619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:32.705404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d19d7e-a63b-439b-9bfd-80797ed0e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:32.705664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 830/1690] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 544 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:32.708658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d19d7e-a63b-439b-9bfd-80797ed0e619 admin admin] PATH_INFO: `/v3/projects/14ffc5ee9226418593622144543ef3be` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:32.716095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237ad8a-8d83-4f85-8549-1aa7963740ec admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:32.716709 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d19d7e-a63b-439b-9bfd-80797ed0e619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ffc5ee9226418593622144543ef3be)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:32.720058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d19d7e-a63b-439b-9bfd-80797ed0e619 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:32.789910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237ad8a-8d83-4f85-8549-1aa7963740ec admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:32.821544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d5109-459f-4659-b06e-9aab635d7ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:32.822630 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5109-459f-4659-b06e-9aab635d7ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:32.831617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5109-459f-4659-b06e-9aab635d7ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:32.832144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5109-459f-4659-b06e-9aab635d7ac3 admin admin] PATH_INFO: `/v3/projects/da764cfc2ea3418fafbde4794ae7412c/users/37018f03006a4184b9ef416edc090c7b/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:32.854560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d5109-459f-4659-b06e-9aab635d7ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da764cfc2ea3418fafbde4794ae7412c, user_id=37018f03006a4184b9ef416edc090c7b, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:32.878169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d9d19d7e-a63b-439b-9bfd-80797ed0e619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ffc5ee9226418593622144543ef3be', 'request_id': 'req-d9d19d7e-a63b-439b-9bfd-80797ed0e619'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:32.881922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d5109-459f-4659-b06e-9aab635d7ac3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:32.906115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d9d19d7e-a63b-439b-9bfd-80797ed0e619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ffc5ee9226418593622144543ef3be', 'request_id': 'req-d9d19d7e-a63b-439b-9bfd-80797ed0e619'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:32.929576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 831/1691] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:32 2022] PUT /identity/v3/projects/da764cfc2ea3418fafbde4794ae7412c/users/37018f03006a4184b9ef416edc090c7b/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:32.939597 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d9d19d7e-a63b-439b-9bfd-80797ed0e619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ffc5ee9226418593622144543ef3be', 'request_id': 'req-d9d19d7e-a63b-439b-9bfd-80797ed0e619'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:32.941400 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a71c6b-ca59-46a6-aae8-a09d8a56d5c9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:32.941890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a71c6b-ca59-46a6-aae8-a09d8a56d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:32.942428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a71c6b-ca59-46a6-aae8-a09d8a56d5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:32.976798 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d9d19d7e-a63b-439b-9bfd-80797ed0e619 admin admin] The token cache is being invalidate because project 14ffc5ee9226418593622144543ef3be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:23:32.979400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d9d19d7e-a63b-439b-9bfd-80797ed0e619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:32.981372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d9d19d7e-a63b-439b-9bfd-80797ed0e619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:32.986209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 861/1692] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:23:32 2022] DELETE /identity/v3/projects/14ffc5ee9226418593622144543ef3be => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:23:32.994494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfab99-69de-4cc0-b788-26d55765ea6b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:32.994997 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfab99-69de-4cc0-b788-26d55765ea6b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:32.995544 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfab99-69de-4cc0-b788-26d55765ea6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:33.022210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-83dfab99-69de-4cc0-b788-26d55765ea6b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:33.024220 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-83dfab99-69de-4cc0-b788-26d55765ea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:33.149537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-57a71c6b-ca59-46a6-aae8-a09d8a56d5c9 None None] MFA Rules not processed for user `37018f03006a4184b9ef416edc090c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:33.152192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-57a71c6b-ca59-46a6-aae8-a09d8a56d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:33.184723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 862/1693] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:33.186532 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f889296-c400-4fb1-b205-a61119cf34ab None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:33.186818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f889296-c400-4fb1-b205-a61119cf34ab None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:33.187095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f889296-c400-4fb1-b205-a61119cf34ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:33.219650 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7f889296-c400-4fb1-b205-a61119cf34ab None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:33.221039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7f889296-c400-4fb1-b205-a61119cf34ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:33.238325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 863/1694] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:33.240186 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f889296-c400-4fb1-b205-a61119cf34ab None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:33.265130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f889296-c400-4fb1-b205-a61119cf34ab None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:33.275804 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfa92d-97a0-40e9-8045-35c33e7d841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:33.278284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfa92d-97a0-40e9-8045-35c33e7d841d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:33.278631 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfa92d-97a0-40e9-8045-35c33e7d841d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:33.278906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfa92d-97a0-40e9-8045-35c33e7d841d admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:33.281723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfa92d-97a0-40e9-8045-35c33e7d841d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:23:33.282041 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfa92d-97a0-40e9-8045-35c33e7d841d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:33.289384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfa92d-97a0-40e9-8045-35c33e7d841d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:33.334213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 864/1695] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:23:33.335316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfa92d-97a0-40e9-8045-35c33e7d841d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:33.371335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfa92d-97a0-40e9-8045-35c33e7d841d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:33.406762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6a307-651c-462f-b2c5-6d9b5c49ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:33.408042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6a307-651c-462f-b2c5-6d9b5c49ece7 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:33.408555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6a307-651c-462f-b2c5-6d9b5c49ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:33.409123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6a307-651c-462f-b2c5-6d9b5c49ece7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:33.410339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6a307-651c-462f-b2c5-6d9b5c49ece7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:33.415393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6a307-651c-462f-b2c5-6d9b5c49ece7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:33.527168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 865/1696] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:33 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:33.530935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6a307-651c-462f-b2c5-6d9b5c49ece7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:33.647071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 832/1697] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 708 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:23:33.647274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:33.682863 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a71c6b-ca59-46a6-aae8-a09d8a56d5c9 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:33.687349 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-57a71c6b-ca59-46a6-aae8-a09d8a56d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:33.697888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6a307-651c-462f-b2c5-6d9b5c49ece7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:33.705966 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2542274-6d7c-4cbb-9b4a-9524e28741b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:33.706617 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2542274-6d7c-4cbb-9b4a-9524e28741b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:33.706897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2542274-6d7c-4cbb-9b4a-9524e28741b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:33.707172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2542274-6d7c-4cbb-9b4a-9524e28741b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:33.708463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2542274-6d7c-4cbb-9b4a-9524e28741b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:33.710822 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2542274-6d7c-4cbb-9b4a-9524e28741b9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:33.749854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 866/1698] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:33 2022] POST /identity/v3/users => generated 284 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:23:33.756421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2542274-6d7c-4cbb-9b4a-9524e28741b9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:33.773180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2542274-6d7c-4cbb-9b4a-9524e28741b9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:33.782534 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d016b7-afb6-454c-85c8-36a61105c849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:33.783453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d016b7-afb6-454c-85c8-36a61105c849 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:33.784011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d016b7-afb6-454c-85c8-36a61105c849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:33.784618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d016b7-afb6-454c-85c8-36a61105c849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:33.786194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d016b7-afb6-454c-85c8-36a61105c849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:33.789055 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d016b7-afb6-454c-85c8-36a61105c849 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:33.809018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 867/1699] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:33.810511 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d016b7-afb6-454c-85c8-36a61105c849 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:33.855193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d016b7-afb6-454c-85c8-36a61105c849 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:33.870672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5545b-e0de-44fa-b60f-99258b20b47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:33.872542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5545b-e0de-44fa-b60f-99258b20b47a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:33.873034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5545b-e0de-44fa-b60f-99258b20b47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:33.874424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5545b-e0de-44fa-b60f-99258b20b47a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:33.875609 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5545b-e0de-44fa-b60f-99258b20b47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:33.878671 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5545b-e0de-44fa-b60f-99258b20b47a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:33.915814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 868/1700] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:33.917675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5545b-e0de-44fa-b60f-99258b20b47a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:33.943405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5545b-e0de-44fa-b60f-99258b20b47a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:33.959679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b2c43-cf00-4165-b8c4-ca391df253d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:33.963261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b2c43-cf00-4165-b8c4-ca391df253d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:33.968403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b2c43-cf00-4165-b8c4-ca391df253d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:33.970717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b2c43-cf00-4165-b8c4-ca391df253d2 admin admin] PATH_INFO: `/v3/projects/dbe737edf8e54a45924c413c8aeea8fc/users/8cfdbaef0631467b95e0073660d98ee0/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:34.004163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a71c6b-ca59-46a6-aae8-a09d8a56d5c9 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:34.055110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b2c43-cf00-4165-b8c4-ca391df253d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe737edf8e54a45924c413c8aeea8fc, user_id=8cfdbaef0631467b95e0073660d98ee0, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:34.073351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b2c43-cf00-4165-b8c4-ca391df253d2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:34.125009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 869/1701] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:33 2022] PUT /identity/v3/projects/dbe737edf8e54a45924c413c8aeea8fc/users/8cfdbaef0631467b95e0073660d98ee0/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:34.147554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1f421-3f0d-4755-9ed8-a6ed30a4ae89 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:34.152635 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1f421-3f0d-4755-9ed8-a6ed30a4ae89 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:34.153136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1f421-3f0d-4755-9ed8-a6ed30a4ae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:34.221558 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-68b1f421-3f0d-4755-9ed8-a6ed30a4ae89 None None] MFA Rules not processed for user `8cfdbaef0631467b95e0073660d98ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:34.225089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-68b1f421-3f0d-4755-9ed8-a6ed30a4ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:34.240240 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88659301-8271-4e00-9735-7161a83929a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:34.242078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88659301-8271-4e00-9735-7161a83929a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:34.242569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88659301-8271-4e00-9735-7161a83929a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:34.243091 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88659301-8271-4e00-9735-7161a83929a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:34.294383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:34.402687 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 870/1702] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:34.430729 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1f421-3f0d-4755-9ed8-a6ed30a4ae89 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:34.432524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-68b1f421-3f0d-4755-9ed8-a6ed30a4ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:34.502147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88659301-8271-4e00-9735-7161a83929a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:34.504087 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88659301-8271-4e00-9735-7161a83929a7 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:34.537187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 833/1703] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 855 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:23:34.581686 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1f421-3f0d-4755-9ed8-a6ed30a4ae89 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:34.590559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257ba3b-9fbc-4e11-8e16-ba644aed8bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:34.591147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257ba3b-9fbc-4e11-8e16-ba644aed8bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:34.591372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257ba3b-9fbc-4e11-8e16-ba644aed8bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:34.591651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257ba3b-9fbc-4e11-8e16-ba644aed8bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:34.614794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257ba3b-9fbc-4e11-8e16-ba644aed8bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:34.616336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257ba3b-9fbc-4e11-8e16-ba644aed8bb3 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:34.641788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 871/1704] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:23:34.985029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88659301-8271-4e00-9735-7161a83929a7 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:35.003541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88659301-8271-4e00-9735-7161a83929a7 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:35.037275 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddaaf7-27a2-4c72-b1ca-68ecd80ce308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:35.043650 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddaaf7-27a2-4c72-b1ca-68ecd80ce308 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:35.043900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddaaf7-27a2-4c72-b1ca-68ecd80ce308 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:35.046676 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddaaf7-27a2-4c72-b1ca-68ecd80ce308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:35.053612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-52ddaaf7-27a2-4c72-b1ca-68ecd80ce308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:35.216274 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddaaf7-27a2-4c72-b1ca-68ecd80ce308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:35.219049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddaaf7-27a2-4c72-b1ca-68ecd80ce308 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:35.260123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 834/1705] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:35.570059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3761c-abb5-4ff7-9186-8c2983403a3c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:35.570059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3761c-abb5-4ff7-9186-8c2983403a3c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:35.570059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3761c-abb5-4ff7-9186-8c2983403a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:35.610922 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:35.680734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-19e3761c-abb5-4ff7-9186-8c2983403a3c None None] MFA Rules not processed for user `e8101d5e67194a4cad4391c9a66ad971`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:35.694256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-19e3761c-abb5-4ff7-9186-8c2983403a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:36.066028 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 872/1706] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:35 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:36.073101 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddaaf7-27a2-4c72-b1ca-68ecd80ce308 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:36.095444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-52ddaaf7-27a2-4c72-b1ca-68ecd80ce308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:36.365232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddaaf7-27a2-4c72-b1ca-68ecd80ce308 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:36.379668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505031e-0c7e-4cf8-b115-5dc417025dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:36.380425 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505031e-0c7e-4cf8-b115-5dc417025dfe admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:36.386188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505031e-0c7e-4cf8-b115-5dc417025dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:36.386498 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505031e-0c7e-4cf8-b115-5dc417025dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:36.398416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505031e-0c7e-4cf8-b115-5dc417025dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:36.404958 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505031e-0c7e-4cf8-b115-5dc417025dfe admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:36.518765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 835/1707] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:36 2022] POST /identity/v3/projects => generated 403 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:36.520850 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3761c-abb5-4ff7-9186-8c2983403a3c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:36.546142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3761c-abb5-4ff7-9186-8c2983403a3c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:36.844911 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5ae23-ee5c-4fcb-8022-6e6dec664076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:36.846070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ae23-ee5c-4fcb-8022-6e6dec664076 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:36.846451 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ae23-ee5c-4fcb-8022-6e6dec664076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:36.848102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ae23-ee5c-4fcb-8022-6e6dec664076 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:36.858535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5ae23-ee5c-4fcb-8022-6e6dec664076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:36.902843 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5ae23-ee5c-4fcb-8022-6e6dec664076 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:36.984751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 873/1708] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:36 2022] POST /identity/v3/users => generated 308 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:36.990574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505031e-0c7e-4cf8-b115-5dc417025dfe admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:37.049264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505031e-0c7e-4cf8-b115-5dc417025dfe admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:37.099989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd485c-9069-41c5-acd3-e7ff74cd1c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:37.103555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd485c-9069-41c5-acd3-e7ff74cd1c60 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:37.106237 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd485c-9069-41c5-acd3-e7ff74cd1c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:37.111727 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd485c-9069-41c5-acd3-e7ff74cd1c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:37.113892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd485c-9069-41c5-acd3-e7ff74cd1c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:37.124834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd485c-9069-41c5-acd3-e7ff74cd1c60 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:37.230046 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 836/1709] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:37.237107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5ae23-ee5c-4fcb-8022-6e6dec664076 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:37.263276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5ae23-ee5c-4fcb-8022-6e6dec664076 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:37.291468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9520a5d-9a60-4a0b-a3c8-03e6f74ff06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:37.291765 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9520a5d-9a60-4a0b-a3c8-03e6f74ff06b admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:37.291926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9520a5d-9a60-4a0b-a3c8-03e6f74ff06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:37.295397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9520a5d-9a60-4a0b-a3c8-03e6f74ff06b admin admin] PATH_INFO: `/v3/projects/e726db2505fe43bba31ea915317e8167/users/d97a94b9e6ba4313bef59f3a07025162/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:37.344217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9520a5d-9a60-4a0b-a3c8-03e6f74ff06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e726db2505fe43bba31ea915317e8167, user_id=d97a94b9e6ba4313bef59f3a07025162, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:37.352079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9520a5d-9a60-4a0b-a3c8-03e6f74ff06b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:37.390462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 874/1710] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:37 2022] PUT /identity/v3/projects/e726db2505fe43bba31ea915317e8167/users/d97a94b9e6ba4313bef59f3a07025162/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:23:37.396680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd485c-9069-41c5-acd3-e7ff74cd1c60 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:37.472483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd485c-9069-41c5-acd3-e7ff74cd1c60 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:37.677750 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:37.969762 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c9935-a9fb-4626-9c7c-a2497706e31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:37.971241 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c9935-a9fb-4626-9c7c-a2497706e31b admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:37.974381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c9935-a9fb-4626-9c7c-a2497706e31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:37.976549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c9935-a9fb-4626-9c7c-a2497706e31b admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:37.980870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c9935-a9fb-4626-9c7c-a2497706e31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:38.003673 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c9935-a9fb-4626-9c7c-a2497706e31b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:38.083899 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 837/1711] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 688 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:23:38.100386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9520a5d-9a60-4a0b-a3c8-03e6f74ff06b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:38.212549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9520a5d-9a60-4a0b-a3c8-03e6f74ff06b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:38.225730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89c7d3-0a05-4537-a01d-fb7099a1af0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:38.228272 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89c7d3-0a05-4537-a01d-fb7099a1af0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:38.229946 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89c7d3-0a05-4537-a01d-fb7099a1af0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:38.231402 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89c7d3-0a05-4537-a01d-fb7099a1af0a admin admin] PATH_INFO: `/v3/projects/e726db2505fe43bba31ea915317e8167/users/d97a94b9e6ba4313bef59f3a07025162/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:38.238752 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89c7d3-0a05-4537-a01d-fb7099a1af0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e726db2505fe43bba31ea915317e8167, user_id=d97a94b9e6ba4313bef59f3a07025162, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:38.250933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89c7d3-0a05-4537-a01d-fb7099a1af0a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:38.326180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 875/1712] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:23:38 2022] PUT /identity/v3/projects/e726db2505fe43bba31ea915317e8167/users/d97a94b9e6ba4313bef59f3a07025162/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:39.888419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8469e77-c3d0-47d2-b940-bbdfc2ef1a7b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:39.889114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8469e77-c3d0-47d2-b940-bbdfc2ef1a7b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:39.891538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8469e77-c3d0-47d2-b940-bbdfc2ef1a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:39.954283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b8469e77-c3d0-47d2-b940-bbdfc2ef1a7b None None] MFA Rules not processed for user `d6b48a9e72564cefb5a4865d944a9a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:39.955963 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b8469e77-c3d0-47d2-b940-bbdfc2ef1a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:40.075594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 838/1713] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:40.110275 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89c7d3-0a05-4537-a01d-fb7099a1af0a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:40.112797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0c89c7d3-0a05-4537-a01d-fb7099a1af0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:40.316519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:40.392590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89c7d3-0a05-4537-a01d-fb7099a1af0a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:40.400320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435641c-cf23-48d4-8b74-5cd24d5da71f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:40.401257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435641c-cf23-48d4-8b74-5cd24d5da71f service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:40.401648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435641c-cf23-48d4-8b74-5cd24d5da71f service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:40.402061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435641c-cf23-48d4-8b74-5cd24d5da71f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:40.418933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435641c-cf23-48d4-8b74-5cd24d5da71f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:40.425367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435641c-cf23-48d4-8b74-5cd24d5da71f service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:40.443480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749cde6-8d5d-441a-9796-16eeff06b6ed None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:40.443833 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749cde6-8d5d-441a-9796-16eeff06b6ed None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:40.444345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749cde6-8d5d-441a-9796-16eeff06b6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:40.457287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 876/1714] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:40.498860 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-4749cde6-8d5d-441a-9796-16eeff06b6ed None None] MFA Rules not processed for user `2e22e9e7fbf1419b8359f38b4a0f154e`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:40.501679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4749cde6-8d5d-441a-9796-16eeff06b6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:40.734051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 839/1715] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:23:40.764314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6703d29-7d84-4346-a0da-9c6787b495ba None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:40.764776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6703d29-7d84-4346-a0da-9c6787b495ba None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:40.765152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6703d29-7d84-4346-a0da-9c6787b495ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:40.824731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d6703d29-7d84-4346-a0da-9c6787b495ba None None] MFA Rules not processed for user `2e22e9e7fbf1419b8359f38b4a0f154e`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:40.857240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d6703d29-7d84-4346-a0da-9c6787b495ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:40.901723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 877/1716] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:23:40.917176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749cde6-8d5d-441a-9796-16eeff06b6ed None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:40.919380 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4749cde6-8d5d-441a-9796-16eeff06b6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:41.025406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749cde6-8d5d-441a-9796-16eeff06b6ed None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:41.090279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5331d27-03d7-410e-8ec6-76bd72a1b622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:41.090936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5331d27-03d7-410e-8ec6-76bd72a1b622 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:41.091215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5331d27-03d7-410e-8ec6-76bd72a1b622 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:41.092331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5331d27-03d7-410e-8ec6-76bd72a1b622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:41.118359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5331d27-03d7-410e-8ec6-76bd72a1b622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:41.122651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5331d27-03d7-410e-8ec6-76bd72a1b622 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:41.190946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 840/1717] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:41.769115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192c0f2-1cb4-4162-a0f1-98fb62fb66d9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:41.769664 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192c0f2-1cb4-4162-a0f1-98fb62fb66d9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:41.770097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192c0f2-1cb4-4162-a0f1-98fb62fb66d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:41.932335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3192c0f2-1cb4-4162-a0f1-98fb62fb66d9 None None] MFA Rules not processed for user `497c2547b8dd4bd1bbb804a9395dc20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:41.938475 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3192c0f2-1cb4-4162-a0f1-98fb62fb66d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:42.250973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 878/1718] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:42.307343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5331d27-03d7-410e-8ec6-76bd72a1b622 service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:42.327156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5331d27-03d7-410e-8ec6-76bd72a1b622 service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:42.343098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa694cb-0fd9-4dde-a9ab-bedb8f490844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:42.343837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa694cb-0fd9-4dde-a9ab-bedb8f490844 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:42.344187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa694cb-0fd9-4dde-a9ab-bedb8f490844 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:42.344525 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa694cb-0fd9-4dde-a9ab-bedb8f490844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:42.362215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa694cb-0fd9-4dde-a9ab-bedb8f490844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:42.363949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa694cb-0fd9-4dde-a9ab-bedb8f490844 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:42.386857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 841/1719] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:43.205821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fffcee-f68d-44cc-b864-51e4577f2681 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:43.207392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fffcee-f68d-44cc-b864-51e4577f2681 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:43.208355 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fffcee-f68d-44cc-b864-51e4577f2681 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:43.211423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 879/1720] 10.222.0.16 () {54 vars in 912 bytes} [Wed Sep 21 16:23:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:23:43.225021 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96aff-3931-42c9-81ba-0cf9d9643f23 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:43.225021 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96aff-3931-42c9-81ba-0cf9d9643f23 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:43.225021 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96aff-3931-42c9-81ba-0cf9d9643f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:43.273809 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:43.345785 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-22a96aff-3931-42c9-81ba-0cf9d9643f23 None None] MFA Rules not processed for user `0e765e2cc4c94243b00f919e8f8d01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:43.347892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-22a96aff-3931-42c9-81ba-0cf9d9643f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:43.469719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 842/1721] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:23:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:43.614158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cef879-3f80-43e9-b4c8-9f4de2f53047 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:43.614816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cef879-3f80-43e9-b4c8-9f4de2f53047 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:43.615260 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cef879-3f80-43e9-b4c8-9f4de2f53047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:43.617011 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a96aff-3931-42c9-81ba-0cf9d9643f23 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:43.621946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-22a96aff-3931-42c9-81ba-0cf9d9643f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:43.670651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a96aff-3931-42c9-81ba-0cf9d9643f23 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:43.687701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0963959-ce7c-4a6d-96bb-95a82bdbf31d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:43.688638 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0963959-ce7c-4a6d-96bb-95a82bdbf31d service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:43.689561 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0963959-ce7c-4a6d-96bb-95a82bdbf31d service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:43.697291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0963959-ce7c-4a6d-96bb-95a82bdbf31d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:43.730370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0963959-ce7c-4a6d-96bb-95a82bdbf31d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:43.732181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0963959-ce7c-4a6d-96bb-95a82bdbf31d service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:43.753562 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-25cef879-3f80-43e9-b4c8-9f4de2f53047 None None] MFA Rules not processed for user `d97a94b9e6ba4313bef59f3a07025162`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:43.754985 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-25cef879-3f80-43e9-b4c8-9f4de2f53047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:43.776041 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 843/1722] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:44.048639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 880/1723] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:43 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:45.865310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0963959-ce7c-4a6d-96bb-95a82bdbf31d service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:45.867973 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d0963959-ce7c-4a6d-96bb-95a82bdbf31d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:45.905464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555074-f172-4f4f-8305-2cdf9e00ac9f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:45.906290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555074-f172-4f4f-8305-2cdf9e00ac9f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:45.906425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555074-f172-4f4f-8305-2cdf9e00ac9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:46.078990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-41555074-f172-4f4f-8305-2cdf9e00ac9f None None] MFA Rules not processed for user `b6093246f53b4dcb961f47aea99fb1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:46.092153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-41555074-f172-4f4f-8305-2cdf9e00ac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:46.137835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0963959-ce7c-4a6d-96bb-95a82bdbf31d service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:46.154510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75faf7-8f2f-4c9b-afb8-418d631647f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd3076ca5a84ff7ada13065f9531f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:46.155262 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75faf7-8f2f-4c9b-afb8-418d631647f2 service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:46.155743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75faf7-8f2f-4c9b-afb8-418d631647f2 service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:46.156068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75faf7-8f2f-4c9b-afb8-418d631647f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:46.163043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3e75faf7-8f2f-4c9b-afb8-418d631647f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:46.191633 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75faf7-8f2f-4c9b-afb8-418d631647f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:46.193500 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75faf7-8f2f-4c9b-afb8-418d631647f2 service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:46.217218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 844/1724] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:46.327395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:46.522338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 881/1725] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 619 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:23:46.543119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75faf7-8f2f-4c9b-afb8-418d631647f2 service placement] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:46.574458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75faf7-8f2f-4c9b-afb8-418d631647f2 service placement] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:46.591336 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701d991-263b-4cd9-875d-7e76e36cad10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:46.592002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701d991-263b-4cd9-875d-7e76e36cad10 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:46.592372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701d991-263b-4cd9-875d-7e76e36cad10 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:46.592737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701d991-263b-4cd9-875d-7e76e36cad10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:46.619483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701d991-263b-4cd9-875d-7e76e36cad10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:46.623338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701d991-263b-4cd9-875d-7e76e36cad10 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:46.651437 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 845/1726] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:23:48.279879 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41555074-f172-4f4f-8305-2cdf9e00ac9f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:48.284408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-41555074-f172-4f4f-8305-2cdf9e00ac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:48.605345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aab788-a75a-4e3f-9ea3-6317346d268a None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:48.606213 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aab788-a75a-4e3f-9ea3-6317346d268a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:48.606213 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aab788-a75a-4e3f-9ea3-6317346d268a None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:48.608374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 846/1727] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 21 16:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:23:48.618949 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41555074-f172-4f4f-8305-2cdf9e00ac9f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:48.656128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b6bdd-f3a8-4679-b6c4-a76fb5f2f48b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:48.665196 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c81b0-3a3b-4d4f-a381-8bd95fed428b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:48.670123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b6bdd-f3a8-4679-b6c4-a76fb5f2f48b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:48.673458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b6bdd-f3a8-4679-b6c4-a76fb5f2f48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:48.686031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c81b0-3a3b-4d4f-a381-8bd95fed428b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:48.689480 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c81b0-3a3b-4d4f-a381-8bd95fed428b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:48.690646 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c81b0-3a3b-4d4f-a381-8bd95fed428b admin admin] PATH_INFO: `/v3/users/18af8850ed61415dabff9a84d8cc3c9f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:48.702348 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c81b0-3a3b-4d4f-a381-8bd95fed428b admin admin] RBAC: Authorizing `identity:delete_user(user_id=18af8850ed61415dabff9a84d8cc3c9f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:48.708192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c81b0-3a3b-4d4f-a381-8bd95fed428b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:48.783867 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2d6b6bdd-f3a8-4679-b6c4-a76fb5f2f48b None None] MFA Rules not processed for user `7cd3076ca5a84ff7ada13065f9531f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:48.785999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2d6b6bdd-f3a8-4679-b6c4-a76fb5f2f48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:48.843803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 847/1728] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 21 16:23:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:23:48.857876 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-069c81b0-3a3b-4d4f-a381-8bd95fed428b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18af8850ed61415dabff9a84d8cc3c9f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:48.858796 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-069c81b0-3a3b-4d4f-a381-8bd95fed428b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18af8850ed61415dabff9a84d8cc3c9f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:48.891106 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6e487-3467-4174-a870-a108e7736575 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:48.891906 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6e487-3467-4174-a870-a108e7736575 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:48.892373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6e487-3467-4174-a870-a108e7736575 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:48.898597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 848/1729] 10.222.0.16 () {54 vars in 961 bytes} [Wed Sep 21 16:23:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:23:48.905722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-069c81b0-3a3b-4d4f-a381-8bd95fed428b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18af8850ed61415dabff9a84d8cc3c9f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:48.924889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c51c8-715f-47dc-9906-70c4b1ce5690 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:48.925151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c51c8-715f-47dc-9906-70c4b1ce5690 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:48.925976 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c51c8-715f-47dc-9906-70c4b1ce5690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:48.951135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-069c81b0-3a3b-4d4f-a381-8bd95fed428b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18af8850ed61415dabff9a84d8cc3c9f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:48.952955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-069c81b0-3a3b-4d4f-a381-8bd95fed428b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18af8850ed61415dabff9a84d8cc3c9f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:49.002315 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e55c51c8-715f-47dc-9906-70c4b1ce5690 None None] MFA Rules not processed for user `7cd3076ca5a84ff7ada13065f9531f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:49.014629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 882/1730] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:23:48 2022] DELETE /identity/v3/users/18af8850ed61415dabff9a84d8cc3c9f => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:49.018066 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e55c51c8-715f-47dc-9906-70c4b1ce5690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:49.028401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d3095-42ce-47fa-b032-00475100c839 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:49.037092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d3095-42ce-47fa-b032-00475100c839 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:49.040305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d3095-42ce-47fa-b032-00475100c839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:49.156547 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-417d3095-42ce-47fa-b032-00475100c839 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:49.161074 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-417d3095-42ce-47fa-b032-00475100c839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:49.354936 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:49.366343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:49.411827 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 849/1731] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Sep 21 16:23:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:49.435231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c51c8-715f-47dc-9906-70c4b1ce5690 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:49.458360 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 883/1732] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:49.497239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c51c8-715f-47dc-9906-70c4b1ce5690 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:49.509310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258782e-f460-4455-81e9-8be537ca7d4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd3076ca5a84ff7ada13065f9531f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:49.512451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258782e-f460-4455-81e9-8be537ca7d4f service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:49.513018 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258782e-f460-4455-81e9-8be537ca7d4f service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:49.514248 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258782e-f460-4455-81e9-8be537ca7d4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:49.532949 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d3095-42ce-47fa-b032-00475100c839 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:49.535217 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2258782e-f460-4455-81e9-8be537ca7d4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:49.535981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-417d3095-42ce-47fa-b032-00475100c839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:49.588307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258782e-f460-4455-81e9-8be537ca7d4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:49.595437 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258782e-f460-4455-81e9-8be537ca7d4f service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:49.629953 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 850/1733] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:49.632356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0e614-fa00-4f9b-8641-6163a660adab None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:49.634183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0e614-fa00-4f9b-8641-6163a660adab None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:49.634680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0e614-fa00-4f9b-8641-6163a660adab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:49.715166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2ad0e614-fa00-4f9b-8641-6163a660adab None None] MFA Rules not processed for user `d6b48a9e72564cefb5a4865d944a9a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:49.718967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2ad0e614-fa00-4f9b-8641-6163a660adab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:49.890827 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d3095-42ce-47fa-b032-00475100c839 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:49.911993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb60d68-ea2e-497b-bede-e26dac20f9f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:49.913381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb60d68-ea2e-497b-bede-e26dac20f9f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:49.913949 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb60d68-ea2e-497b-bede-e26dac20f9f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:49.914536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb60d68-ea2e-497b-bede-e26dac20f9f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:49.961063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 851/1734] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:49.982182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb60d68-ea2e-497b-bede-e26dac20f9f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:49.994454 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb60d68-ea2e-497b-bede-e26dac20f9f1 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:50.055735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 884/1735] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:50.086972 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea15bcc-7187-45fb-be57-63bb40cfd316 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:50.087259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea15bcc-7187-45fb-be57-63bb40cfd316 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:50.087531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea15bcc-7187-45fb-be57-63bb40cfd316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:50.189896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5ea15bcc-7187-45fb-be57-63bb40cfd316 None None] MFA Rules not processed for user `497c2547b8dd4bd1bbb804a9395dc20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:50.191152 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5ea15bcc-7187-45fb-be57-63bb40cfd316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:50.218111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb60d68-ea2e-497b-bede-e26dac20f9f1 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:50.222231 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4cb60d68-ea2e-497b-bede-e26dac20f9f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:50.346870 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb60d68-ea2e-497b-bede-e26dac20f9f1 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:50.372447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac89a23-8cd4-4aa3-aaa8-3f8e1a5c4433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:50.377063 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac89a23-8cd4-4aa3-aaa8-3f8e1a5c4433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:50.377795 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac89a23-8cd4-4aa3-aaa8-3f8e1a5c4433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:50.378369 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac89a23-8cd4-4aa3-aaa8-3f8e1a5c4433 admin admin] PATH_INFO: `/v3/users/8cfdbaef0631467b95e0073660d98ee0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:50.383461 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac89a23-8cd4-4aa3-aaa8-3f8e1a5c4433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cfdbaef0631467b95e0073660d98ee0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:50.393132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac89a23-8cd4-4aa3-aaa8-3f8e1a5c4433 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:50.479199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 852/1736] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:50.651922 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ac89a23-8cd4-4aa3-aaa8-3f8e1a5c4433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cfdbaef0631467b95e0073660d98ee0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:50.656859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ac89a23-8cd4-4aa3-aaa8-3f8e1a5c4433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cfdbaef0631467b95e0073660d98ee0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:50.751016 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ac89a23-8cd4-4aa3-aaa8-3f8e1a5c4433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cfdbaef0631467b95e0073660d98ee0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:50.806279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ac89a23-8cd4-4aa3-aaa8-3f8e1a5c4433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cfdbaef0631467b95e0073660d98ee0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:50.810111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ac89a23-8cd4-4aa3-aaa8-3f8e1a5c4433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cfdbaef0631467b95e0073660d98ee0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:50.932679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 885/1737] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:23:50 2022] DELETE /identity/v3/users/8cfdbaef0631467b95e0073660d98ee0 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:50.934635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd63acf-18df-44db-9b3f-5696fb030e69 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:50.935341 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd63acf-18df-44db-9b3f-5696fb030e69 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:50.935341 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd63acf-18df-44db-9b3f-5696fb030e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:51.011554 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8cd63acf-18df-44db-9b3f-5696fb030e69 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:51.030042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8cd63acf-18df-44db-9b3f-5696fb030e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:51.324219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 853/1738] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:51.618959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac89a23-8cd4-4aa3-aaa8-3f8e1a5c4433 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:51.621201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2ac89a23-8cd4-4aa3-aaa8-3f8e1a5c4433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:51.702191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34d597-981d-4882-b1c1-6088c5ef252e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:51.702821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34d597-981d-4882-b1c1-6088c5ef252e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:51.703437 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34d597-981d-4882-b1c1-6088c5ef252e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:51.830525 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac89a23-8cd4-4aa3-aaa8-3f8e1a5c4433 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:51.845136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bc756-02f1-46bf-8c3b-44bc7a8b043c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:51.846378 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc756-02f1-46bf-8c3b-44bc7a8b043c service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:51.846639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc756-02f1-46bf-8c3b-44bc7a8b043c service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:51.847314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc756-02f1-46bf-8c3b-44bc7a8b043c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:51.878007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bc756-02f1-46bf-8c3b-44bc7a8b043c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:51.879795 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bc756-02f1-46bf-8c3b-44bc7a8b043c service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:51.909100 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 886/1739] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:51.940583 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-cc34d597-981d-4882-b1c1-6088c5ef252e None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:51.951262 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cc34d597-981d-4882-b1c1-6088c5ef252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:52.021033 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:52.170908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 854/1740] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:23:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:52.559972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bc756-02f1-46bf-8c3b-44bc7a8b043c service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:52.564638 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-476bc756-02f1-46bf-8c3b-44bc7a8b043c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:52.613297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:52.709738 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe966407-2429-456f-a943-9f700a183d41 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:52.710258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe966407-2429-456f-a943-9f700a183d41 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:52.710746 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe966407-2429-456f-a943-9f700a183d41 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:52.715350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 855/1741] 10.222.0.16 () {54 vars in 912 bytes} [Wed Sep 21 16:23:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:23:52.727215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899eda3-f19b-4a82-812f-b36d18ad3124 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:52.727740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899eda3-f19b-4a82-812f-b36d18ad3124 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:52.728248 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899eda3-f19b-4a82-812f-b36d18ad3124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:52.828837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5899eda3-f19b-4a82-812f-b36d18ad3124 None None] MFA Rules not processed for user `0e765e2cc4c94243b00f919e8f8d01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:52.834317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5899eda3-f19b-4a82-812f-b36d18ad3124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:52.873600 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 856/1742] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:52.878338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899eda3-f19b-4a82-812f-b36d18ad3124 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:52.884776 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5899eda3-f19b-4a82-812f-b36d18ad3124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:52.933737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899eda3-f19b-4a82-812f-b36d18ad3124 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:52.960918 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:52.964603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:52.965402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:52.966688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] PATH_INFO: `/v3/projects/e48c9da18e4b4bb18534f0eceb61d85a` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:52.971662 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e48c9da18e4b4bb18534f0eceb61d85a)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:52.975819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:53.066784 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bc756-02f1-46bf-8c3b-44bc7a8b043c service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:53.114951 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48c9da18e4b4bb18534f0eceb61d85a', 'request_id': 'req-71e45d53-2b46-4c62-a253-edd3ed34595b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:53.138768 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48c9da18e4b4bb18534f0eceb61d85a', 'request_id': 'req-71e45d53-2b46-4c62-a253-edd3ed34595b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:53.181341 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48c9da18e4b4bb18534f0eceb61d85a', 'request_id': 'req-71e45d53-2b46-4c62-a253-edd3ed34595b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:53.233997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] The token cache is being invalidate because project e48c9da18e4b4bb18534f0eceb61d85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:23:53.235276 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:53.238038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:53.246182 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 857/1743] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:23:52 2022] DELETE /identity/v3/projects/e48c9da18e4b4bb18534f0eceb61d85a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:53.248541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:53.253413 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:53.269608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926c279-ae37-44b1-949a-e4fafefc1317 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:53.270220 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c279-ae37-44b1-949a-e4fafefc1317 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:53.270685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c279-ae37-44b1-949a-e4fafefc1317 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:53.271134 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c279-ae37-44b1-949a-e4fafefc1317 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:53.280316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3926c279-ae37-44b1-949a-e4fafefc1317 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:53.463115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926c279-ae37-44b1-949a-e4fafefc1317 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:53.466021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926c279-ae37-44b1-949a-e4fafefc1317 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:53.492038 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 887/1744] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:23:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 934 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:23:53.495470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926c279-ae37-44b1-949a-e4fafefc1317 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:53.500334 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3926c279-ae37-44b1-949a-e4fafefc1317 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:53.574958 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e45d53-2b46-4c62-a253-edd3ed34595b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:53.601544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fcd30-8081-4292-b8fa-8cf5b0ac6920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:53.602565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fcd30-8081-4292-b8fa-8cf5b0ac6920 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:53.604029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fcd30-8081-4292-b8fa-8cf5b0ac6920 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:53.604029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fcd30-8081-4292-b8fa-8cf5b0ac6920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:53.614663 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bc4fcd30-8081-4292-b8fa-8cf5b0ac6920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:53.654540 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fcd30-8081-4292-b8fa-8cf5b0ac6920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:53.663084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fcd30-8081-4292-b8fa-8cf5b0ac6920 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:53.685002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 858/1745] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:53.725937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:53.810785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926c279-ae37-44b1-949a-e4fafefc1317 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:53.816421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8e48d-a0cd-4145-9420-42c7f0f9e486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:53.817551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e48d-a0cd-4145-9420-42c7f0f9e486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:53.818005 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e48d-a0cd-4145-9420-42c7f0f9e486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:53.818451 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e48d-a0cd-4145-9420-42c7f0f9e486 admin admin] PATH_INFO: `/v3/users/37018f03006a4184b9ef416edc090c7b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:53.825523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8e48d-a0cd-4145-9420-42c7f0f9e486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37018f03006a4184b9ef416edc090c7b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:53.830177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8e48d-a0cd-4145-9420-42c7f0f9e486 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:53.981249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9ce8e48d-a0cd-4145-9420-42c7f0f9e486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37018f03006a4184b9ef416edc090c7b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:53.990487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9ce8e48d-a0cd-4145-9420-42c7f0f9e486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37018f03006a4184b9ef416edc090c7b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:54.076653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9ce8e48d-a0cd-4145-9420-42c7f0f9e486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37018f03006a4184b9ef416edc090c7b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:54.140519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9ce8e48d-a0cd-4145-9420-42c7f0f9e486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37018f03006a4184b9ef416edc090c7b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:54.149804 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9ce8e48d-a0cd-4145-9420-42c7f0f9e486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37018f03006a4184b9ef416edc090c7b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:54.224740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 888/1746] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:23:53 2022] DELETE /identity/v3/users/37018f03006a4184b9ef416edc090c7b => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:55.453455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fcd30-8081-4292-b8fa-8cf5b0ac6920 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:55.461084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bc4fcd30-8081-4292-b8fa-8cf5b0ac6920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:55.529892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fcd30-8081-4292-b8fa-8cf5b0ac6920 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:55.625502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:55.717707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0287cb-bb79-4983-9f15-864315c783cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:55.718471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0287cb-bb79-4983-9f15-864315c783cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:55.718822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0287cb-bb79-4983-9f15-864315c783cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:55.719541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0287cb-bb79-4983-9f15-864315c783cc admin admin] PATH_INFO: `/v3/users/e8101d5e67194a4cad4391c9a66ad971` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:55.721456 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0287cb-bb79-4983-9f15-864315c783cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8101d5e67194a4cad4391c9a66ad971)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:55.723773 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0287cb-bb79-4983-9f15-864315c783cc admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:55.847571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b0287cb-bb79-4983-9f15-864315c783cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8101d5e67194a4cad4391c9a66ad971'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:55.848447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b0287cb-bb79-4983-9f15-864315c783cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8101d5e67194a4cad4391c9a66ad971'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:55.849144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b0287cb-bb79-4983-9f15-864315c783cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8101d5e67194a4cad4391c9a66ad971'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:55.869488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b0287cb-bb79-4983-9f15-864315c783cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8101d5e67194a4cad4391c9a66ad971'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:55.904896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b0287cb-bb79-4983-9f15-864315c783cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8101d5e67194a4cad4391c9a66ad971'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:55.937189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 859/1747] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:23:55 2022] DELETE /identity/v3/users/e8101d5e67194a4cad4391c9a66ad971 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:56.471738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8e48d-a0cd-4145-9420-42c7f0f9e486 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:56.474421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9ce8e48d-a0cd-4145-9420-42c7f0f9e486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:56.511085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8e48d-a0cd-4145-9420-42c7f0f9e486 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:57.056501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2116ff-01b7-45c4-810d-db95c89bcc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:57.058501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2116ff-01b7-45c4-810d-db95c89bcc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:57.061772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2116ff-01b7-45c4-810d-db95c89bcc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:57.065716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2116ff-01b7-45c4-810d-db95c89bcc65 admin admin] PATH_INFO: `/v3/projects/dbe737edf8e54a45924c413c8aeea8fc` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:57.074791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2116ff-01b7-45c4-810d-db95c89bcc65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe737edf8e54a45924c413c8aeea8fc)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:57.083885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2116ff-01b7-45c4-810d-db95c89bcc65 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:57.393974 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ad2116ff-01b7-45c4-810d-db95c89bcc65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe737edf8e54a45924c413c8aeea8fc', 'request_id': 'req-ad2116ff-01b7-45c4-810d-db95c89bcc65'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:57.421231 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:57.431536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ad2116ff-01b7-45c4-810d-db95c89bcc65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe737edf8e54a45924c413c8aeea8fc', 'request_id': 'req-ad2116ff-01b7-45c4-810d-db95c89bcc65'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:57.490643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ad2116ff-01b7-45c4-810d-db95c89bcc65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe737edf8e54a45924c413c8aeea8fc', 'request_id': 'req-ad2116ff-01b7-45c4-810d-db95c89bcc65'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:57.559894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ad2116ff-01b7-45c4-810d-db95c89bcc65 admin admin] The token cache is being invalidate because project dbe737edf8e54a45924c413c8aeea8fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:23:57.564061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ad2116ff-01b7-45c4-810d-db95c89bcc65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:57.565779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ad2116ff-01b7-45c4-810d-db95c89bcc65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:57.579685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 889/1748] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:23:56 2022] DELETE /identity/v3/projects/dbe737edf8e54a45924c413c8aeea8fc => generated 0 bytes in 1102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:57.581123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94050c-6c94-4b11-ad8a-0ee04187899e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:57.582004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94050c-6c94-4b11-ad8a-0ee04187899e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:57.582418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94050c-6c94-4b11-ad8a-0ee04187899e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:57.627946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9f94050c-6c94-4b11-ad8a-0ee04187899e None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:57.629026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9f94050c-6c94-4b11-ad8a-0ee04187899e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:57.848559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 860/1749] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:57.853041 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74872e4b-b37b-4a7c-8fc2-b71ad1a54ac7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:57.853922 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74872e4b-b37b-4a7c-8fc2-b71ad1a54ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:57.854730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74872e4b-b37b-4a7c-8fc2-b71ad1a54ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:57.907794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c9e3e-7845-4af9-aa5c-44cddade0b2a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:57.908161 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c9e3e-7845-4af9-aa5c-44cddade0b2a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:57.908443 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c9e3e-7845-4af9-aa5c-44cddade0b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:57.992027 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b49c9e3e-7845-4af9-aa5c-44cddade0b2a None None] MFA Rules not processed for user `0e765e2cc4c94243b00f919e8f8d01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:57.998516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b49c9e3e-7845-4af9-aa5c-44cddade0b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:58.016032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-74872e4b-b37b-4a7c-8fc2-b71ad1a54ac7 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:58.021340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-74872e4b-b37b-4a7c-8fc2-b71ad1a54ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:58.065353 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 890/1750] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:58.071000 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a77655-3c8d-4bbb-bfc9-cdb93e36f392 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:58.074160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a77655-3c8d-4bbb-bfc9-cdb93e36f392 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:58.074994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a77655-3c8d-4bbb-bfc9-cdb93e36f392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:58.171425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-78a77655-3c8d-4bbb-bfc9-cdb93e36f392 None None] MFA Rules not processed for user `b6093246f53b4dcb961f47aea99fb1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:58.178535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78a77655-3c8d-4bbb-bfc9-cdb93e36f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:58.344192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:58.377796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 861/1751] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Sep 21 16:23:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:23:58.391932 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c9e3e-7845-4af9-aa5c-44cddade0b2a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:58.471955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c9e3e-7845-4af9-aa5c-44cddade0b2a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:58.491529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 891/1752] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:23:58.497725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a77655-3c8d-4bbb-bfc9-cdb93e36f392 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:58.507340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78a77655-3c8d-4bbb-bfc9-cdb93e36f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:58.537110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85917c0-64fe-4d56-ae49-4d02a67b607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:58.538057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85917c0-64fe-4d56-ae49-4d02a67b607f admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:58.538480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85917c0-64fe-4d56-ae49-4d02a67b607f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:58.538936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85917c0-64fe-4d56-ae49-4d02a67b607f admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:58.539969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85917c0-64fe-4d56-ae49-4d02a67b607f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:23:58.540278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85917c0-64fe-4d56-ae49-4d02a67b607f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:58.542337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85917c0-64fe-4d56-ae49-4d02a67b607f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:58.603562 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a77655-3c8d-4bbb-bfc9-cdb93e36f392 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:58.651326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 862/1753] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:23:58.652419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85917c0-64fe-4d56-ae49-4d02a67b607f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:58.667310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:58.669483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:58.684997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a85917c0-64fe-4d56-ae49-4d02a67b607f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:58.685778 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:58.687747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] PATH_INFO: `/v3/projects/da764cfc2ea3418fafbde4794ae7412c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:58.693693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=da764cfc2ea3418fafbde4794ae7412c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:58.702532 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:58.789015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85917c0-64fe-4d56-ae49-4d02a67b607f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:58.803451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6556106-dc30-4969-8983-c43a8089f3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:58.803764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6556106-dc30-4969-8983-c43a8089f3dc service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:58.831646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6556106-dc30-4969-8983-c43a8089f3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:58.835403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6556106-dc30-4969-8983-c43a8089f3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:58.917505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6556106-dc30-4969-8983-c43a8089f3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:58.923011 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6556106-dc30-4969-8983-c43a8089f3dc service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:58.943785 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 863/1754] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:23:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:23:58.951155 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6556106-dc30-4969-8983-c43a8089f3dc service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:58.955657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da764cfc2ea3418fafbde4794ae7412c', 'request_id': 'req-3faad341-f7c1-49b2-acf6-8ed001ea84ca'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:58.966078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b6556106-dc30-4969-8983-c43a8089f3dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:58.997554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da764cfc2ea3418fafbde4794ae7412c', 'request_id': 'req-3faad341-f7c1-49b2-acf6-8ed001ea84ca'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:59.037327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6556106-dc30-4969-8983-c43a8089f3dc service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:59.047228 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da764cfc2ea3418fafbde4794ae7412c', 'request_id': 'req-3faad341-f7c1-49b2-acf6-8ed001ea84ca'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:59.074470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] The token cache is being invalidate because project da764cfc2ea3418fafbde4794ae7412c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:23:59.074849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:59.076067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:59.084506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 892/1755] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:23:58 2022] DELETE /identity/v3/projects/da764cfc2ea3418fafbde4794ae7412c => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:59.089365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:59.094939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:59.346749 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:59.353464 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:59.359293 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:59.359700 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] PATH_INFO: `/v3/projects/b92232752fec4668aedfaf6dbee07231` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:59.362324 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92232752fec4668aedfaf6dbee07231)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:59.373243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:59.445706 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faad341-f7c1-49b2-acf6-8ed001ea84ca admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:23:59.506712 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b908d-ee2d-4b14-a8a3-79bb057f5bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:23:59.510039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b908d-ee2d-4b14-a8a3-79bb057f5bfb admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:59.514253 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b908d-ee2d-4b14-a8a3-79bb057f5bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:59.516973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b908d-ee2d-4b14-a8a3-79bb057f5bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:59.521526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b908d-ee2d-4b14-a8a3-79bb057f5bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:23:59.535757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b908d-ee2d-4b14-a8a3-79bb057f5bfb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:23:59.604019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:59.605550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92232752fec4668aedfaf6dbee07231', 'request_id': 'req-8aac10be-12bd-4c4b-bc80-dda459489a40'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:59.640375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92232752fec4668aedfaf6dbee07231', 'request_id': 'req-8aac10be-12bd-4c4b-bc80-dda459489a40'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:59.678390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92232752fec4668aedfaf6dbee07231', 'request_id': 'req-8aac10be-12bd-4c4b-bc80-dda459489a40'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:59.727713 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 893/1756] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:23:59 2022] POST /identity/v3/projects => generated 363 bytes in 642 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:23:59.730418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99113a4c-e607-4d53-9eb5-54598dca92e4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:23:59.733455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99113a4c-e607-4d53-9eb5-54598dca92e4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:23:59.735086 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99113a4c-e607-4d53-9eb5-54598dca92e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:23:59.770442 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] The token cache is being invalidate because project b92232752fec4668aedfaf6dbee07231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:23:59.771274 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:59.774360 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:23:59.791589 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 864/1757] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:23:58 2022] DELETE /identity/v3/projects/b92232752fec4668aedfaf6dbee07231 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:23:59.793405 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:23:59.801350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:23:59.874788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-99113a4c-e607-4d53-9eb5-54598dca92e4 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:23:59.877374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-99113a4c-e607-4d53-9eb5-54598dca92e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:00.029059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac10be-12bd-4c4b-bc80-dda459489a40 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:00.047218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:00.149292 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 894/1758] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:00.150368 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99113a4c-e607-4d53-9eb5-54598dca92e4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:00.156929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-99113a4c-e607-4d53-9eb5-54598dca92e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:00.222764 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99113a4c-e607-4d53-9eb5-54598dca92e4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:00.235931 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c361aa-b087-473a-bb5a-9dde8b5bb3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:00.236652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c361aa-b087-473a-bb5a-9dde8b5bb3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:00.237134 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c361aa-b087-473a-bb5a-9dde8b5bb3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:00.237430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c361aa-b087-473a-bb5a-9dde8b5bb3ec admin admin] PATH_INFO: `/v3/users/d97a94b9e6ba4313bef59f3a07025162` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:00.243131 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c361aa-b087-473a-bb5a-9dde8b5bb3ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97a94b9e6ba4313bef59f3a07025162)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:00.245221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c361aa-b087-473a-bb5a-9dde8b5bb3ec admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:00.262588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4f10c-ab96-45bb-8a9a-cd92c43f0b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:00.264801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4f10c-ab96-45bb-8a9a-cd92c43f0b58 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:00.265690 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4f10c-ab96-45bb-8a9a-cd92c43f0b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:00.266490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4f10c-ab96-45bb-8a9a-cd92c43f0b58 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:00.268288 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4f10c-ab96-45bb-8a9a-cd92c43f0b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:00.275427 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4f10c-ab96-45bb-8a9a-cd92c43f0b58 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:00.344908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 865/1759] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:23:59 2022] POST /identity/v3/users => generated 282 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:00.347518 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff20f0-6948-429e-add4-c36099df1d0c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:00.348018 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff20f0-6948-429e-add4-c36099df1d0c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:00.350080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff20f0-6948-429e-add4-c36099df1d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:00.360637 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c8c361aa-b087-473a-bb5a-9dde8b5bb3ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97a94b9e6ba4313bef59f3a07025162'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:00.361459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c8c361aa-b087-473a-bb5a-9dde8b5bb3ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97a94b9e6ba4313bef59f3a07025162'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:00.400867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c8c361aa-b087-473a-bb5a-9dde8b5bb3ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97a94b9e6ba4313bef59f3a07025162'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:00.428901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c8c361aa-b087-473a-bb5a-9dde8b5bb3ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97a94b9e6ba4313bef59f3a07025162'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:00.430183 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c8c361aa-b087-473a-bb5a-9dde8b5bb3ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97a94b9e6ba4313bef59f3a07025162'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:00.449007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a4ff20f0-6948-429e-add4-c36099df1d0c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:00.450262 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a4ff20f0-6948-429e-add4-c36099df1d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:00.475335 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 866/1760] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:00.477736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff20f0-6948-429e-add4-c36099df1d0c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:00.483079 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a4ff20f0-6948-429e-add4-c36099df1d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:00.530417 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff20f0-6948-429e-add4-c36099df1d0c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:00.536324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 895/1761] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:00 2022] DELETE /identity/v3/users/d97a94b9e6ba4313bef59f3a07025162 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:00.538108 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c361aa-b087-473a-bb5a-9dde8b5bb3ec admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:00.683474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad09baf-87e8-41ad-b765-fd7f8dd37ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:00.684286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad09baf-87e8-41ad-b765-fd7f8dd37ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:00.684670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad09baf-87e8-41ad-b765-fd7f8dd37ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:00.686099 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad09baf-87e8-41ad-b765-fd7f8dd37ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:00.688285 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad09baf-87e8-41ad-b765-fd7f8dd37ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:00.690828 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad09baf-87e8-41ad-b765-fd7f8dd37ee2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:00.753623 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 867/1762] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:00.757353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad09baf-87e8-41ad-b765-fd7f8dd37ee2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:00.797638 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad09baf-87e8-41ad-b765-fd7f8dd37ee2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:00.821726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c361aa-b087-473a-bb5a-9dde8b5bb3ec admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:00.828781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778591ec-d635-415b-9cf0-17bdf624c4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:00.829072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c1000-72fd-4a0f-bafd-24bd46a8b546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:00.833907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778591ec-d635-415b-9cf0-17bdf624c4eb admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:00.833907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778591ec-d635-415b-9cf0-17bdf624c4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:00.833907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778591ec-d635-415b-9cf0-17bdf624c4eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:00.833907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778591ec-d635-415b-9cf0-17bdf624c4eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:00.833907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778591ec-d635-415b-9cf0-17bdf624c4eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:00.835685 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c1000-72fd-4a0f-bafd-24bd46a8b546 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:00.836133 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778591ec-d635-415b-9cf0-17bdf624c4eb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:00.836306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c1000-72fd-4a0f-bafd-24bd46a8b546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:00.836708 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c1000-72fd-4a0f-bafd-24bd46a8b546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:00.838314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c1000-72fd-4a0f-bafd-24bd46a8b546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:00.840091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:00.841049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c1000-72fd-4a0f-bafd-24bd46a8b546 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:00.856771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 868/1763] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:00.864439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 896/1764] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:24:00.865183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c1000-72fd-4a0f-bafd-24bd46a8b546 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:00.869541 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778591ec-d635-415b-9cf0-17bdf624c4eb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:00.890869 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c1000-72fd-4a0f-bafd-24bd46a8b546 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:00.901427 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d99ba-5094-49c8-8776-5665ddbf1370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:00.903591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d99ba-5094-49c8-8776-5665ddbf1370 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:00.904165 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d99ba-5094-49c8-8776-5665ddbf1370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:00.904580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d99ba-5094-49c8-8776-5665ddbf1370 admin admin] PATH_INFO: `/v3/projects/d0fc8542956a4a91975ac1aaba63f473/users/a5ffe951ad714dd593fb07407db53463/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:00.914690 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778591ec-d635-415b-9cf0-17bdf624c4eb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:00.939178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd2816-58d0-4963-be03-b00e7b022919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:00.940773 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd2816-58d0-4963-be03-b00e7b022919 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:00.941196 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd2816-58d0-4963-be03-b00e7b022919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:00.941477 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd2816-58d0-4963-be03-b00e7b022919 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:00.942154 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd2816-58d0-4963-be03-b00e7b022919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:00.950681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd2816-58d0-4963-be03-b00e7b022919 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:00.959251 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d99ba-5094-49c8-8776-5665ddbf1370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc8542956a4a91975ac1aaba63f473, user_id=a5ffe951ad714dd593fb07407db53463, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:00.968050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d99ba-5094-49c8-8776-5665ddbf1370 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:01.014581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 869/1765] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:00 2022] PUT /identity/v3/projects/d0fc8542956a4a91975ac1aaba63f473/users/a5ffe951ad714dd593fb07407db53463/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:01.038901 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a58cc-8fd9-481a-8b6c-e993275b6044 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:01.039207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a58cc-8fd9-481a-8b6c-e993275b6044 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:01.039517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a58cc-8fd9-481a-8b6c-e993275b6044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:01.098891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 897/1766] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:00 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:01.100543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd2816-58d0-4963-be03-b00e7b022919 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:01.140527 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-164a58cc-8fd9-481a-8b6c-e993275b6044 None None] MFA Rules not processed for user `a5ffe951ad714dd593fb07407db53463`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:01.148548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-164a58cc-8fd9-481a-8b6c-e993275b6044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:01.328204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:01.409903 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd2816-58d0-4963-be03-b00e7b022919 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:01.429142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1721378-e529-46b8-8247-2a9750ad8c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:01.432938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1721378-e529-46b8-8247-2a9750ad8c7b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:01.433331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1721378-e529-46b8-8247-2a9750ad8c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:01.433583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1721378-e529-46b8-8247-2a9750ad8c7b admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:01.436388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1721378-e529-46b8-8247-2a9750ad8c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:01.442107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 870/1767] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:01.442693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1721378-e529-46b8-8247-2a9750ad8c7b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:01.449591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a58cc-8fd9-481a-8b6c-e993275b6044 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:01.484437 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a58cc-8fd9-481a-8b6c-e993275b6044 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:01.505429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 898/1768] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:01 2022] POST /identity/v3/users => generated 293 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:01.507629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1721378-e529-46b8-8247-2a9750ad8c7b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:01.511980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab8846-c6ac-4ccd-b849-a971344fc825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:01.512636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab8846-c6ac-4ccd-b849-a971344fc825 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:01.514484 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab8846-c6ac-4ccd-b849-a971344fc825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:01.514863 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab8846-c6ac-4ccd-b849-a971344fc825 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:01.515789 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab8846-c6ac-4ccd-b849-a971344fc825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:01.530173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab8846-c6ac-4ccd-b849-a971344fc825 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:01.555193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1721378-e529-46b8-8247-2a9750ad8c7b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:01.574904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50627ff0-0003-46e5-bbce-87a6fa4ce252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:01.575776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50627ff0-0003-46e5-bbce-87a6fa4ce252 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:01.577169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50627ff0-0003-46e5-bbce-87a6fa4ce252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:01.577630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50627ff0-0003-46e5-bbce-87a6fa4ce252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:01.581622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50627ff0-0003-46e5-bbce-87a6fa4ce252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:01.587222 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50627ff0-0003-46e5-bbce-87a6fa4ce252 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:01.633777 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 899/1769] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:01.636717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50627ff0-0003-46e5-bbce-87a6fa4ce252 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:01.669546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 871/1770] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:01 2022] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:01.672144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50627ff0-0003-46e5-bbce-87a6fa4ce252 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:01.679778 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab8846-c6ac-4ccd-b849-a971344fc825 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:01.860839 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11c1c7-6b36-47fb-9e16-82c502a445b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:01.864192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11c1c7-6b36-47fb-9e16-82c502a445b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:01.865133 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11c1c7-6b36-47fb-9e16-82c502a445b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:01.867317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11c1c7-6b36-47fb-9e16-82c502a445b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:01.869234 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11c1c7-6b36-47fb-9e16-82c502a445b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:01.874856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11c1c7-6b36-47fb-9e16-82c502a445b2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:01.936004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 900/1771] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:01.938605 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11c1c7-6b36-47fb-9e16-82c502a445b2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:01.989471 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11c1c7-6b36-47fb-9e16-82c502a445b2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:02.012987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083768d-9aae-4808-b85d-fc3aeda92875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:02.013651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083768d-9aae-4808-b85d-fc3aeda92875 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:02.013932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083768d-9aae-4808-b85d-fc3aeda92875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:02.019497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083768d-9aae-4808-b85d-fc3aeda92875 admin admin] PATH_INFO: `/v3/projects/2c17a2812b2043c38441935250c73c41/users/4aa00ee57f1843cf88c0c6453dfc17c2/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:02.038137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab8846-c6ac-4ccd-b849-a971344fc825 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:02.062682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b7b0f-7bb8-4da0-9c18-f4f0b146d34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:02.063318 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b7b0f-7bb8-4da0-9c18-f4f0b146d34b admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:02.063771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b7b0f-7bb8-4da0-9c18-f4f0b146d34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:02.063919 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b7b0f-7bb8-4da0-9c18-f4f0b146d34b admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:02.064591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b7b0f-7bb8-4da0-9c18-f4f0b146d34b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:02.066831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b7b0f-7bb8-4da0-9c18-f4f0b146d34b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:02.095448 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083768d-9aae-4808-b85d-fc3aeda92875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c17a2812b2043c38441935250c73c41, user_id=4aa00ee57f1843cf88c0c6453dfc17c2, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:02.098637 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083768d-9aae-4808-b85d-fc3aeda92875 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:02.148275 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 901/1772] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:01 2022] PUT /identity/v3/projects/2c17a2812b2043c38441935250c73c41/users/4aa00ee57f1843cf88c0c6453dfc17c2/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:02.160566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249753b-08cd-45ab-a116-f2b6a95b27a2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:02.161119 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249753b-08cd-45ab-a116-f2b6a95b27a2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:02.161513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249753b-08cd-45ab-a116-f2b6a95b27a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:02.175411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 872/1773] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:01 2022] POST /identity/v3/users => generated 288 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:02.180252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b7b0f-7bb8-4da0-9c18-f4f0b146d34b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:02.209251 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5249753b-08cd-45ab-a116-f2b6a95b27a2 None None] MFA Rules not processed for user `4aa00ee57f1843cf88c0c6453dfc17c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:02.210679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5249753b-08cd-45ab-a116-f2b6a95b27a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:02.217917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b7b0f-7bb8-4da0-9c18-f4f0b146d34b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:02.227939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:02.371205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 902/1774] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:02.372309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249753b-08cd-45ab-a116-f2b6a95b27a2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:02.461793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8addb5-4033-4542-9bf3-7bcd868d8703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:02.462663 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8addb5-4033-4542-9bf3-7bcd868d8703 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:02.463017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8addb5-4033-4542-9bf3-7bcd868d8703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:02.463289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8addb5-4033-4542-9bf3-7bcd868d8703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:02.464007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8addb5-4033-4542-9bf3-7bcd868d8703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:02.468181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8addb5-4033-4542-9bf3-7bcd868d8703 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:02.537769 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 873/1775] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:02.539438 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8addb5-4033-4542-9bf3-7bcd868d8703 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:02.565353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8addb5-4033-4542-9bf3-7bcd868d8703 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:02.580377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b1e8d-9ba6-4073-892c-c30d00d97bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:02.581469 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b1e8d-9ba6-4073-892c-c30d00d97bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:02.581848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b1e8d-9ba6-4073-892c-c30d00d97bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:02.582604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b1e8d-9ba6-4073-892c-c30d00d97bd7 admin admin] PATH_INFO: `/v3/projects/3e46cddd8d244e079777789d293410e8/users/0899b233df78490683177d1d918c4fee/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:02.610820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249753b-08cd-45ab-a116-f2b6a95b27a2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:02.630623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c337c7-a22f-41d5-8c29-5baa535ea372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:02.642207 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c337c7-a22f-41d5-8c29-5baa535ea372 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:02.642755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c337c7-a22f-41d5-8c29-5baa535ea372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:02.642964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c337c7-a22f-41d5-8c29-5baa535ea372 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:02.644044 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c337c7-a22f-41d5-8c29-5baa535ea372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:02.649233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c337c7-a22f-41d5-8c29-5baa535ea372 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:02.672480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b1e8d-9ba6-4073-892c-c30d00d97bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e46cddd8d244e079777789d293410e8, user_id=0899b233df78490683177d1d918c4fee, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:02.693966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b1e8d-9ba6-4073-892c-c30d00d97bd7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:02.737535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 903/1776] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:02 2022] POST /identity/v3/projects => generated 385 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:02.745303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c337c7-a22f-41d5-8c29-5baa535ea372 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:02.776736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 874/1777] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:02 2022] PUT /identity/v3/projects/3e46cddd8d244e079777789d293410e8/users/0899b233df78490683177d1d918c4fee/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:02.785384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b1e8d-9ba6-4073-892c-c30d00d97bd7 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:03.021036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:03.035821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c337c7-a22f-41d5-8c29-5baa535ea372 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:03.260091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:03.314042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b1e8d-9ba6-4073-892c-c30d00d97bd7 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:03.314629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbf588-1b8e-472e-a260-f4f601c13c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:03.316419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbf588-1b8e-472e-a260-f4f601c13c0e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:03.318118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbf588-1b8e-472e-a260-f4f601c13c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:03.318791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbf588-1b8e-472e-a260-f4f601c13c0e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:03.320461 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbf588-1b8e-472e-a260-f4f601c13c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:03.325465 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbf588-1b8e-472e-a260-f4f601c13c0e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:03.348024 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac953e-273f-4ea9-8e20-12ff2207e0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:03.349265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac953e-273f-4ea9-8e20-12ff2207e0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:03.349860 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac953e-273f-4ea9-8e20-12ff2207e0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:03.350338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac953e-273f-4ea9-8e20-12ff2207e0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:03.351492 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac953e-273f-4ea9-8e20-12ff2207e0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:03.365403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac953e-273f-4ea9-8e20-12ff2207e0d5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:03.398574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 904/1778] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:02 2022] POST /identity/v3/users => generated 293 bytes in 655 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:03.399581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbf588-1b8e-472e-a260-f4f601c13c0e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:03.402689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-adbbf588-1b8e-472e-a260-f4f601c13c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:03.420164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbf588-1b8e-472e-a260-f4f601c13c0e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:03.426689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:03.427416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:03.427704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:03.428233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] PATH_INFO: `/v3/projects/e726db2505fe43bba31ea915317e8167` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:03.430169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e726db2505fe43bba31ea915317e8167)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:03.434334 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:03.469162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 875/1779] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 691 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:03.470816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac953e-273f-4ea9-8e20-12ff2207e0d5 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:03.568008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac953e-273f-4ea9-8e20-12ff2207e0d5 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:03.615506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e726db2505fe43bba31ea915317e8167', 'request_id': 'req-342f1116-545f-41fb-9c5e-801566271e92'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:03.660124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e726db2505fe43bba31ea915317e8167', 'request_id': 'req-342f1116-545f-41fb-9c5e-801566271e92'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:03.690680 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e726db2505fe43bba31ea915317e8167', 'request_id': 'req-342f1116-545f-41fb-9c5e-801566271e92'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:03.755343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] The token cache is being invalidate because project e726db2505fe43bba31ea915317e8167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:03.755812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:03.759455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:03.766697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 905/1780] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:03 2022] DELETE /identity/v3/projects/e726db2505fe43bba31ea915317e8167 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:03.775209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:03.786751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:03.906962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4ee60-fd30-46b9-992f-d68614892397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:03.908218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4ee60-fd30-46b9-992f-d68614892397 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:03.908895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4ee60-fd30-46b9-992f-d68614892397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:03.909469 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4ee60-fd30-46b9-992f-d68614892397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:03.910793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4ee60-fd30-46b9-992f-d68614892397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:03.917188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4ee60-fd30-46b9-992f-d68614892397 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:03.985766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 876/1781] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:03.988234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce1b4a-152f-468c-b1e7-43aea00a9986 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:03.991295 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce1b4a-152f-468c-b1e7-43aea00a9986 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:03.996647 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce1b4a-152f-468c-b1e7-43aea00a9986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:04.060054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-66ce1b4a-152f-468c-b1e7-43aea00a9986 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:04.062422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-66ce1b4a-152f-468c-b1e7-43aea00a9986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:04.082582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 877/1782] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:04.084235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce1b4a-152f-468c-b1e7-43aea00a9986 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:04.099131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-66ce1b4a-152f-468c-b1e7-43aea00a9986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:04.099423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f1116-545f-41fb-9c5e-801566271e92 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:04.110115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42fade-589e-4216-8428-a6db129264a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:04.110813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42fade-589e-4216-8428-a6db129264a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:04.111085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42fade-589e-4216-8428-a6db129264a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:04.111366 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42fade-589e-4216-8428-a6db129264a3 admin admin] PATH_INFO: `/v3/projects/3e46cddd8d244e079777789d293410e8/users/0899b233df78490683177d1d918c4fee/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:04.116934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42fade-589e-4216-8428-a6db129264a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e46cddd8d244e079777789d293410e8, user_id=0899b233df78490683177d1d918c4fee, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:04.119682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42fade-589e-4216-8428-a6db129264a3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:04.121405 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce1b4a-152f-468c-b1e7-43aea00a9986 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:04.148314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 906/1783] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:03 2022] PUT /identity/v3/projects/3e46cddd8d244e079777789d293410e8/users/0899b233df78490683177d1d918c4fee/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:04.149869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eb348-1f47-4a12-825b-52afbcdc9ef5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:04.150181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eb348-1f47-4a12-825b-52afbcdc9ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:04.150461 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eb348-1f47-4a12-825b-52afbcdc9ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:04.218123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-285eb348-1f47-4a12-825b-52afbcdc9ef5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:04.219424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-285eb348-1f47-4a12-825b-52afbcdc9ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:04.350757 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0eae0-ea83-46fb-9a6f-f0b43fbbb3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:04.356740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0eae0-ea83-46fb-9a6f-f0b43fbbb3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:04.357032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0eae0-ea83-46fb-9a6f-f0b43fbbb3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:04.357300 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0eae0-ea83-46fb-9a6f-f0b43fbbb3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:04.357996 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0eae0-ea83-46fb-9a6f-f0b43fbbb3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:04.359790 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0eae0-ea83-46fb-9a6f-f0b43fbbb3b6 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:04.381504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:04.390662 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 878/1784] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:04.392201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9679c6b-cfaf-4f11-89e2-b992638c4fd3 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:04.392487 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9679c6b-cfaf-4f11-89e2-b992638c4fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:04.407952 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9679c6b-cfaf-4f11-89e2-b992638c4fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:04.424666 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 907/1785] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:04.426752 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eb348-1f47-4a12-825b-52afbcdc9ef5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:04.450755 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-f9679c6b-cfaf-4f11-89e2-b992638c4fd3 None None] MFA Rules not processed for user `0899b233df78490683177d1d918c4fee`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:04.453399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f9679c6b-cfaf-4f11-89e2-b992638c4fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:04.466829 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eb348-1f47-4a12-825b-52afbcdc9ef5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:04.488254 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b098b1-0902-4bff-b643-12cfb00e85f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:04.488999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b098b1-0902-4bff-b643-12cfb00e85f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:04.489283 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b098b1-0902-4bff-b643-12cfb00e85f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:04.489559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b098b1-0902-4bff-b643-12cfb00e85f9 admin admin] PATH_INFO: `/v3/projects/57bbb7eb8f2a401fac454010f1040239/users/c3014ba083204e09940ecbebeb450d53/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:04.518171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:04.546928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b098b1-0902-4bff-b643-12cfb00e85f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57bbb7eb8f2a401fac454010f1040239, user_id=c3014ba083204e09940ecbebeb450d53, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:04.550764 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b098b1-0902-4bff-b643-12cfb00e85f9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:04.582034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 908/1786] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:04 2022] PUT /identity/v3/projects/57bbb7eb8f2a401fac454010f1040239/users/c3014ba083204e09940ecbebeb450d53/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:04.583476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b098b1-0902-4bff-b643-12cfb00e85f9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:04.646599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 879/1787] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:04.652173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24101c-d0a7-49ca-9645-8390b28d2184 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:04.656036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24101c-d0a7-49ca-9645-8390b28d2184 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:04.656036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24101c-d0a7-49ca-9645-8390b28d2184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:04.778581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-cd24101c-d0a7-49ca-9645-8390b28d2184 None None] MFA Rules not processed for user `c3014ba083204e09940ecbebeb450d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:04.779784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cd24101c-d0a7-49ca-9645-8390b28d2184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:04.871073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b098b1-0902-4bff-b643-12cfb00e85f9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:04.906554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88522e55-c467-417f-baad-e75f631354d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:04.912245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88522e55-c467-417f-baad-e75f631354d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:04.912537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88522e55-c467-417f-baad-e75f631354d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:04.914682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88522e55-c467-417f-baad-e75f631354d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:04.915506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88522e55-c467-417f-baad-e75f631354d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:04.915736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88522e55-c467-417f-baad-e75f631354d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:04.920218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88522e55-c467-417f-baad-e75f631354d1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:04.981670 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 909/1788] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:24:04.981670 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88522e55-c467-417f-baad-e75f631354d1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:04.991844 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-88522e55-c467-417f-baad-e75f631354d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:05.106616 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 880/1789] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:05.107462 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24101c-d0a7-49ca-9645-8390b28d2184 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:05.164068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24101c-d0a7-49ca-9645-8390b28d2184 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:05.193826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c59f1-718b-4102-b350-4da7823037f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:05.194477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c59f1-718b-4102-b350-4da7823037f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:05.194766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c59f1-718b-4102-b350-4da7823037f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:05.195048 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c59f1-718b-4102-b350-4da7823037f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:05.200570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c59f1-718b-4102-b350-4da7823037f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:05.202613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c59f1-718b-4102-b350-4da7823037f0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:05.294312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88522e55-c467-417f-baad-e75f631354d1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:05.313947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5f4a3-48f5-445e-a171-e826fcfb106b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:05.318684 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5f4a3-48f5-445e-a171-e826fcfb106b service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:05.322891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5f4a3-48f5-445e-a171-e826fcfb106b service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:05.324914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5f4a3-48f5-445e-a171-e826fcfb106b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:05.349415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 881/1790] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:05 2022] POST /identity/v3/projects => generated 393 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:05.349415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c59f1-718b-4102-b350-4da7823037f0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:05.551095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5f4a3-48f5-445e-a171-e826fcfb106b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:05.556675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5f4a3-48f5-445e-a171-e826fcfb106b service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:05.606612 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 910/1791] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:05.608789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5f4a3-48f5-445e-a171-e826fcfb106b service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:05.653269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5f4a3-48f5-445e-a171-e826fcfb106b service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:05.700091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:05.749111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c59f1-718b-4102-b350-4da7823037f0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:05.787511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53562251-6718-4375-95af-9325aa9c5e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:05.788631 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53562251-6718-4375-95af-9325aa9c5e5e admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:05.789248 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53562251-6718-4375-95af-9325aa9c5e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:05.795968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53562251-6718-4375-95af-9325aa9c5e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:05.799340 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53562251-6718-4375-95af-9325aa9c5e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:05.813445 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53562251-6718-4375-95af-9325aa9c5e5e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:05.974231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 882/1792] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:05 2022] POST /identity/v3/projects => generated 385 bytes in 624 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:05.984802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53562251-6718-4375-95af-9325aa9c5e5e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:06.032742 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582fc8e-799a-48d8-8bda-43f997290293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:06.039507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582fc8e-799a-48d8-8bda-43f997290293 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:06.040431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582fc8e-799a-48d8-8bda-43f997290293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:06.041100 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582fc8e-799a-48d8-8bda-43f997290293 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:06.042181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582fc8e-799a-48d8-8bda-43f997290293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:06.064352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582fc8e-799a-48d8-8bda-43f997290293 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:06.177152 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:06.199707 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 911/1793] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:05 2022] POST /identity/v3/users => generated 297 bytes in 592 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:06.208898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582fc8e-799a-48d8-8bda-43f997290293 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:06.271146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582fc8e-799a-48d8-8bda-43f997290293 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:06.427302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53562251-6718-4375-95af-9325aa9c5e5e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:06.473524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae9e60-5d23-4f08-98b6-e4da510bb78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:06.474821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae9e60-5d23-4f08-98b6-e4da510bb78e admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:06.475271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae9e60-5d23-4f08-98b6-e4da510bb78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:06.475714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae9e60-5d23-4f08-98b6-e4da510bb78e admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:06.490525 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae9e60-5d23-4f08-98b6-e4da510bb78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:06.513894 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae9e60-5d23-4f08-98b6-e4da510bb78e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:06.669060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 883/1794] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:05 2022] POST /identity/v3/users => generated 299 bytes in 692 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:06.676429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea1f92-bfa4-40f0-9fed-cca00af4d5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:06.678392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2b834-bec0-4816-b34d-2de18f2a4478 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:06.681332 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2b834-bec0-4816-b34d-2de18f2a4478 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:06.682486 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2b834-bec0-4816-b34d-2de18f2a4478 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:06.684642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea1f92-bfa4-40f0-9fed-cca00af4d5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:06.689275 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea1f92-bfa4-40f0-9fed-cca00af4d5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:06.692633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea1f92-bfa4-40f0-9fed-cca00af4d5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:06.694904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 884/1795] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 21 16:24:06 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:24:06.696558 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea1f92-bfa4-40f0-9fed-cca00af4d5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:06.701346 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2b834-bec0-4816-b34d-2de18f2a4478 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:06.709830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea1f92-bfa4-40f0-9fed-cca00af4d5c9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:06.770694 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 912/1796] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 568 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:06.776641 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea1f92-bfa4-40f0-9fed-cca00af4d5c9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:06.793908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2b834-bec0-4816-b34d-2de18f2a4478 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:06.819136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea1f92-bfa4-40f0-9fed-cca00af4d5c9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:06.832035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad559708-c9f1-482d-9e7e-e0d6bc89ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:06.838009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559708-c9f1-482d-9e7e-e0d6bc89ec6e admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:06.840448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559708-c9f1-482d-9e7e-e0d6bc89ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:06.841007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559708-c9f1-482d-9e7e-e0d6bc89ec6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:06.845418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad559708-c9f1-482d-9e7e-e0d6bc89ec6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:06.849221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad559708-c9f1-482d-9e7e-e0d6bc89ec6e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:06.889875 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97ef0f-036c-4143-87fe-f565b4ec7fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:06.893266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97ef0f-036c-4143-87fe-f565b4ec7fab admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:06.896189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97ef0f-036c-4143-87fe-f565b4ec7fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:06.897065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97ef0f-036c-4143-87fe-f565b4ec7fab admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:06.900091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97ef0f-036c-4143-87fe-f565b4ec7fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:06.909922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 885/1797] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:06.912026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad559708-c9f1-482d-9e7e-e0d6bc89ec6e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:06.931474 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97ef0f-036c-4143-87fe-f565b4ec7fab admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:06.957537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad559708-c9f1-482d-9e7e-e0d6bc89ec6e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:06.969038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb157d-3650-462a-be6b-75428c088e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:06.971223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb157d-3650-462a-be6b-75428c088e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:06.971223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb157d-3650-462a-be6b-75428c088e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:06.971841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb157d-3650-462a-be6b-75428c088e43 admin admin] PATH_INFO: `/v3/users/a5ffe951ad714dd593fb07407db53463` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:06.975886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb157d-3650-462a-be6b-75428c088e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ffe951ad714dd593fb07407db53463)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:06.980650 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb157d-3650-462a-be6b-75428c088e43 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:06.991610 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 913/1798] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:06.994404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1ee84-6bf4-4f1f-a3a8-2f4fa4428098 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:06.994896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1ee84-6bf4-4f1f-a3a8-2f4fa4428098 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:06.995365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1ee84-6bf4-4f1f-a3a8-2f4fa4428098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:07.056678 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-efa1ee84-6bf4-4f1f-a3a8-2f4fa4428098 None None] MFA Rules not processed for user `d7ff08c990dc41b4811f97fecb7c4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:07.064443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-efa1ee84-6bf4-4f1f-a3a8-2f4fa4428098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:07.199062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7bdb157d-3650-462a-be6b-75428c088e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ffe951ad714dd593fb07407db53463'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:07.202403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7bdb157d-3650-462a-be6b-75428c088e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ffe951ad714dd593fb07407db53463'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:07.205819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7bdb157d-3650-462a-be6b-75428c088e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ffe951ad714dd593fb07407db53463'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:07.258124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7bdb157d-3650-462a-be6b-75428c088e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ffe951ad714dd593fb07407db53463'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:07.325126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7bdb157d-3650-462a-be6b-75428c088e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ffe951ad714dd593fb07407db53463'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:07.374954 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 886/1799] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:06 2022] DELETE /identity/v3/users/a5ffe951ad714dd593fb07407db53463 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:07.379126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb157d-3650-462a-be6b-75428c088e43 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:07.387389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7bdb157d-3650-462a-be6b-75428c088e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:07.401881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 914/1800] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 21 16:24:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:07.404751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1ee84-6bf4-4f1f-a3a8-2f4fa4428098 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:07.406595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-efa1ee84-6bf4-4f1f-a3a8-2f4fa4428098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:07.439116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1ee84-6bf4-4f1f-a3a8-2f4fa4428098 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:07.530131 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:07.643090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb157d-3650-462a-be6b-75428c088e43 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:07.662259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73304b17-44f4-4c6f-b25e-07b9dd88e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:07.682249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73304b17-44f4-4c6f-b25e-07b9dd88e525 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:07.683918 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73304b17-44f4-4c6f-b25e-07b9dd88e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:07.684881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73304b17-44f4-4c6f-b25e-07b9dd88e525 admin admin] PATH_INFO: `/v3/projects/4504ff813aff4d88b13fb9f7c7018bb6/users/83006148026c40e688f6e5822c41d908/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:07.750853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e34d46-8d1e-47cd-b22a-b15eff069ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:07.753922 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34d46-8d1e-47cd-b22a-b15eff069ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:07.760891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34d46-8d1e-47cd-b22a-b15eff069ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:07.762861 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34d46-8d1e-47cd-b22a-b15eff069ed1 admin admin] PATH_INFO: `/v3/projects/a8b235bc63ea405cbd014584130a4e66/users/652df40949ef485d90f0e9ada18674ad/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:07.769725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73304b17-44f4-4c6f-b25e-07b9dd88e525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4504ff813aff4d88b13fb9f7c7018bb6, user_id=83006148026c40e688f6e5822c41d908, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:07.774496 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73304b17-44f4-4c6f-b25e-07b9dd88e525 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:07.785621 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:07.810784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 887/1801] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:07 2022] PUT /identity/v3/projects/4504ff813aff4d88b13fb9f7c7018bb6/users/83006148026c40e688f6e5822c41d908/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:07.812094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73304b17-44f4-4c6f-b25e-07b9dd88e525 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:07.814454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-73304b17-44f4-4c6f-b25e-07b9dd88e525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:07.814596 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e34d46-8d1e-47cd-b22a-b15eff069ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b235bc63ea405cbd014584130a4e66, user_id=652df40949ef485d90f0e9ada18674ad, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:07.840716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e34d46-8d1e-47cd-b22a-b15eff069ed1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:07.876375 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 915/1802] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:07 2022] PUT /identity/v3/projects/a8b235bc63ea405cbd014584130a4e66/users/652df40949ef485d90f0e9ada18674ad/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:07.876375 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889238-e877-4461-b5fa-3ad2f06169a3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:07.876375 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889238-e877-4461-b5fa-3ad2f06169a3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:07.876375 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889238-e877-4461-b5fa-3ad2f06169a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:07.946828 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-00889238-e877-4461-b5fa-3ad2f06169a3 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:07.949310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-00889238-e877-4461-b5fa-3ad2f06169a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:07.953414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73304b17-44f4-4c6f-b25e-07b9dd88e525 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:08.188641 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 916/1803] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:08.190577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00889238-e877-4461-b5fa-3ad2f06169a3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:08.240598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00889238-e877-4461-b5fa-3ad2f06169a3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:08.240972 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa531c2-4003-4f23-90dd-d11fe5682c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:08.241874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa531c2-4003-4f23-90dd-d11fe5682c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:08.242452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa531c2-4003-4f23-90dd-d11fe5682c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:08.242846 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa531c2-4003-4f23-90dd-d11fe5682c58 admin admin] PATH_INFO: `/v3/users/f30cfb57e19f45f9844de1cf7f932214` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:08.248074 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa531c2-4003-4f23-90dd-d11fe5682c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30cfb57e19f45f9844de1cf7f932214)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:08.258259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa531c2-4003-4f23-90dd-d11fe5682c58 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:08.268399 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94091b8-f4ad-48ca-826a-3ee8b2bfd5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:08.269486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94091b8-f4ad-48ca-826a-3ee8b2bfd5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:08.270175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94091b8-f4ad-48ca-826a-3ee8b2bfd5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:08.270672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94091b8-f4ad-48ca-826a-3ee8b2bfd5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:08.271908 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94091b8-f4ad-48ca-826a-3ee8b2bfd5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:08.278992 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94091b8-f4ad-48ca-826a-3ee8b2bfd5b8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:08.319823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 917/1804] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:08.319823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d75c-cb2f-4af1-84fb-4bc9c12e8981 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:08.319823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d75c-cb2f-4af1-84fb-4bc9c12e8981 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:08.319823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d75c-cb2f-4af1-84fb-4bc9c12e8981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:08.395193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ddb3d75c-cb2f-4af1-84fb-4bc9c12e8981 None None] MFA Rules not processed for user `652df40949ef485d90f0e9ada18674ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:08.395459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-faa531c2-4003-4f23-90dd-d11fe5682c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30cfb57e19f45f9844de1cf7f932214'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:08.397651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-faa531c2-4003-4f23-90dd-d11fe5682c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30cfb57e19f45f9844de1cf7f932214'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:08.398944 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-faa531c2-4003-4f23-90dd-d11fe5682c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30cfb57e19f45f9844de1cf7f932214'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:08.402318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ddb3d75c-cb2f-4af1-84fb-4bc9c12e8981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:08.430016 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-faa531c2-4003-4f23-90dd-d11fe5682c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30cfb57e19f45f9844de1cf7f932214'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:08.472225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-faa531c2-4003-4f23-90dd-d11fe5682c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30cfb57e19f45f9844de1cf7f932214'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:08.521658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 888/1805] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:07 2022] DELETE /identity/v3/users/f30cfb57e19f45f9844de1cf7f932214 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:08.523216 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa531c2-4003-4f23-90dd-d11fe5682c58 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:08.526167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-faa531c2-4003-4f23-90dd-d11fe5682c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:08.674900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:08.710815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 918/1806] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:08.712261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3d75c-cb2f-4af1-84fb-4bc9c12e8981 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:08.715253 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ddb3d75c-cb2f-4af1-84fb-4bc9c12e8981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:08.831203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:08.899273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa531c2-4003-4f23-90dd-d11fe5682c58 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:08.938835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f0991-ef14-4862-ad96-073754818312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:08.939719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f0991-ef14-4862-ad96-073754818312 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:08.940148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f0991-ef14-4862-ad96-073754818312 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:08.940518 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f0991-ef14-4862-ad96-073754818312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:08.956194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-452f0991-ef14-4862-ad96-073754818312 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:09.019975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f0991-ef14-4862-ad96-073754818312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:09.022147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3d75c-cb2f-4af1-84fb-4bc9c12e8981 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:09.024286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f0991-ef14-4862-ad96-073754818312 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:09.051493 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 889/1807] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:09.052175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f0991-ef14-4862-ad96-073754818312 service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:09.059164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-452f0991-ef14-4862-ad96-073754818312 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:09.294159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f0991-ef14-4862-ad96-073754818312 service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:09.317931 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be53d3-5961-4e9b-aa0f-3f6d2754c1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:09.326117 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be53d3-5961-4e9b-aa0f-3f6d2754c1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:09.326117 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be53d3-5961-4e9b-aa0f-3f6d2754c1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:09.333237 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be53d3-5961-4e9b-aa0f-3f6d2754c1dc admin admin] PATH_INFO: `/v3/projects/4504ff813aff4d88b13fb9f7c7018bb6/users/83006148026c40e688f6e5822c41d908/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:09.341794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be53d3-5961-4e9b-aa0f-3f6d2754c1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4504ff813aff4d88b13fb9f7c7018bb6, user_id=83006148026c40e688f6e5822c41d908, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:09.344624 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be53d3-5961-4e9b-aa0f-3f6d2754c1dc admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:09.390795 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 890/1808] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:09 2022] PUT /identity/v3/projects/4504ff813aff4d88b13fb9f7c7018bb6/users/83006148026c40e688f6e5822c41d908/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:09.392274 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00fce-560d-42a2-8f93-57fa01209321 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:09.392559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00fce-560d-42a2-8f93-57fa01209321 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:09.401032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00fce-560d-42a2-8f93-57fa01209321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:09.405650 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecd54a-8259-4ad0-8826-a2383fdf9c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:09.406955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecd54a-8259-4ad0-8826-a2383fdf9c20 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:09.407425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecd54a-8259-4ad0-8826-a2383fdf9c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:09.407858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecd54a-8259-4ad0-8826-a2383fdf9c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:09.410407 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1fecd54a-8259-4ad0-8826-a2383fdf9c20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:09.483489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-65e00fce-560d-42a2-8f93-57fa01209321 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:09.493683 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-65e00fce-560d-42a2-8f93-57fa01209321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:09.527964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecd54a-8259-4ad0-8826-a2383fdf9c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:09.537170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecd54a-8259-4ad0-8826-a2383fdf9c20 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:09.590997 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 919/1809] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 880 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:09.592082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecd54a-8259-4ad0-8826-a2383fdf9c20 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:09.596301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1fecd54a-8259-4ad0-8826-a2383fdf9c20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:09.665286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecd54a-8259-4ad0-8826-a2383fdf9c20 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:09.787260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 891/1810] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:09.790479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fccbf-3936-4727-8cfb-6be13837951e None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:09.792933 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fccbf-3936-4727-8cfb-6be13837951e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:09.796203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fccbf-3936-4727-8cfb-6be13837951e None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:09.801058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 892/1811] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 21 16:24:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:24:09.802628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a1f54-eca1-440a-8104-0990e88570f6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:09.810134 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a1f54-eca1-440a-8104-0990e88570f6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:09.814705 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a1f54-eca1-440a-8104-0990e88570f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:09.920494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-870a1f54-eca1-440a-8104-0990e88570f6 None None] MFA Rules not processed for user `83006148026c40e688f6e5822c41d908`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:09.925644 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-870a1f54-eca1-440a-8104-0990e88570f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:09.938948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cfa6b-616e-4bd3-87ca-7d1545fcdd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:09.962557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cfa6b-616e-4bd3-87ca-7d1545fcdd4d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:09.963949 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cfa6b-616e-4bd3-87ca-7d1545fcdd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:09.964247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cfa6b-616e-4bd3-87ca-7d1545fcdd4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:09.965116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cfa6b-616e-4bd3-87ca-7d1545fcdd4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:09.972625 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cfa6b-616e-4bd3-87ca-7d1545fcdd4d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:10.053642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 920/1812] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:09 2022] POST /identity/v3/projects => generated 391 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:10.056107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8d03f-9a38-42b9-b347-75f5e0698a6b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:10.056395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8d03f-9a38-42b9-b347-75f5e0698a6b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:10.057061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8d03f-9a38-42b9-b347-75f5e0698a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:10.060798 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:10.114023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f3a8d03f-9a38-42b9-b347-75f5e0698a6b None None] MFA Rules not processed for user `d7ff08c990dc41b4811f97fecb7c4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:10.115351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3a8d03f-9a38-42b9-b347-75f5e0698a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:10.192569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 893/1813] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:10.192569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a1f54-eca1-440a-8104-0990e88570f6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:10.384004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a1f54-eca1-440a-8104-0990e88570f6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:10.533072 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:10.554690 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 921/1814] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 21 16:24:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:10.555683 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8d03f-9a38-42b9-b347-75f5e0698a6b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:10.688928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d153f-6673-4dd8-aaf3-2ce405ddac08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:10.690183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d153f-6673-4dd8-aaf3-2ce405ddac08 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:10.690759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d153f-6673-4dd8-aaf3-2ce405ddac08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:10.691321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d153f-6673-4dd8-aaf3-2ce405ddac08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:10.784494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8d03f-9a38-42b9-b347-75f5e0698a6b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:10.812715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef8a80-8c1b-41f3-a163-1a0e107dc47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:10.813485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef8a80-8c1b-41f3-a163-1a0e107dc47e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:10.813767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef8a80-8c1b-41f3-a163-1a0e107dc47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:10.814042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef8a80-8c1b-41f3-a163-1a0e107dc47e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:10.814697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef8a80-8c1b-41f3-a163-1a0e107dc47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:10.824259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef8a80-8c1b-41f3-a163-1a0e107dc47e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:10.901770 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d153f-6673-4dd8-aaf3-2ce405ddac08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:10.908499 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d153f-6673-4dd8-aaf3-2ce405ddac08 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:10.926069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 922/1815] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:10 2022] POST /identity/v3/users => generated 302 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:10.929673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef8a80-8c1b-41f3-a163-1a0e107dc47e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:10.933056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-43ef8a80-8c1b-41f3-a163-1a0e107dc47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:10.946502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 894/1816] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:10.949741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d153f-6673-4dd8-aaf3-2ce405ddac08 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:11.007344 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d153f-6673-4dd8-aaf3-2ce405ddac08 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:11.026842 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b563b63-643b-4e3b-abd3-e1b77cf97be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:11.029082 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b563b63-643b-4e3b-abd3-e1b77cf97be6 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:11.031643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b563b63-643b-4e3b-abd3-e1b77cf97be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:11.032267 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b563b63-643b-4e3b-abd3-e1b77cf97be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:11.036634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b563b63-643b-4e3b-abd3-e1b77cf97be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:11.042021 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b563b63-643b-4e3b-abd3-e1b77cf97be6 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:11.087156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 895/1817] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:11.087156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b563b63-643b-4e3b-abd3-e1b77cf97be6 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:11.098246 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9b563b63-643b-4e3b-abd3-e1b77cf97be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:11.163713 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef8a80-8c1b-41f3-a163-1a0e107dc47e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:11.170055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b563b63-643b-4e3b-abd3-e1b77cf97be6 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:11.181389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c9124-c3a2-4fd3-8e4c-83e9e2a117ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:11.186407 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c9124-c3a2-4fd3-8e4c-83e9e2a117ba service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:11.187057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c9124-c3a2-4fd3-8e4c-83e9e2a117ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:11.190193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c9124-c3a2-4fd3-8e4c-83e9e2a117ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:11.199034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaa3d3-7c5c-430b-b8c2-4404c98d3bd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:11.202129 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaa3d3-7c5c-430b-b8c2-4404c98d3bd0 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:11.205469 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaa3d3-7c5c-430b-b8c2-4404c98d3bd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:11.206458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaa3d3-7c5c-430b-b8c2-4404c98d3bd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:11.249859 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aaa3d3-7c5c-430b-b8c2-4404c98d3bd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:11.257801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aaa3d3-7c5c-430b-b8c2-4404c98d3bd0 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:11.327834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 896/1818] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:11.331872 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaa3d3-7c5c-430b-b8c2-4404c98d3bd0 service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:11.369607 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaa3d3-7c5c-430b-b8c2-4404c98d3bd0 service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:11.389095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585994c-d098-460f-b9b3-cc2795da336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:11.393284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585994c-d098-460f-b9b3-cc2795da336d admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:11.394960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585994c-d098-460f-b9b3-cc2795da336d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:11.396358 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585994c-d098-460f-b9b3-cc2795da336d admin admin] PATH_INFO: `/v3/projects/99dce9cc63ee4cb681c7d867e1025657/users/0f59f587d1004944a46c90111f040171/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:11.406585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:11.453347 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585994c-d098-460f-b9b3-cc2795da336d admin admin] RBAC: Authorizing `identity:create_grant(project_id=99dce9cc63ee4cb681c7d867e1025657, user_id=0f59f587d1004944a46c90111f040171, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:11.458842 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585994c-d098-460f-b9b3-cc2795da336d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:11.461529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c9124-c3a2-4fd3-8e4c-83e9e2a117ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:11.463105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c9124-c3a2-4fd3-8e4c-83e9e2a117ba service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:11.476464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 923/1819] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:11.506219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 897/1820] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:11 2022] PUT /identity/v3/projects/99dce9cc63ee4cb681c7d867e1025657/users/0f59f587d1004944a46c90111f040171/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:11.506895 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c9124-c3a2-4fd3-8e4c-83e9e2a117ba service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:11.532745 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c9124-c3a2-4fd3-8e4c-83e9e2a117ba service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:11.647077 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:11.758254 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa27899-c396-45a1-9d52-9eb46f4b7b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:11.761911 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa27899-c396-45a1-9d52-9eb46f4b7b0d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:11.763671 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa27899-c396-45a1-9d52-9eb46f4b7b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:11.765498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa27899-c396-45a1-9d52-9eb46f4b7b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:11.768163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa27899-c396-45a1-9d52-9eb46f4b7b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:11.774824 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585994c-d098-460f-b9b3-cc2795da336d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:11.783755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa27899-c396-45a1-9d52-9eb46f4b7b0d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:11.794300 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2585994c-d098-460f-b9b3-cc2795da336d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:11.827365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585994c-d098-460f-b9b3-cc2795da336d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:11.844228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:11.844938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:11.845272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:11.845527 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] PATH_INFO: `/v3/projects/d0fc8542956a4a91975ac1aaba63f473` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:11.853933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 924/1821] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:24:11.855862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa27899-c396-45a1-9d52-9eb46f4b7b0d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:11.856201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0fc8542956a4a91975ac1aaba63f473)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:11.881410 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:11.932823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa27899-c396-45a1-9d52-9eb46f4b7b0d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:11.969079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c5073-80b5-4289-ad69-f5df56597b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:11.971453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c5073-80b5-4289-ad69-f5df56597b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:11.973477 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c5073-80b5-4289-ad69-f5df56597b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:11.975130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c5073-80b5-4289-ad69-f5df56597b41 admin admin] PATH_INFO: `/v3/projects/99dce9cc63ee4cb681c7d867e1025657/users/0f59f587d1004944a46c90111f040171/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:11.990909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c5073-80b5-4289-ad69-f5df56597b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99dce9cc63ee4cb681c7d867e1025657, user_id=0f59f587d1004944a46c90111f040171, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:11.997888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c5073-80b5-4289-ad69-f5df56597b41 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:12.033288 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 925/1822] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:11 2022] PUT /identity/v3/projects/99dce9cc63ee4cb681c7d867e1025657/users/0f59f587d1004944a46c90111f040171/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:12.049431 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0fc8542956a4a91975ac1aaba63f473', 'request_id': 'req-14a06a2f-0174-43d8-80b1-c65fe90a0200'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:12.060050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714e415-7874-4d4b-a511-472d58689b5e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:12.060999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714e415-7874-4d4b-a511-472d58689b5e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:12.061483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714e415-7874-4d4b-a511-472d58689b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:12.073836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0fc8542956a4a91975ac1aaba63f473', 'request_id': 'req-14a06a2f-0174-43d8-80b1-c65fe90a0200'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:12.115151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0fc8542956a4a91975ac1aaba63f473', 'request_id': 'req-14a06a2f-0174-43d8-80b1-c65fe90a0200'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:12.161005 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] The token cache is being invalidate because project d0fc8542956a4a91975ac1aaba63f473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:12.163233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:12.165654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:12.171158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 898/1823] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:11 2022] DELETE /identity/v3/projects/d0fc8542956a4a91975ac1aaba63f473 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:12.179553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:12.182549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:12.192667 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4714e415-7874-4d4b-a511-472d58689b5e None None] MFA Rules not processed for user `0f59f587d1004944a46c90111f040171`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:12.199671 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4714e415-7874-4d4b-a511-472d58689b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:12.360625 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 926/1824] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:12.391000 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714e415-7874-4d4b-a511-472d58689b5e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:12.392870 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4714e415-7874-4d4b-a511-472d58689b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:12.425589 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a06a2f-0174-43d8-80b1-c65fe90a0200 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:12.610397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2852fbf-c46e-4103-a028-fff15c64868c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:12.611090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2852fbf-c46e-4103-a028-fff15c64868c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:12.611371 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2852fbf-c46e-4103-a028-fff15c64868c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:12.611644 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2852fbf-c46e-4103-a028-fff15c64868c admin admin] PATH_INFO: `/v3/users/0899b233df78490683177d1d918c4fee` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:12.613195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2852fbf-c46e-4103-a028-fff15c64868c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0899b233df78490683177d1d918c4fee)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:12.616384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2852fbf-c46e-4103-a028-fff15c64868c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:12.639181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714e415-7874-4d4b-a511-472d58689b5e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:12.645114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db891408-0d94-42e0-a73e-99cbcc37fba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:12.645748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db891408-0d94-42e0-a73e-99cbcc37fba0 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:12.646023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db891408-0d94-42e0-a73e-99cbcc37fba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:12.646292 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db891408-0d94-42e0-a73e-99cbcc37fba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:12.661865 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:12.671187 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db891408-0d94-42e0-a73e-99cbcc37fba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:12.678714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db891408-0d94-42e0-a73e-99cbcc37fba0 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:12.704242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 927/1825] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:24:12.736708 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e2852fbf-c46e-4103-a028-fff15c64868c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0899b233df78490683177d1d918c4fee'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:12.738600 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e2852fbf-c46e-4103-a028-fff15c64868c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0899b233df78490683177d1d918c4fee'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:12.740002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e2852fbf-c46e-4103-a028-fff15c64868c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0899b233df78490683177d1d918c4fee'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:12.762159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e2852fbf-c46e-4103-a028-fff15c64868c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0899b233df78490683177d1d918c4fee'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:12.780843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e2852fbf-c46e-4103-a028-fff15c64868c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0899b233df78490683177d1d918c4fee'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:12.801429 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 899/1826] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:12 2022] DELETE /identity/v3/users/0899b233df78490683177d1d918c4fee => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:12.875787 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db891408-0d94-42e0-a73e-99cbcc37fba0 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:12.904939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db891408-0d94-42e0-a73e-99cbcc37fba0 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:12.987412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2852fbf-c46e-4103-a028-fff15c64868c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:12.990622 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e2852fbf-c46e-4103-a028-fff15c64868c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:13.131857 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:13.142834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615a006-b806-47ab-be2f-aadc3943690b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:13.144539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615a006-b806-47ab-be2f-aadc3943690b service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:13.144989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615a006-b806-47ab-be2f-aadc3943690b service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:13.145269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615a006-b806-47ab-be2f-aadc3943690b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:13.149806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7615a006-b806-47ab-be2f-aadc3943690b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:13.330464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615a006-b806-47ab-be2f-aadc3943690b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:13.332930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615a006-b806-47ab-be2f-aadc3943690b service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:13.341837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2852fbf-c46e-4103-a028-fff15c64868c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:13.347993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 928/1827] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:13.349259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615a006-b806-47ab-be2f-aadc3943690b service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:13.349874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:13.351019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7615a006-b806-47ab-be2f-aadc3943690b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:13.352469 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:13.353013 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:13.353558 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] PATH_INFO: `/v3/projects/1fe4df2ded0c46c983c71b566ba4eb47` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:13.356228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe4df2ded0c46c983c71b566ba4eb47)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:13.360803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:13.374629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615a006-b806-47ab-be2f-aadc3943690b service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:13.397089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abd958-63de-4adb-b206-be8a37878aab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:13.398326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abd958-63de-4adb-b206-be8a37878aab service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:13.398635 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abd958-63de-4adb-b206-be8a37878aab service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:13.398918 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abd958-63de-4adb-b206-be8a37878aab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:13.409122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-21abd958-63de-4adb-b206-be8a37878aab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:13.525251 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe4df2ded0c46c983c71b566ba4eb47', 'request_id': 'req-16dea9f8-57ec-440c-ab29-67119f22a93d'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:13.557245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe4df2ded0c46c983c71b566ba4eb47', 'request_id': 'req-16dea9f8-57ec-440c-ab29-67119f22a93d'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:13.596889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe4df2ded0c46c983c71b566ba4eb47', 'request_id': 'req-16dea9f8-57ec-440c-ab29-67119f22a93d'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:13.641771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] The token cache is being invalidate because project 1fe4df2ded0c46c983c71b566ba4eb47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:13.643342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:13.645287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:13.648358 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abd958-63de-4adb-b206-be8a37878aab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:13.648706 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 900/1828] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:12 2022] DELETE /identity/v3/projects/1fe4df2ded0c46c983c71b566ba4eb47 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:13.650422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abd958-63de-4adb-b206-be8a37878aab service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:13.651612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:13.657857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:13.683935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 929/1829] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:13.758053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:13.842067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dea9f8-57ec-440c-ab29-67119f22a93d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:13.874229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7c203-25aa-4a71-814b-e1986df3ef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:13.879447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7c203-25aa-4a71-814b-e1986df3ef1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:13.880486 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7c203-25aa-4a71-814b-e1986df3ef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:13.881433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7c203-25aa-4a71-814b-e1986df3ef1c admin admin] PATH_INFO: `/v3/users/12b5ca6922e54e64a24d6671df012237` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:13.886112 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7c203-25aa-4a71-814b-e1986df3ef1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b5ca6922e54e64a24d6671df012237)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:13.896009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7c203-25aa-4a71-814b-e1986df3ef1c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:14.029487 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-97c7c203-25aa-4a71-814b-e1986df3ef1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b5ca6922e54e64a24d6671df012237'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:14.030710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-97c7c203-25aa-4a71-814b-e1986df3ef1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b5ca6922e54e64a24d6671df012237'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:14.031621 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-97c7c203-25aa-4a71-814b-e1986df3ef1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b5ca6922e54e64a24d6671df012237'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:14.051258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-97c7c203-25aa-4a71-814b-e1986df3ef1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b5ca6922e54e64a24d6671df012237'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:14.088556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-97c7c203-25aa-4a71-814b-e1986df3ef1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b5ca6922e54e64a24d6671df012237'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:14.107936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 901/1830] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:13 2022] DELETE /identity/v3/users/12b5ca6922e54e64a24d6671df012237 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:14.292864 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abd958-63de-4adb-b206-be8a37878aab service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:14.294731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-21abd958-63de-4adb-b206-be8a37878aab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:14.340650 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abd958-63de-4adb-b206-be8a37878aab service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:14.547993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:14.549487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:14.549960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:14.550511 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] PATH_INFO: `/v3/projects/3e46cddd8d244e079777789d293410e8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:14.552443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e46cddd8d244e079777789d293410e8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:14.555234 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:14.640732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:14.645152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e46cddd8d244e079777789d293410e8', 'request_id': 'req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:14.653925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e46cddd8d244e079777789d293410e8', 'request_id': 'req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:14.665064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e46cddd8d244e079777789d293410e8', 'request_id': 'req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:14.685730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] The token cache is being invalidate because project 3e46cddd8d244e079777789d293410e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:14.686337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:14.688147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:14.690029 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 930/1831] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:14 2022] DELETE /identity/v3/projects/3e46cddd8d244e079777789d293410e8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:14.695835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabc7df-eae0-463f-85c6-372bd8226522 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:14.696418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabc7df-eae0-463f-85c6-372bd8226522 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:14.696507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabc7df-eae0-463f-85c6-372bd8226522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:14.724596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3fabc7df-eae0-463f-85c6-372bd8226522 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:14.725926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3fabc7df-eae0-463f-85c6-372bd8226522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:14.762290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:14.763912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:14.828354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 902/1832] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:14.836819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed49116-dd14-4831-a402-cb48d963b15e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:14.837059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed49116-dd14-4831-a402-cb48d963b15e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:14.837303 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed49116-dd14-4831-a402-cb48d963b15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:14.862740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1ed49116-dd14-4831-a402-cb48d963b15e None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:14.865078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1ed49116-dd14-4831-a402-cb48d963b15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:14.883296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 903/1833] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:14.883498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a6a66-66c6-4b8f-89b8-3d6c4c655587 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:14.886335 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed49116-dd14-4831-a402-cb48d963b15e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:14.892269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8552d-cf3a-4391-9bba-47166d3ef6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:14.894089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8552d-cf3a-4391-9bba-47166d3ef6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:14.894221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8552d-cf3a-4391-9bba-47166d3ef6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:14.894642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8552d-cf3a-4391-9bba-47166d3ef6df admin admin] PATH_INFO: `/v3/projects/0e2ad930d9664966944c2f9edd04906d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:14.897175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8552d-cf3a-4391-9bba-47166d3ef6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2ad930d9664966944c2f9edd04906d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:14.901420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8552d-cf3a-4391-9bba-47166d3ef6df admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:14.904635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed49116-dd14-4831-a402-cb48d963b15e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:14.913946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29b87e-5ffe-448c-8bc0-72b9d26fbf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:14.915215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29b87e-5ffe-448c-8bc0-72b9d26fbf3f admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:14.915962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29b87e-5ffe-448c-8bc0-72b9d26fbf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:14.916360 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29b87e-5ffe-448c-8bc0-72b9d26fbf3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:14.917736 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29b87e-5ffe-448c-8bc0-72b9d26fbf3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:14.918325 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29b87e-5ffe-448c-8bc0-72b9d26fbf3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:14.921327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29b87e-5ffe-448c-8bc0-72b9d26fbf3f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:14.943331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 904/1834] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:24:14.949224 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29b87e-5ffe-448c-8bc0-72b9d26fbf3f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:14.966028 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29b87e-5ffe-448c-8bc0-72b9d26fbf3f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:14.972173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102bab9-3a44-4e2d-90ab-86f543e413d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:14.973025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102bab9-3a44-4e2d-90ab-86f543e413d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:14.973455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102bab9-3a44-4e2d-90ab-86f543e413d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:14.973843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102bab9-3a44-4e2d-90ab-86f543e413d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:14.974559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102bab9-3a44-4e2d-90ab-86f543e413d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:14.977075 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102bab9-3a44-4e2d-90ab-86f543e413d0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:15.001817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-85e8552d-cf3a-4391-9bba-47166d3ef6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2ad930d9664966944c2f9edd04906d', 'request_id': 'req-85e8552d-cf3a-4391-9bba-47166d3ef6df'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:15.009499 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-85e8552d-cf3a-4391-9bba-47166d3ef6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2ad930d9664966944c2f9edd04906d', 'request_id': 'req-85e8552d-cf3a-4391-9bba-47166d3ef6df'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:15.023060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 905/1835] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:14 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:15.027975 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-85e8552d-cf3a-4391-9bba-47166d3ef6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2ad930d9664966944c2f9edd04906d', 'request_id': 'req-85e8552d-cf3a-4391-9bba-47166d3ef6df'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:15.028268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102bab9-3a44-4e2d-90ab-86f543e413d0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:15.035242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:15.050938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-85e8552d-cf3a-4391-9bba-47166d3ef6df admin admin] The token cache is being invalidate because project 0e2ad930d9664966944c2f9edd04906d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:15.051464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-85e8552d-cf3a-4391-9bba-47166d3ef6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:15.052374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-85e8552d-cf3a-4391-9bba-47166d3ef6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:15.060083 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 931/1836] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:14 2022] DELETE /identity/v3/projects/0e2ad930d9664966944c2f9edd04906d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:15.062595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b403e15-7474-4c5a-b691-d825590b76a6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:15.063292 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b403e15-7474-4c5a-b691-d825590b76a6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:15.063590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b403e15-7474-4c5a-b691-d825590b76a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:15.093765 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8b403e15-7474-4c5a-b691-d825590b76a6 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:15.094622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8b403e15-7474-4c5a-b691-d825590b76a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:15.128079 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102bab9-3a44-4e2d-90ab-86f543e413d0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:15.133073 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09a0b1-bb93-4739-81bd-c6994f9616af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:15.133697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a0b1-bb93-4739-81bd-c6994f9616af admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:15.133976 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a0b1-bb93-4739-81bd-c6994f9616af admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:15.134244 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a0b1-bb93-4739-81bd-c6994f9616af admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:15.135458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09a0b1-bb93-4739-81bd-c6994f9616af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:15.138231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09a0b1-bb93-4739-81bd-c6994f9616af admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:15.172890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 906/1837] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:15 2022] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:15.176565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09a0b1-bb93-4739-81bd-c6994f9616af admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:15.178392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5d09a0b1-bb93-4739-81bd-c6994f9616af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:15.198068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09a0b1-bb93-4739-81bd-c6994f9616af admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:15.203581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 932/1838] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:15.212380 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4b3b-d14a-4a73-be17-de9e9c0bbb9c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:15.213049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4b3b-d14a-4a73-be17-de9e9c0bbb9c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:15.213424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4b3b-d14a-4a73-be17-de9e9c0bbb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:15.214497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a10d42-c4af-46b6-a487-51116e964614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:15.215352 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10d42-c4af-46b6-a487-51116e964614 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:15.215762 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10d42-c4af-46b6-a487-51116e964614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:15.216147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10d42-c4af-46b6-a487-51116e964614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:15.217202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a10d42-c4af-46b6-a487-51116e964614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:15.220229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a10d42-c4af-46b6-a487-51116e964614 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:15.229558 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:15.240355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 907/1839] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:15.242321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a10d42-c4af-46b6-a487-51116e964614 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:15.251476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e92f4b3b-d14a-4a73-be17-de9e9c0bbb9c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:15.253608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e92f4b3b-d14a-4a73-be17-de9e9c0bbb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:15.257372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a10d42-c4af-46b6-a487-51116e964614 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:15.262650 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c178dcf-b608-44b7-95d8-ca8eed251263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:15.262946 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 933/1840] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:15.263167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c178dcf-b608-44b7-95d8-ca8eed251263 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:15.263450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c178dcf-b608-44b7-95d8-ca8eed251263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:15.263800 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c178dcf-b608-44b7-95d8-ca8eed251263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:15.264398 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c178dcf-b608-44b7-95d8-ca8eed251263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:15.266810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c178dcf-b608-44b7-95d8-ca8eed251263 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:15.267574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f4b3b-d14a-4a73-be17-de9e9c0bbb9c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:15.283323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 908/1841] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:15.284414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c178dcf-b608-44b7-95d8-ca8eed251263 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:15.286660 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f4b3b-d14a-4a73-be17-de9e9c0bbb9c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:15.294790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9410f-a92b-4cdb-8793-b66b117e90b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:15.296150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c178dcf-b608-44b7-95d8-ca8eed251263 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:15.296999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9410f-a92b-4cdb-8793-b66b117e90b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:15.297750 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9410f-a92b-4cdb-8793-b66b117e90b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:15.298171 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9410f-a92b-4cdb-8793-b66b117e90b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:15.299061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9410f-a92b-4cdb-8793-b66b117e90b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:15.299509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9410f-a92b-4cdb-8793-b66b117e90b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:15.301544 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9410f-a92b-4cdb-8793-b66b117e90b6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:15.303440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94897d2-5604-486a-979e-74cd7fea4a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:15.304454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94897d2-5604-486a-979e-74cd7fea4a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:15.304839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94897d2-5604-486a-979e-74cd7fea4a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:15.305210 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94897d2-5604-486a-979e-74cd7fea4a5b admin admin] PATH_INFO: `/v3/projects/3a2623d38fd44ef499e2badf39992f76/users/fccd7cb13cc14ba6bfcd0ec95b8315d1/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:15.325278 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 934/1842] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:24:15.328289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9410f-a92b-4cdb-8793-b66b117e90b6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:15.341306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94897d2-5604-486a-979e-74cd7fea4a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2623d38fd44ef499e2badf39992f76, user_id=fccd7cb13cc14ba6bfcd0ec95b8315d1, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:15.342210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9410f-a92b-4cdb-8793-b66b117e90b6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:15.345824 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94897d2-5604-486a-979e-74cd7fea4a5b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:15.348506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8cf90-b9b6-4348-9de3-f5d6186b78bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:15.349178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8cf90-b9b6-4348-9de3-f5d6186b78bc admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:15.349510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8cf90-b9b6-4348-9de3-f5d6186b78bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:15.349799 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8cf90-b9b6-4348-9de3-f5d6186b78bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:15.350422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8cf90-b9b6-4348-9de3-f5d6186b78bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:15.352531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8cf90-b9b6-4348-9de3-f5d6186b78bc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:15.368845 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 909/1843] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:15 2022] PUT /identity/v3/projects/3a2623d38fd44ef499e2badf39992f76/users/fccd7cb13cc14ba6bfcd0ec95b8315d1/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:15.387038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507f401-896e-45b0-a481-a18b7eb07a1a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:15.387322 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507f401-896e-45b0-a481-a18b7eb07a1a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:15.387594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507f401-896e-45b0-a481-a18b7eb07a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:15.407797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 935/1844] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:15 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:15.410669 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8cf90-b9b6-4348-9de3-f5d6186b78bc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:15.469512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7507f401-896e-45b0-a481-a18b7eb07a1a None None] MFA Rules not processed for user `fccd7cb13cc14ba6bfcd0ec95b8315d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:15.469512 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7507f401-896e-45b0-a481-a18b7eb07a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:15.574593 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 910/1845] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:15.579896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507f401-896e-45b0-a481-a18b7eb07a1a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:15.618885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8cf90-b9b6-4348-9de3-f5d6186b78bc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:15.632162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895169b-57a8-4eca-944f-5acf4a5fceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:15.635224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895169b-57a8-4eca-944f-5acf4a5fceed admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:15.636180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895169b-57a8-4eca-944f-5acf4a5fceed admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:15.636958 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895169b-57a8-4eca-944f-5acf4a5fceed admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:15.639350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895169b-57a8-4eca-944f-5acf4a5fceed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:15.643744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895169b-57a8-4eca-944f-5acf4a5fceed admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:15.662033 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:15.715036 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 936/1846] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:15 2022] POST /identity/v3/users => generated 289 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:15.720180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895169b-57a8-4eca-944f-5acf4a5fceed admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:15.753757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895169b-57a8-4eca-944f-5acf4a5fceed admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:15.754980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507f401-896e-45b0-a481-a18b7eb07a1a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:15.769183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8df82a-767f-42ce-819d-9a6e4833fc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:15.772732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8df82a-767f-42ce-819d-9a6e4833fc31 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:15.773195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8df82a-767f-42ce-819d-9a6e4833fc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:15.773682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8df82a-767f-42ce-819d-9a6e4833fc31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:15.776139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18358a-92fa-477e-b401-ca000090f17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:15.777186 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18358a-92fa-477e-b401-ca000090f17c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:15.777657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18358a-92fa-477e-b401-ca000090f17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:15.778106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18358a-92fa-477e-b401-ca000090f17c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:15.779287 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18358a-92fa-477e-b401-ca000090f17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:15.782440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18358a-92fa-477e-b401-ca000090f17c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:15.785432 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8df82a-767f-42ce-819d-9a6e4833fc31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:15.789481 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8df82a-767f-42ce-819d-9a6e4833fc31 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:15.839214 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 937/1847] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:15.842152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18358a-92fa-477e-b401-ca000090f17c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:15.866437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18358a-92fa-477e-b401-ca000090f17c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:15.880932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f900e-b5df-41ec-a6ec-938096795eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:15.881771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f900e-b5df-41ec-a6ec-938096795eda admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:15.882114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f900e-b5df-41ec-a6ec-938096795eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:15.882623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f900e-b5df-41ec-a6ec-938096795eda admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:15.883539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f900e-b5df-41ec-a6ec-938096795eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:15.885559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f900e-b5df-41ec-a6ec-938096795eda admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:15.893947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 911/1848] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:15 2022] POST /identity/v3/projects => generated 365 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:15.899502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8df82a-767f-42ce-819d-9a6e4833fc31 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:15.912519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 938/1849] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:15.913664 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f900e-b5df-41ec-a6ec-938096795eda admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:15.927513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f900e-b5df-41ec-a6ec-938096795eda admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:16.027595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42462f75-9c41-4659-93a2-f9e6ad97e6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:16.028449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462f75-9c41-4659-93a2-f9e6ad97e6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:16.029006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462f75-9c41-4659-93a2-f9e6ad97e6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:16.029411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462f75-9c41-4659-93a2-f9e6ad97e6fe admin admin] PATH_INFO: `/v3/projects/3a0ec05c87204f0abdf9634def502417/users/d3ab779712fc421c88af7e503c0090b4/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:16.049389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42462f75-9c41-4659-93a2-f9e6ad97e6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0ec05c87204f0abdf9634def502417, user_id=d3ab779712fc421c88af7e503c0090b4, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:16.053028 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42462f75-9c41-4659-93a2-f9e6ad97e6fe admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:16.077973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 939/1850] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:15 2022] PUT /identity/v3/projects/3a0ec05c87204f0abdf9634def502417/users/d3ab779712fc421c88af7e503c0090b4/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:16.084755 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8df82a-767f-42ce-819d-9a6e4833fc31 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:16.096840 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f9f10-b3a6-4c86-b197-b184818f44f1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:16.097279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f9f10-b3a6-4c86-b197-b184818f44f1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:16.098245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f9f10-b3a6-4c86-b197-b184818f44f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:16.139433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:16.160604 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-950f9f10-b3a6-4c86-b197-b184818f44f1 None None] MFA Rules not processed for user `d3ab779712fc421c88af7e503c0090b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:16.162288 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-950f9f10-b3a6-4c86-b197-b184818f44f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:16.201373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3761a71-1b26-4ccd-b060-864b9cf5b4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:16.202382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3761a71-1b26-4ccd-b060-864b9cf5b4de admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:16.202989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3761a71-1b26-4ccd-b060-864b9cf5b4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:16.203359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3761a71-1b26-4ccd-b060-864b9cf5b4de admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:16.204131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3761a71-1b26-4ccd-b060-864b9cf5b4de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:16.206551 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3761a71-1b26-4ccd-b060-864b9cf5b4de admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:16.254574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 912/1851] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:15 2022] POST /identity/v3/users => generated 289 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:16.260401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3761a71-1b26-4ccd-b060-864b9cf5b4de admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:16.273038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3761a71-1b26-4ccd-b060-864b9cf5b4de admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:16.278607 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a4c44-d1f6-4ef1-965b-79453cb134af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:16.279261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4c44-d1f6-4ef1-965b-79453cb134af admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:16.279516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4c44-d1f6-4ef1-965b-79453cb134af admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:16.279782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4c44-d1f6-4ef1-965b-79453cb134af admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:16.280467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a4c44-d1f6-4ef1-965b-79453cb134af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:16.282146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a4c44-d1f6-4ef1-965b-79453cb134af admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:16.296097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 940/1852] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:16.298399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 913/1853] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:24:16.302433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f9f10-b3a6-4c86-b197-b184818f44f1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:16.303271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a4c44-d1f6-4ef1-965b-79453cb134af admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:16.321206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a4c44-d1f6-4ef1-965b-79453cb134af admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:16.327210 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5058b9-bb57-4771-8755-c5f9955fe971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:16.327933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f9f10-b3a6-4c86-b197-b184818f44f1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:16.328198 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5058b9-bb57-4771-8755-c5f9955fe971 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:16.328659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5058b9-bb57-4771-8755-c5f9955fe971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:16.329070 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5058b9-bb57-4771-8755-c5f9955fe971 admin admin] PATH_INFO: `/v3/projects/9d534e16414f4d07a900af6bc02e3188/users/0ab06a13e7d44ef7a0c4b5c0df2d1374/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:16.335978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9223414-8b8a-46bf-8f12-3bb3d8dcb388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:16.337088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9223414-8b8a-46bf-8f12-3bb3d8dcb388 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:16.339520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9223414-8b8a-46bf-8f12-3bb3d8dcb388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:16.339797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9223414-8b8a-46bf-8f12-3bb3d8dcb388 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:16.340473 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9223414-8b8a-46bf-8f12-3bb3d8dcb388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:16.342466 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9223414-8b8a-46bf-8f12-3bb3d8dcb388 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:16.347890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5058b9-bb57-4771-8755-c5f9955fe971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d534e16414f4d07a900af6bc02e3188, user_id=0ab06a13e7d44ef7a0c4b5c0df2d1374, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:16.351384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5058b9-bb57-4771-8755-c5f9955fe971 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:16.375614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 914/1854] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:16 2022] PUT /identity/v3/projects/9d534e16414f4d07a900af6bc02e3188/users/0ab06a13e7d44ef7a0c4b5c0df2d1374/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:16.380314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5058b9-bb57-4771-8755-c5f9955fe971 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:16.408516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 941/1855] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:16 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:16.413613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9223414-8b8a-46bf-8f12-3bb3d8dcb388 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:16.420671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:16.494750 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5058b9-bb57-4771-8755-c5f9955fe971 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:16.529328 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9223414-8b8a-46bf-8f12-3bb3d8dcb388 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:16.536918 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d25e83-99bc-4418-a49c-c0a47718e8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:16.537809 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d25e83-99bc-4418-a49c-c0a47718e8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:16.538634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d25e83-99bc-4418-a49c-c0a47718e8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:16.538909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d25e83-99bc-4418-a49c-c0a47718e8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:16.539821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d25e83-99bc-4418-a49c-c0a47718e8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:16.543773 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d25e83-99bc-4418-a49c-c0a47718e8d9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:16.573269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 942/1856] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:16 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:16.577212 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d25e83-99bc-4418-a49c-c0a47718e8d9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:16.577815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20db11-95b2-46d8-b3b2-8088e8704691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:16.578683 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20db11-95b2-46d8-b3b2-8088e8704691 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:16.579163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20db11-95b2-46d8-b3b2-8088e8704691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:16.579628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20db11-95b2-46d8-b3b2-8088e8704691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:16.580624 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20db11-95b2-46d8-b3b2-8088e8704691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:16.583831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20db11-95b2-46d8-b3b2-8088e8704691 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:16.589545 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d25e83-99bc-4418-a49c-c0a47718e8d9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:16.596177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddf666-0043-44af-9f96-bb7c7f9021f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:16.596836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddf666-0043-44af-9f96-bb7c7f9021f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:16.597112 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddf666-0043-44af-9f96-bb7c7f9021f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:16.597385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddf666-0043-44af-9f96-bb7c7f9021f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:16.598080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddf666-0043-44af-9f96-bb7c7f9021f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:16.599849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddf666-0043-44af-9f96-bb7c7f9021f6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:16.603899 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 915/1857] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:24:16.605391 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20db11-95b2-46d8-b3b2-8088e8704691 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:16.612399 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 943/1858] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:24:16.626590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddf666-0043-44af-9f96-bb7c7f9021f6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:16.650105 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20db11-95b2-46d8-b3b2-8088e8704691 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:16.655615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddf666-0043-44af-9f96-bb7c7f9021f6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:16.663055 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa4212-702d-4041-8790-7702d592e153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:16.663719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa4212-702d-4041-8790-7702d592e153 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:16.663894 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6f85c-f7ec-47bd-adf2-0f1c0aaa0919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:16.664061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa4212-702d-4041-8790-7702d592e153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:16.664341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa4212-702d-4041-8790-7702d592e153 admin admin] PATH_INFO: `/v3/projects/1c0a1ede8abd4675bc982d1ea08493f0/users/adce145df5ef44a0a933309385ecee76/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:16.665325 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6f85c-f7ec-47bd-adf2-0f1c0aaa0919 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:16.665688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6f85c-f7ec-47bd-adf2-0f1c0aaa0919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:16.666797 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6f85c-f7ec-47bd-adf2-0f1c0aaa0919 admin admin] PATH_INFO: `/v3/projects/9d534e16414f4d07a900af6bc02e3188/users/0ab06a13e7d44ef7a0c4b5c0df2d1374/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:16.671840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6f85c-f7ec-47bd-adf2-0f1c0aaa0919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d534e16414f4d07a900af6bc02e3188, user_id=0ab06a13e7d44ef7a0c4b5c0df2d1374, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:16.678389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6f85c-f7ec-47bd-adf2-0f1c0aaa0919 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:16.709530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 916/1859] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:16 2022] PUT /identity/v3/projects/9d534e16414f4d07a900af6bc02e3188/users/0ab06a13e7d44ef7a0c4b5c0df2d1374/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:16.710360 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa4212-702d-4041-8790-7702d592e153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0a1ede8abd4675bc982d1ea08493f0, user_id=adce145df5ef44a0a933309385ecee76, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:16.711903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac012f9-481a-4991-8e2c-94a593c03d0a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:16.712300 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac012f9-481a-4991-8e2c-94a593c03d0a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:16.712926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac012f9-481a-4991-8e2c-94a593c03d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:16.713203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa4212-702d-4041-8790-7702d592e153 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:16.740761 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 944/1860] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:16 2022] PUT /identity/v3/projects/1c0a1ede8abd4675bc982d1ea08493f0/users/adce145df5ef44a0a933309385ecee76/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:16.741844 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa4212-702d-4041-8790-7702d592e153 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:16.772839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-cac012f9-481a-4991-8e2c-94a593c03d0a None None] MFA Rules not processed for user `0ab06a13e7d44ef7a0c4b5c0df2d1374`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:16.775810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cac012f9-481a-4991-8e2c-94a593c03d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:16.862551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:16.936327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 917/1861] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:16.961006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa4212-702d-4041-8790-7702d592e153 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:16.964718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac012f9-481a-4991-8e2c-94a593c03d0a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:16.967481 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cac012f9-481a-4991-8e2c-94a593c03d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:16.979437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4b25c-dc03-4a56-b32b-0dc15e969a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:16.982310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4b25c-dc03-4a56-b32b-0dc15e969a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:16.982310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4b25c-dc03-4a56-b32b-0dc15e969a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:16.982310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4b25c-dc03-4a56-b32b-0dc15e969a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:16.982310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4b25c-dc03-4a56-b32b-0dc15e969a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:16.990310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4b25c-dc03-4a56-b32b-0dc15e969a43 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:17.023546 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 945/1862] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:17.028099 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4b25c-dc03-4a56-b32b-0dc15e969a43 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:17.045746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4b25c-dc03-4a56-b32b-0dc15e969a43 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:17.061623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee02d9-2dde-4065-b174-e1c18807015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:17.062357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee02d9-2dde-4065-b174-e1c18807015c admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:17.062699 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee02d9-2dde-4065-b174-e1c18807015c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:17.062945 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee02d9-2dde-4065-b174-e1c18807015c admin admin] PATH_INFO: `/v3/projects/1c0a1ede8abd4675bc982d1ea08493f0/users/adce145df5ef44a0a933309385ecee76/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:17.069912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee02d9-2dde-4065-b174-e1c18807015c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0a1ede8abd4675bc982d1ea08493f0, user_id=adce145df5ef44a0a933309385ecee76, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:17.076714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee02d9-2dde-4065-b174-e1c18807015c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:17.106113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 946/1863] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:17 2022] PUT /identity/v3/projects/1c0a1ede8abd4675bc982d1ea08493f0/users/adce145df5ef44a0a933309385ecee76/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:17.118423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481851a-02b5-478b-8d01-f3c990c44637 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:17.118884 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481851a-02b5-478b-8d01-f3c990c44637 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:17.119528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481851a-02b5-478b-8d01-f3c990c44637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:17.208944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b481851a-02b5-478b-8d01-f3c990c44637 None None] MFA Rules not processed for user `adce145df5ef44a0a933309385ecee76`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:17.210221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b481851a-02b5-478b-8d01-f3c990c44637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:17.216998 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:17.259036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac012f9-481a-4991-8e2c-94a593c03d0a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:17.343884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d9a53-f84d-4309-ab46-fc9f2d42f335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:17.351074 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d9a53-f84d-4309-ab46-fc9f2d42f335 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:17.353323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d9a53-f84d-4309-ab46-fc9f2d42f335 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:17.354473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d9a53-f84d-4309-ab46-fc9f2d42f335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:17.364570 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 947/1864] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:17.373473 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481851a-02b5-478b-8d01-f3c990c44637 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:17.375364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b481851a-02b5-478b-8d01-f3c990c44637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:17.392517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481851a-02b5-478b-8d01-f3c990c44637 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:17.397912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc6188-6d14-4092-982d-f2dac9ea2075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:17.398687 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc6188-6d14-4092-982d-f2dac9ea2075 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:17.399112 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc6188-6d14-4092-982d-f2dac9ea2075 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:17.399462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc6188-6d14-4092-982d-f2dac9ea2075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:17.477634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d9a53-f84d-4309-ab46-fc9f2d42f335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:17.479723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d9a53-f84d-4309-ab46-fc9f2d42f335 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:17.502036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 918/1865] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:17.515334 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc6188-6d14-4092-982d-f2dac9ea2075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:17.517144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc6188-6d14-4092-982d-f2dac9ea2075 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:17.550037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 948/1866] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:24:17.941355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d9a53-f84d-4309-ab46-fc9f2d42f335 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:17.942698 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c31d9a53-f84d-4309-ab46-fc9f2d42f335 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:17.951264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc6188-6d14-4092-982d-f2dac9ea2075 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:17.961654 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc6188-6d14-4092-982d-f2dac9ea2075 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:17.972899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d62b13-13cc-4e7e-b065-762a2afea09d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:17.973487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d62b13-13cc-4e7e-b065-762a2afea09d service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:17.974095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d62b13-13cc-4e7e-b065-762a2afea09d service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:17.974095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d62b13-13cc-4e7e-b065-762a2afea09d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:18.080796 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:18.125818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d62b13-13cc-4e7e-b065-762a2afea09d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:18.127279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d62b13-13cc-4e7e-b065-762a2afea09d service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:18.146345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d9a53-f84d-4309-ab46-fc9f2d42f335 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:18.153236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec99ae2-f1c1-4e2e-ba22-0641cb4cfa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:18.153971 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec99ae2-f1c1-4e2e-ba22-0641cb4cfa23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:18.154537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec99ae2-f1c1-4e2e-ba22-0641cb4cfa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:18.154815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec99ae2-f1c1-4e2e-ba22-0641cb4cfa23 admin admin] PATH_INFO: `/v3/users/652df40949ef485d90f0e9ada18674ad` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:18.156078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec99ae2-f1c1-4e2e-ba22-0641cb4cfa23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=652df40949ef485d90f0e9ada18674ad)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:18.158416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec99ae2-f1c1-4e2e-ba22-0641cb4cfa23 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:18.162570 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 949/1867] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:24:18.255066 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:18.257420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9ec99ae2-f1c1-4e2e-ba22-0641cb4cfa23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652df40949ef485d90f0e9ada18674ad'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:18.258232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9ec99ae2-f1c1-4e2e-ba22-0641cb4cfa23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652df40949ef485d90f0e9ada18674ad'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:18.258937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9ec99ae2-f1c1-4e2e-ba22-0641cb4cfa23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652df40949ef485d90f0e9ada18674ad'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:18.271404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9ec99ae2-f1c1-4e2e-ba22-0641cb4cfa23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652df40949ef485d90f0e9ada18674ad'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:18.290373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9ec99ae2-f1c1-4e2e-ba22-0641cb4cfa23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652df40949ef485d90f0e9ada18674ad'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:18.315357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 919/1868] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:17 2022] DELETE /identity/v3/users/652df40949ef485d90f0e9ada18674ad => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:18.317828 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232df33-6caa-4aa4-828f-0a118367cb0d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:18.318339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232df33-6caa-4aa4-828f-0a118367cb0d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:18.318818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232df33-6caa-4aa4-828f-0a118367cb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:18.372630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b232df33-6caa-4aa4-828f-0a118367cb0d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:18.378192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b232df33-6caa-4aa4-828f-0a118367cb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:18.544442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 950/1869] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:18.555584 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec99ae2-f1c1-4e2e-ba22-0641cb4cfa23 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:18.557997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9ec99ae2-f1c1-4e2e-ba22-0641cb4cfa23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:18.638998 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec99ae2-f1c1-4e2e-ba22-0641cb4cfa23 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:18.646601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dacce-caec-46da-ae0b-59cfece96004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:18.648325 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dacce-caec-46da-ae0b-59cfece96004 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:18.648325 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dacce-caec-46da-ae0b-59cfece96004 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:18.648772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dacce-caec-46da-ae0b-59cfece96004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:18.674663 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dacce-caec-46da-ae0b-59cfece96004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:18.677844 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dacce-caec-46da-ae0b-59cfece96004 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:18.696803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 920/1870] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:18.718205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232df33-6caa-4aa4-828f-0a118367cb0d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:18.721099 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b232df33-6caa-4aa4-828f-0a118367cb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:18.815591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232df33-6caa-4aa4-828f-0a118367cb0d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:18.845552 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de681a-e073-4444-b611-9446faa66e63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:18.846820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de681a-e073-4444-b611-9446faa66e63 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:18.847337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de681a-e073-4444-b611-9446faa66e63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:18.847852 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de681a-e073-4444-b611-9446faa66e63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:18.857449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-53de681a-e073-4444-b611-9446faa66e63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:19.010542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de681a-e073-4444-b611-9446faa66e63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:19.013337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de681a-e073-4444-b611-9446faa66e63 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:19.028615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 951/1871] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:19.508103 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dacce-caec-46da-ae0b-59cfece96004 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:19.510642 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-900dacce-caec-46da-ae0b-59cfece96004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:19.532145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dacce-caec-46da-ae0b-59cfece96004 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:19.545770 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:19.546439 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:19.547841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:19.547841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] PATH_INFO: `/v3/projects/a8b235bc63ea405cbd014584130a4e66` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:19.550780 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8b235bc63ea405cbd014584130a4e66)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:19.556044 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:19.703283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b235bc63ea405cbd014584130a4e66', 'request_id': 'req-e5547252-1053-4090-ba37-87c7380f1d33'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:19.732722 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b235bc63ea405cbd014584130a4e66', 'request_id': 'req-e5547252-1053-4090-ba37-87c7380f1d33'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:19.743363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b235bc63ea405cbd014584130a4e66', 'request_id': 'req-e5547252-1053-4090-ba37-87c7380f1d33'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:19.772128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] The token cache is being invalidate because project a8b235bc63ea405cbd014584130a4e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:19.772580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:19.775630 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:19.779637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 921/1872] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:19 2022] DELETE /identity/v3/projects/a8b235bc63ea405cbd014584130a4e66 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:19.786992 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de681a-e073-4444-b611-9446faa66e63 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:19.816772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de681a-e073-4444-b611-9446faa66e63 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:19.910059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:19.999281 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd67ef-e06c-49cf-a47a-e7668dc6a489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:20.002433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd67ef-e06c-49cf-a47a-e7668dc6a489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:20.002875 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd67ef-e06c-49cf-a47a-e7668dc6a489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:20.003356 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd67ef-e06c-49cf-a47a-e7668dc6a489 admin admin] PATH_INFO: `/v3/users/0f59f587d1004944a46c90111f040171` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:20.007854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd67ef-e06c-49cf-a47a-e7668dc6a489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f59f587d1004944a46c90111f040171)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:20.018091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd67ef-e06c-49cf-a47a-e7668dc6a489 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:20.194924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-50fd67ef-e06c-49cf-a47a-e7668dc6a489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f59f587d1004944a46c90111f040171'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:20.195656 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-50fd67ef-e06c-49cf-a47a-e7668dc6a489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f59f587d1004944a46c90111f040171'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:20.244248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-50fd67ef-e06c-49cf-a47a-e7668dc6a489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f59f587d1004944a46c90111f040171'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:20.267599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-50fd67ef-e06c-49cf-a47a-e7668dc6a489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f59f587d1004944a46c90111f040171'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:20.269049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-50fd67ef-e06c-49cf-a47a-e7668dc6a489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f59f587d1004944a46c90111f040171'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:20.300274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 952/1873] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:19 2022] DELETE /identity/v3/users/0f59f587d1004944a46c90111f040171 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:20.759942 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:20.762724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:20.896364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:20.906289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5547252-1053-4090-ba37-87c7380f1d33 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:21.005234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b809447-403a-408a-aee6-885cfe6d437b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:21.006407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b809447-403a-408a-aee6-885cfe6d437b service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:21.006771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b809447-403a-408a-aee6-885cfe6d437b service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:21.007102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b809447-403a-408a-aee6-885cfe6d437b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:21.008949 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58001dbf-3624-40b0-bb24-6bf05d6bfec3 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:21.009960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9b809447-403a-408a-aee6-885cfe6d437b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:21.010756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58001dbf-3624-40b0-bb24-6bf05d6bfec3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:21.011242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58001dbf-3624-40b0-bb24-6bf05d6bfec3 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:21.013403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 953/1874] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 21 16:24:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:24:21.032962 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f6550-24bf-42ae-8112-e13fe4a6f4c5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:21.034210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f6550-24bf-42ae-8112-e13fe4a6f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:21.034741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f6550-24bf-42ae-8112-e13fe4a6f4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:21.097021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-879f6550-24bf-42ae-8112-e13fe4a6f4c5 None None] MFA Rules not processed for user `d7ff08c990dc41b4811f97fecb7c4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:21.100043 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-879f6550-24bf-42ae-8112-e13fe4a6f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:21.158697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b809447-403a-408a-aee6-885cfe6d437b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:21.160322 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b809447-403a-408a-aee6-885cfe6d437b service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:21.172956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 922/1875] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:24:21.280501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 954/1876] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 21 16:24:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:21.288893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b809447-403a-408a-aee6-885cfe6d437b service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:21.291316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9b809447-403a-408a-aee6-885cfe6d437b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:21.311420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b809447-403a-408a-aee6-885cfe6d437b service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:21.322476 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51ceb7-f419-4032-8ab7-c21058a8b837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:21.323850 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51ceb7-f419-4032-8ab7-c21058a8b837 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:21.324145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51ceb7-f419-4032-8ab7-c21058a8b837 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:21.325401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51ceb7-f419-4032-8ab7-c21058a8b837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:21.340396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51ceb7-f419-4032-8ab7-c21058a8b837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:21.341201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51ceb7-f419-4032-8ab7-c21058a8b837 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:21.364925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 923/1877] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:24:21.383535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f6550-24bf-42ae-8112-e13fe4a6f4c5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:21.386094 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-879f6550-24bf-42ae-8112-e13fe4a6f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:21.514027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:21.553093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f6550-24bf-42ae-8112-e13fe4a6f4c5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:21.560434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:21.561141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:21.561443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:21.561682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] PATH_INFO: `/v3/projects/99dce9cc63ee4cb681c7d867e1025657` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:21.562925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99dce9cc63ee4cb681c7d867e1025657)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:21.564907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:21.625710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99dce9cc63ee4cb681c7d867e1025657', 'request_id': 'req-a6e8e35e-244f-4757-b090-4759653b41d5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:21.635106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99dce9cc63ee4cb681c7d867e1025657', 'request_id': 'req-a6e8e35e-244f-4757-b090-4759653b41d5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:21.646964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99dce9cc63ee4cb681c7d867e1025657', 'request_id': 'req-a6e8e35e-244f-4757-b090-4759653b41d5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:21.664188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] The token cache is being invalidate because project 99dce9cc63ee4cb681c7d867e1025657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:21.664477 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:21.666442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:21.668426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 955/1878] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:21 2022] DELETE /identity/v3/projects/99dce9cc63ee4cb681c7d867e1025657 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:21.674393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1572b32-99c2-4801-b96b-346da4cd458f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:21.674680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1572b32-99c2-4801-b96b-346da4cd458f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:21.674933 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1572b32-99c2-4801-b96b-346da4cd458f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:21.704654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b1572b32-99c2-4801-b96b-346da4cd458f None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:21.707252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b1572b32-99c2-4801-b96b-346da4cd458f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:21.949197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 924/1879] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:21.955544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cbcc-c07a-497e-bb89-3e13b6002f7b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:21.955801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:21.955985 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cbcc-c07a-497e-bb89-3e13b6002f7b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:21.956121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cbcc-c07a-497e-bb89-3e13b6002f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:21.957791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:21.993877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8e35e-244f-4757-b090-4759653b41d5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:22.010994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e87e6-337e-40fe-8132-48a88a73df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:22.014292 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e87e6-337e-40fe-8132-48a88a73df17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:22.015326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e87e6-337e-40fe-8132-48a88a73df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:22.016879 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e87e6-337e-40fe-8132-48a88a73df17 admin admin] PATH_INFO: `/v3/users/fccd7cb13cc14ba6bfcd0ec95b8315d1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:22.020953 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e87e6-337e-40fe-8132-48a88a73df17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fccd7cb13cc14ba6bfcd0ec95b8315d1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:22.028073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e87e6-337e-40fe-8132-48a88a73df17 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:22.037957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8b09cbcc-c07a-497e-bb89-3e13b6002f7b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:22.039227 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8b09cbcc-c07a-497e-bb89-3e13b6002f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:22.073859 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 925/1880] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:22.080742 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09cbcc-c07a-497e-bb89-3e13b6002f7b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:22.100616 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09cbcc-c07a-497e-bb89-3e13b6002f7b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:22.118374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee594f35-0d10-4adc-8180-ef5e6accfd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:22.120404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee594f35-0d10-4adc-8180-ef5e6accfd30 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:22.121627 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee594f35-0d10-4adc-8180-ef5e6accfd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:22.122428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee594f35-0d10-4adc-8180-ef5e6accfd30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:22.123935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee594f35-0d10-4adc-8180-ef5e6accfd30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:22.125065 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee594f35-0d10-4adc-8180-ef5e6accfd30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:22.129439 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee594f35-0d10-4adc-8180-ef5e6accfd30 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:22.155853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 926/1881] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:24:22.156899 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee594f35-0d10-4adc-8180-ef5e6accfd30 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:22.162206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f19e87e6-337e-40fe-8132-48a88a73df17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fccd7cb13cc14ba6bfcd0ec95b8315d1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:22.170520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f19e87e6-337e-40fe-8132-48a88a73df17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fccd7cb13cc14ba6bfcd0ec95b8315d1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:22.176172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee594f35-0d10-4adc-8180-ef5e6accfd30 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:22.191324 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d8ec4-4997-485f-9b82-e637f1730d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:22.193142 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d8ec4-4997-485f-9b82-e637f1730d02 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:22.193377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d8ec4-4997-485f-9b82-e637f1730d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:22.193656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d8ec4-4997-485f-9b82-e637f1730d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:22.195825 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d8ec4-4997-485f-9b82-e637f1730d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:22.200477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d8ec4-4997-485f-9b82-e637f1730d02 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:22.218224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f19e87e6-337e-40fe-8132-48a88a73df17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fccd7cb13cc14ba6bfcd0ec95b8315d1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:22.250808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f19e87e6-337e-40fe-8132-48a88a73df17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fccd7cb13cc14ba6bfcd0ec95b8315d1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:22.253114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f19e87e6-337e-40fe-8132-48a88a73df17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fccd7cb13cc14ba6bfcd0ec95b8315d1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:22.267115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:22.275866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 956/1882] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:21 2022] DELETE /identity/v3/users/fccd7cb13cc14ba6bfcd0ec95b8315d1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:22.284826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 927/1883] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:22 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:22.285027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b04cb-b90f-41da-97dc-6f0d9f6001ac None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:22.285027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b04cb-b90f-41da-97dc-6f0d9f6001ac None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:22.285027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b04cb-b90f-41da-97dc-6f0d9f6001ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:22.286121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d8ec4-4997-485f-9b82-e637f1730d02 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:22.288522 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0e0d8ec4-4997-485f-9b82-e637f1730d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:22.312892 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-301b04cb-b90f-41da-97dc-6f0d9f6001ac None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:22.315051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-301b04cb-b90f-41da-97dc-6f0d9f6001ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:22.380406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:22.397573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d8ec4-4997-485f-9b82-e637f1730d02 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:22.417673 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f856db-d808-47ef-8184-dbf48408160a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:22.418507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f856db-d808-47ef-8184-dbf48408160a admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:22.418674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f856db-d808-47ef-8184-dbf48408160a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:22.418897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f856db-d808-47ef-8184-dbf48408160a admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:22.419579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f856db-d808-47ef-8184-dbf48408160a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:22.421717 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f856db-d808-47ef-8184-dbf48408160a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:22.428905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 957/1884] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:22.440311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b04cb-b90f-41da-97dc-6f0d9f6001ac None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:22.443364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-301b04cb-b90f-41da-97dc-6f0d9f6001ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:22.448109 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 928/1885] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:22 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:22.452617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f856db-d808-47ef-8184-dbf48408160a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:22.465368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f856db-d808-47ef-8184-dbf48408160a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:22.470781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa67641-c112-4efd-a45e-8b4b2158f274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:22.471442 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa67641-c112-4efd-a45e-8b4b2158f274 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:22.471725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa67641-c112-4efd-a45e-8b4b2158f274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:22.471990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa67641-c112-4efd-a45e-8b4b2158f274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:22.472652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa67641-c112-4efd-a45e-8b4b2158f274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:22.474478 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa67641-c112-4efd-a45e-8b4b2158f274 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:22.486450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 929/1886] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:24:22.492165 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa67641-c112-4efd-a45e-8b4b2158f274 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:22.506439 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa67641-c112-4efd-a45e-8b4b2158f274 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:22.514744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cee557-11bc-4dda-9fe4-fe882338bb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:22.515996 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cee557-11bc-4dda-9fe4-fe882338bb74 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:22.516417 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cee557-11bc-4dda-9fe4-fe882338bb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:22.516942 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cee557-11bc-4dda-9fe4-fe882338bb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:22.518077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cee557-11bc-4dda-9fe4-fe882338bb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:22.521076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cee557-11bc-4dda-9fe4-fe882338bb74 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:22.538180 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 930/1887] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:22.539339 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cee557-11bc-4dda-9fe4-fe882338bb74 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:22.541417 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b04cb-b90f-41da-97dc-6f0d9f6001ac None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:22.548410 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191e194-60a8-46b6-a8d7-460a5295c296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:22.549790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191e194-60a8-46b6-a8d7-460a5295c296 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:22.550940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191e194-60a8-46b6-a8d7-460a5295c296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:22.551102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cee557-11bc-4dda-9fe4-fe882338bb74 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:22.551776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191e194-60a8-46b6-a8d7-460a5295c296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:22.557689 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a650e3-514e-4057-b434-3ca770748934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:22.558759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a650e3-514e-4057-b434-3ca770748934 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:22.559113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a650e3-514e-4057-b434-3ca770748934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:22.559457 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a650e3-514e-4057-b434-3ca770748934 admin admin] PATH_INFO: `/v3/projects/bf130a20cd9d465590718495d8371dcb/users/da219c913d7146d8b2c32ddce1649044/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:22.572765 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191e194-60a8-46b6-a8d7-460a5295c296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:22.577047 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191e194-60a8-46b6-a8d7-460a5295c296 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:22.581800 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a650e3-514e-4057-b434-3ca770748934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf130a20cd9d465590718495d8371dcb, user_id=da219c913d7146d8b2c32ddce1649044, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:22.585086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a650e3-514e-4057-b434-3ca770748934 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:22.598535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 958/1888] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:22.608415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191e194-60a8-46b6-a8d7-460a5295c296 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:22.610220 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7191e194-60a8-46b6-a8d7-460a5295c296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:22.618124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 931/1889] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:22 2022] PUT /identity/v3/projects/bf130a20cd9d465590718495d8371dcb/users/da219c913d7146d8b2c32ddce1649044/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:24:22.636345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd167f-c5f1-491d-8f85-ed29704d58c1 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:22.636345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd167f-c5f1-491d-8f85-ed29704d58c1 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:22.636788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd167f-c5f1-491d-8f85-ed29704d58c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:22.643479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191e194-60a8-46b6-a8d7-460a5295c296 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:22.689816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-01dd167f-c5f1-491d-8f85-ed29704d58c1 None None] MFA Rules not processed for user `da219c913d7146d8b2c32ddce1649044`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:22.692335 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-01dd167f-c5f1-491d-8f85-ed29704d58c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:22.782294 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cdb22-8e4e-4ac8-9f7d-10b011aa6be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:22.783728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cdb22-8e4e-4ac8-9f7d-10b011aa6be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:22.784125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cdb22-8e4e-4ac8-9f7d-10b011aa6be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:22.784430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cdb22-8e4e-4ac8-9f7d-10b011aa6be4 admin admin] PATH_INFO: `/v3/users/4aa00ee57f1843cf88c0c6453dfc17c2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:22.786202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cdb22-8e4e-4ac8-9f7d-10b011aa6be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aa00ee57f1843cf88c0c6453dfc17c2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:22.789484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cdb22-8e4e-4ac8-9f7d-10b011aa6be4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:22.857973 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 932/1890] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:22.864985 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd167f-c5f1-491d-8f85-ed29704d58c1 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:22.881600 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd167f-c5f1-491d-8f85-ed29704d58c1 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:22.892523 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4d735-c5fd-4ea6-abfb-1beaa3ecb4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:22.893920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4d735-c5fd-4ea6-abfb-1beaa3ecb4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:22.894525 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4d735-c5fd-4ea6-abfb-1beaa3ecb4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:22.894929 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4d735-c5fd-4ea6-abfb-1beaa3ecb4a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:22.896834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4d735-c5fd-4ea6-abfb-1beaa3ecb4a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:22.900071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4d735-c5fd-4ea6-abfb-1beaa3ecb4a1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:22.915378 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b3cdb22-8e4e-4ac8-9f7d-10b011aa6be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aa00ee57f1843cf88c0c6453dfc17c2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:22.918424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b3cdb22-8e4e-4ac8-9f7d-10b011aa6be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aa00ee57f1843cf88c0c6453dfc17c2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:22.956006 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 933/1891] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:22 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:22.958904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4d735-c5fd-4ea6-abfb-1beaa3ecb4a1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:22.962652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-07f4d735-c5fd-4ea6-abfb-1beaa3ecb4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:22.963498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b3cdb22-8e4e-4ac8-9f7d-10b011aa6be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aa00ee57f1843cf88c0c6453dfc17c2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:22.979507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b3cdb22-8e4e-4ac8-9f7d-10b011aa6be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aa00ee57f1843cf88c0c6453dfc17c2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:22.981579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b3cdb22-8e4e-4ac8-9f7d-10b011aa6be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aa00ee57f1843cf88c0c6453dfc17c2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:23.001717 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:23.007484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 959/1892] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:22 2022] DELETE /identity/v3/users/4aa00ee57f1843cf88c0c6453dfc17c2 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:23.014970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d0bac-990a-43b0-938c-c3f3e8852d7e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:23.015344 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d0bac-990a-43b0-938c-c3f3e8852d7e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:23.015623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d0bac-990a-43b0-938c-c3f3e8852d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:23.065299 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b94d0bac-990a-43b0-938c-c3f3e8852d7e None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:23.069574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b94d0bac-990a-43b0-938c-c3f3e8852d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:23.076621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:23.123560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4d735-c5fd-4ea6-abfb-1beaa3ecb4a1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:23.220563 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 960/1893] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:23.222518 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d0bac-990a-43b0-938c-c3f3e8852d7e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:23.225508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b94d0bac-990a-43b0-938c-c3f3e8852d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:23.266263 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d0bac-990a-43b0-938c-c3f3e8852d7e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:23.277230 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:23.278688 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:23.279435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:23.280043 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] PATH_INFO: `/v3/projects/3a2623d38fd44ef499e2badf39992f76` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:23.282548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2623d38fd44ef499e2badf39992f76)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:23.287237 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:23.331285 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edd845-db30-4425-870a-569d973e54d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:23.333063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edd845-db30-4425-870a-569d973e54d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:23.333912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edd845-db30-4425-870a-569d973e54d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:23.334585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edd845-db30-4425-870a-569d973e54d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:23.336585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edd845-db30-4425-870a-569d973e54d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:23.342843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edd845-db30-4425-870a-569d973e54d0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:23.492508 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 934/1894] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:22 2022] POST /identity/v3/users => generated 289 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:23.495630 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edd845-db30-4425-870a-569d973e54d0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:23.507561 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-82edd845-db30-4425-870a-569d973e54d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:23.526427 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2623d38fd44ef499e2badf39992f76', 'request_id': 'req-fa4b029d-00d1-4f3e-a08f-0f277383accd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:23.538700 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2623d38fd44ef499e2badf39992f76', 'request_id': 'req-fa4b029d-00d1-4f3e-a08f-0f277383accd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:23.557765 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2623d38fd44ef499e2badf39992f76', 'request_id': 'req-fa4b029d-00d1-4f3e-a08f-0f277383accd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:23.576651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] The token cache is being invalidate because project 3a2623d38fd44ef499e2badf39992f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:23.577175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:23.578214 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:23.583390 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 961/1895] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:23 2022] DELETE /identity/v3/projects/3a2623d38fd44ef499e2badf39992f76 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:23.583390 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:23.584024 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:23.662401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edd845-db30-4425-870a-569d973e54d0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:23.728744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b029d-00d1-4f3e-a08f-0f277383accd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:23.734402 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff2604-69ab-4283-990b-f272e19fabde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:23.735038 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff2604-69ab-4283-990b-f272e19fabde admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:23.735314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff2604-69ab-4283-990b-f272e19fabde admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:23.735582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff2604-69ab-4283-990b-f272e19fabde admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:23.736405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff2604-69ab-4283-990b-f272e19fabde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:23.738202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff2604-69ab-4283-990b-f272e19fabde admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:23.764725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 962/1896] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:23.766679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff2604-69ab-4283-990b-f272e19fabde admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:23.776595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-32ff2604-69ab-4283-990b-f272e19fabde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:23.776831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b859eb6-13a1-438d-883e-6aac36d304df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:23.797310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b859eb6-13a1-438d-883e-6aac36d304df service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:23.797749 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b859eb6-13a1-438d-883e-6aac36d304df service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:23.798642 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b859eb6-13a1-438d-883e-6aac36d304df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:23.809380 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4b859eb6-13a1-438d-883e-6aac36d304df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:23.817481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff2604-69ab-4283-990b-f272e19fabde admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:23.825523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ef905-e5de-4b77-8de4-96bc3d289c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:23.827066 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ef905-e5de-4b77-8de4-96bc3d289c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:23.827542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ef905-e5de-4b77-8de4-96bc3d289c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:23.828055 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ef905-e5de-4b77-8de4-96bc3d289c83 admin admin] PATH_INFO: `/v3/users/0ab06a13e7d44ef7a0c4b5c0df2d1374` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:23.838173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ef905-e5de-4b77-8de4-96bc3d289c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab06a13e7d44ef7a0c4b5c0df2d1374)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:23.841836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ef905-e5de-4b77-8de4-96bc3d289c83 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:23.845597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b859eb6-13a1-438d-883e-6aac36d304df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:23.849889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b859eb6-13a1-438d-883e-6aac36d304df service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:23.879133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 935/1897] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:23.885529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b859eb6-13a1-438d-883e-6aac36d304df service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:23.893937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b859eb6-13a1-438d-883e-6aac36d304df service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:23.899551 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed368e95-c5bb-4672-a09a-f6a96b679ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:23.900301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed368e95-c5bb-4672-a09a-f6a96b679ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:23.900612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed368e95-c5bb-4672-a09a-f6a96b679ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:23.900946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed368e95-c5bb-4672-a09a-f6a96b679ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:23.901614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed368e95-c5bb-4672-a09a-f6a96b679ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:23.902415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:23.903379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed368e95-c5bb-4672-a09a-f6a96b679ae9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:23.905205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:23.929213 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 936/1898] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:23.932480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed368e95-c5bb-4672-a09a-f6a96b679ae9 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:23.945107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed368e95-c5bb-4672-a09a-f6a96b679ae9 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:23.951473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695889be-e446-4e35-b020-8a62e1c862aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:23.952180 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695889be-e446-4e35-b020-8a62e1c862aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:23.953073 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695889be-e446-4e35-b020-8a62e1c862aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:23.953073 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695889be-e446-4e35-b020-8a62e1c862aa admin admin] PATH_INFO: `/v3/projects/ccafb93195574f9bb4ca31c45c870189/users/71ad4b0b35cd461d9f981c225edfe60c/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:23.959337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-449ef905-e5de-4b77-8de4-96bc3d289c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab06a13e7d44ef7a0c4b5c0df2d1374'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:23.960977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-449ef905-e5de-4b77-8de4-96bc3d289c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab06a13e7d44ef7a0c4b5c0df2d1374'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:23.976249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695889be-e446-4e35-b020-8a62e1c862aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccafb93195574f9bb4ca31c45c870189, user_id=71ad4b0b35cd461d9f981c225edfe60c, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:23.979244 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695889be-e446-4e35-b020-8a62e1c862aa admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:23.996384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-449ef905-e5de-4b77-8de4-96bc3d289c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab06a13e7d44ef7a0c4b5c0df2d1374'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:24.012724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-449ef905-e5de-4b77-8de4-96bc3d289c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab06a13e7d44ef7a0c4b5c0df2d1374'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:24.014420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-449ef905-e5de-4b77-8de4-96bc3d289c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab06a13e7d44ef7a0c4b5c0df2d1374'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:24.016510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 937/1899] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:23 2022] PUT /identity/v3/projects/ccafb93195574f9bb4ca31c45c870189/users/71ad4b0b35cd461d9f981c225edfe60c/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:24.018515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253843f-1a2a-4f7e-94b8-e7d9aa4f51b4 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:24.018808 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253843f-1a2a-4f7e-94b8-e7d9aa4f51b4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:24.019106 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253843f-1a2a-4f7e-94b8-e7d9aa4f51b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:24.057735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 963/1900] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:23 2022] DELETE /identity/v3/users/0ab06a13e7d44ef7a0c4b5c0df2d1374 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:24.058519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8253843f-1a2a-4f7e-94b8-e7d9aa4f51b4 None None] MFA Rules not processed for user `71ad4b0b35cd461d9f981c225edfe60c`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:24.060501 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8253843f-1a2a-4f7e-94b8-e7d9aa4f51b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:24.227260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 938/1901] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:24.230192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ef905-e5de-4b77-8de4-96bc3d289c83 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:24.236816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-449ef905-e5de-4b77-8de4-96bc3d289c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:24.343148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ef905-e5de-4b77-8de4-96bc3d289c83 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:24.350783 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a034897-c952-497c-ac1b-f1f946161c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:24.352163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a034897-c952-497c-ac1b-f1f946161c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:24.352163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a034897-c952-497c-ac1b-f1f946161c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:24.352522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a034897-c952-497c-ac1b-f1f946161c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:24.354296 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a034897-c952-497c-ac1b-f1f946161c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:24.356914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a034897-c952-497c-ac1b-f1f946161c0d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:24.402735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 964/1902] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:24 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:24.404546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253843f-1a2a-4f7e-94b8-e7d9aa4f51b4 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:24.422402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253843f-1a2a-4f7e-94b8-e7d9aa4f51b4 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:24.605475 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17b2a0-af6c-452e-a352-d0a3e79a23f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:24.606146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17b2a0-af6c-452e-a352-d0a3e79a23f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:24.606560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17b2a0-af6c-452e-a352-d0a3e79a23f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:24.606731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17b2a0-af6c-452e-a352-d0a3e79a23f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:24.607368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17b2a0-af6c-452e-a352-d0a3e79a23f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:24.609475 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17b2a0-af6c-452e-a352-d0a3e79a23f2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:24.660473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 939/1903] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:24 2022] POST /identity/v3/users => generated 296 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:24.661350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a034897-c952-497c-ac1b-f1f946161c0d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:24.680521 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a034897-c952-497c-ac1b-f1f946161c0d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:24.700870 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defec528-3126-46f8-87c5-b4c6434cd23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:24.701538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec528-3126-46f8-87c5-b4c6434cd23c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:24.701824 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec528-3126-46f8-87c5-b4c6434cd23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:24.702098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec528-3126-46f8-87c5-b4c6434cd23c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:24.702931 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defec528-3126-46f8-87c5-b4c6434cd23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:24.704567 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defec528-3126-46f8-87c5-b4c6434cd23c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:24.720455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 965/1904] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:24.728606 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17b2a0-af6c-452e-a352-d0a3e79a23f2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:24.775237 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17b2a0-af6c-452e-a352-d0a3e79a23f2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:24.794540 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a90ca-b57c-40e3-9643-25b278a1a265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:24.796544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a90ca-b57c-40e3-9643-25b278a1a265 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:24.797271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a90ca-b57c-40e3-9643-25b278a1a265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:24.797890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a90ca-b57c-40e3-9643-25b278a1a265 admin admin] PATH_INFO: `/v3/projects/fd0c2f69ebb94986a8877183d12a5100/users/80d98b82cdcc49ba87321b0c1d4efbbd/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:24.852444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a90ca-b57c-40e3-9643-25b278a1a265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0c2f69ebb94986a8877183d12a5100, user_id=80d98b82cdcc49ba87321b0c1d4efbbd, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:24.858189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a90ca-b57c-40e3-9643-25b278a1a265 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:24.880757 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 940/1905] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:24 2022] PUT /identity/v3/projects/fd0c2f69ebb94986a8877183d12a5100/users/80d98b82cdcc49ba87321b0c1d4efbbd/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:24.887616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defec528-3126-46f8-87c5-b4c6434cd23c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:24.907014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defec528-3126-46f8-87c5-b4c6434cd23c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:25.080589 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe6718-ab31-422f-9b36-ac7164bfd29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:25.081275 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe6718-ab31-422f-9b36-ac7164bfd29b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:25.081557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe6718-ab31-422f-9b36-ac7164bfd29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:25.082784 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe6718-ab31-422f-9b36-ac7164bfd29b admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:25.082784 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe6718-ab31-422f-9b36-ac7164bfd29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:25.084413 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe6718-ab31-422f-9b36-ac7164bfd29b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:25.091204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a90ca-b57c-40e3-9643-25b278a1a265 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:25.094574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d34a90ca-b57c-40e3-9643-25b278a1a265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:25.101598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 966/1906] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:25.103590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe6718-ab31-422f-9b36-ac7164bfd29b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:25.128087 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe6718-ab31-422f-9b36-ac7164bfd29b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:25.138444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a90ca-b57c-40e3-9643-25b278a1a265 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:25.143735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b00be4-467f-4342-8467-1329795c498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:25.144513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b00be4-467f-4342-8467-1329795c498a admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:25.145860 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b00be4-467f-4342-8467-1329795c498a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:25.146320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b00be4-467f-4342-8467-1329795c498a admin admin] PATH_INFO: `/v3/projects/fd0c2f69ebb94986a8877183d12a5100/users/80d98b82cdcc49ba87321b0c1d4efbbd/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:25.149367 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:25.150097 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:25.150426 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:25.150710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] PATH_INFO: `/v3/projects/9d534e16414f4d07a900af6bc02e3188` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:25.151968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d534e16414f4d07a900af6bc02e3188)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:25.152890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b00be4-467f-4342-8467-1329795c498a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0c2f69ebb94986a8877183d12a5100, user_id=80d98b82cdcc49ba87321b0c1d4efbbd, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:25.154652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:25.155876 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b00be4-467f-4342-8467-1329795c498a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:25.171821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:25.182291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 967/1907] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:25 2022] PUT /identity/v3/projects/fd0c2f69ebb94986a8877183d12a5100/users/80d98b82cdcc49ba87321b0c1d4efbbd/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:25.206199 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ea2d4-6e3d-4e7d-bfa7-3243585840e6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:25.207236 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ea2d4-6e3d-4e7d-bfa7-3243585840e6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:25.207944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ea2d4-6e3d-4e7d-bfa7-3243585840e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:25.223182 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:25.269377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d534e16414f4d07a900af6bc02e3188', 'request_id': 'req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.279204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d534e16414f4d07a900af6bc02e3188', 'request_id': 'req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.287863 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d534e16414f4d07a900af6bc02e3188', 'request_id': 'req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.290367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-078ea2d4-6e3d-4e7d-bfa7-3243585840e6 None None] MFA Rules not processed for user `80d98b82cdcc49ba87321b0c1d4efbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:25.296618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-078ea2d4-6e3d-4e7d-bfa7-3243585840e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:25.310995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] The token cache is being invalidate because project 9d534e16414f4d07a900af6bc02e3188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:25.311890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.313013 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.315818 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 941/1908] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:25 2022] DELETE /identity/v3/projects/9d534e16414f4d07a900af6bc02e3188 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:25.317637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:25.320232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:25.434267 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdcdda-d2ed-4a93-b7cc-1ebad225c39f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:25.438917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 968/1909] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:25.440081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a146452-cc80-4642-b38c-b6c1ed7d42cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:25.440858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a146452-cc80-4642-b38c-b6c1ed7d42cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:25.441686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a146452-cc80-4642-b38c-b6c1ed7d42cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:25.441686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a146452-cc80-4642-b38c-b6c1ed7d42cc admin admin] PATH_INFO: `/v3/projects/2c17a2812b2043c38441935250c73c41` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:25.442877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a146452-cc80-4642-b38c-b6c1ed7d42cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c17a2812b2043c38441935250c73c41)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:25.444224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc223dd-9921-4a18-903a-e04d65bb82a8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:25.445322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc223dd-9921-4a18-903a-e04d65bb82a8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:25.445645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a146452-cc80-4642-b38c-b6c1ed7d42cc admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:25.446945 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc223dd-9921-4a18-903a-e04d65bb82a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:25.479218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fcc223dd-9921-4a18-903a-e04d65bb82a8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:25.480485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fcc223dd-9921-4a18-903a-e04d65bb82a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:25.490631 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 969/1910] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:25.491502 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc223dd-9921-4a18-903a-e04d65bb82a8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:25.492998 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fcc223dd-9921-4a18-903a-e04d65bb82a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:25.525503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a146452-cc80-4642-b38c-b6c1ed7d42cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c17a2812b2043c38441935250c73c41', 'request_id': 'req-7a146452-cc80-4642-b38c-b6c1ed7d42cc'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.534871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a146452-cc80-4642-b38c-b6c1ed7d42cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c17a2812b2043c38441935250c73c41', 'request_id': 'req-7a146452-cc80-4642-b38c-b6c1ed7d42cc'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.543629 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a146452-cc80-4642-b38c-b6c1ed7d42cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c17a2812b2043c38441935250c73c41', 'request_id': 'req-7a146452-cc80-4642-b38c-b6c1ed7d42cc'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.564519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a146452-cc80-4642-b38c-b6c1ed7d42cc admin admin] The token cache is being invalidate because project 2c17a2812b2043c38441935250c73c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:25.565116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a146452-cc80-4642-b38c-b6c1ed7d42cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.566981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a146452-cc80-4642-b38c-b6c1ed7d42cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.570164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 942/1911] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:25 2022] DELETE /identity/v3/projects/2c17a2812b2043c38441935250c73c41 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:25.571509 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74c0fc-328e-4c88-b7f9-4dfdd23ca3a5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:25.572368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74c0fc-328e-4c88-b7f9-4dfdd23ca3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:25.572639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74c0fc-328e-4c88-b7f9-4dfdd23ca3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:25.586619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc223dd-9921-4a18-903a-e04d65bb82a8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:25.601920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7a74c0fc-328e-4c88-b7f9-4dfdd23ca3a5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:25.604194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7a74c0fc-328e-4c88-b7f9-4dfdd23ca3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:25.664410 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80429e06-98b9-4781-b223-aea888ad6a90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:25.666082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429e06-98b9-4781-b223-aea888ad6a90 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:25.666896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429e06-98b9-4781-b223-aea888ad6a90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:25.667430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429e06-98b9-4781-b223-aea888ad6a90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:25.672010 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-80429e06-98b9-4781-b223-aea888ad6a90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:25.685716 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:25.724838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 943/1912] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:25.725887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74c0fc-328e-4c88-b7f9-4dfdd23ca3a5 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:25.729726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7a74c0fc-328e-4c88-b7f9-4dfdd23ca3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:25.741032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:25.754158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74c0fc-328e-4c88-b7f9-4dfdd23ca3a5 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:25.763572 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec0e1b-dc6d-46dc-8b2f-9003520b22fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:25.764655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec0e1b-dc6d-46dc-8b2f-9003520b22fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:25.765200 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec0e1b-dc6d-46dc-8b2f-9003520b22fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:25.765811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec0e1b-dc6d-46dc-8b2f-9003520b22fb admin admin] PATH_INFO: `/v3/users/c3014ba083204e09940ecbebeb450d53` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:25.765958 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80429e06-98b9-4781-b223-aea888ad6a90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:25.767529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80429e06-98b9-4781-b223-aea888ad6a90 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:25.768023 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec0e1b-dc6d-46dc-8b2f-9003520b22fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3014ba083204e09940ecbebeb450d53)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:25.771738 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec0e1b-dc6d-46dc-8b2f-9003520b22fb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:25.779953 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 970/1913] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:25.782207 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80429e06-98b9-4781-b223-aea888ad6a90 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:25.795489 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80429e06-98b9-4781-b223-aea888ad6a90 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:25.800793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93970c-766a-421c-9066-d93d5eeb81b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:25.801494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93970c-766a-421c-9066-d93d5eeb81b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:25.801804 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93970c-766a-421c-9066-d93d5eeb81b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:25.802036 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93970c-766a-421c-9066-d93d5eeb81b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:25.802728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93970c-766a-421c-9066-d93d5eeb81b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:25.803054 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93970c-766a-421c-9066-d93d5eeb81b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:25.804976 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93970c-766a-421c-9066-d93d5eeb81b5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:25.819619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 971/1914] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:24:25.826248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93970c-766a-421c-9066-d93d5eeb81b5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:25.840172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93970c-766a-421c-9066-d93d5eeb81b5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:25.849578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396e242-3dfa-4fd4-9287-2879fb22d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:25.850957 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396e242-3dfa-4fd4-9287-2879fb22d3cb admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:25.852467 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396e242-3dfa-4fd4-9287-2879fb22d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:25.853506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396e242-3dfa-4fd4-9287-2879fb22d3cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:25.854770 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396e242-3dfa-4fd4-9287-2879fb22d3cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:25.855614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-78ec0e1b-dc6d-46dc-8b2f-9003520b22fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3014ba083204e09940ecbebeb450d53'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.856490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-78ec0e1b-dc6d-46dc-8b2f-9003520b22fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3014ba083204e09940ecbebeb450d53'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.857331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-78ec0e1b-dc6d-46dc-8b2f-9003520b22fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3014ba083204e09940ecbebeb450d53'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.858600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396e242-3dfa-4fd4-9287-2879fb22d3cb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:25.865961 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-78ec0e1b-dc6d-46dc-8b2f-9003520b22fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3014ba083204e09940ecbebeb450d53'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.884806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-78ec0e1b-dc6d-46dc-8b2f-9003520b22fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3014ba083204e09940ecbebeb450d53'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:25.904022 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 944/1915] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:25 2022] DELETE /identity/v3/users/c3014ba083204e09940ecbebeb450d53 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:25.905133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec0e1b-dc6d-46dc-8b2f-9003520b22fb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:25.906667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-78ec0e1b-dc6d-46dc-8b2f-9003520b22fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:25.919366 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 972/1916] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:25 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:25.926305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396e242-3dfa-4fd4-9287-2879fb22d3cb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:25.930660 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f396e242-3dfa-4fd4-9287-2879fb22d3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:26.049354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec0e1b-dc6d-46dc-8b2f-9003520b22fb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:26.141029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6dd1d-86fa-4c05-8058-478868eb655a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:26.141805 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6dd1d-86fa-4c05-8058-478868eb655a service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:26.142186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6dd1d-86fa-4c05-8058-478868eb655a service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:26.142552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6dd1d-86fa-4c05-8058-478868eb655a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:26.145355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2aa6dd1d-86fa-4c05-8058-478868eb655a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:26.162653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396e242-3dfa-4fd4-9287-2879fb22d3cb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:26.180326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fc366-42a9-4e72-999e-941af03f4a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:26.182588 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fc366-42a9-4e72-999e-941af03f4a42 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:26.183814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fc366-42a9-4e72-999e-941af03f4a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:26.184301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fc366-42a9-4e72-999e-941af03f4a42 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:26.188401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fc366-42a9-4e72-999e-941af03f4a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:26.193403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fc366-42a9-4e72-999e-941af03f4a42 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:26.226948 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:26.289481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 973/1917] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:25 2022] POST /identity/v3/users => generated 283 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:26.290744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fc366-42a9-4e72-999e-941af03f4a42 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:26.341938 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fc366-42a9-4e72-999e-941af03f4a42 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:26.348528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c16311-7cd7-4794-99ac-5e5c0d71efff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:26.363310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16311-7cd7-4794-99ac-5e5c0d71efff admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:26.363740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16311-7cd7-4794-99ac-5e5c0d71efff admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:26.364140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16311-7cd7-4794-99ac-5e5c0d71efff admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:26.369119 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c16311-7cd7-4794-99ac-5e5c0d71efff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:26.374788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c16311-7cd7-4794-99ac-5e5c0d71efff admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:26.398598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 974/1918] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:26.399694 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c16311-7cd7-4794-99ac-5e5c0d71efff admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:26.430275 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c16311-7cd7-4794-99ac-5e5c0d71efff admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:26.439933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192543a-a332-41bc-8d25-9885ffff0d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:26.441533 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192543a-a332-41bc-8d25-9885ffff0d82 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:26.442648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192543a-a332-41bc-8d25-9885ffff0d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:26.443417 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192543a-a332-41bc-8d25-9885ffff0d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:26.464377 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192543a-a332-41bc-8d25-9885ffff0d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:26.469206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192543a-a332-41bc-8d25-9885ffff0d82 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:26.473699 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6dd1d-86fa-4c05-8058-478868eb655a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:26.477097 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6dd1d-86fa-4c05-8058-478868eb655a service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:26.486704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 975/1919] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:26.491319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192543a-a332-41bc-8d25-9885ffff0d82 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:26.506021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192543a-a332-41bc-8d25-9885ffff0d82 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:26.511843 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976c4e2-350a-434d-a46f-7f1b5493faa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:26.513213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976c4e2-350a-434d-a46f-7f1b5493faa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:26.513411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976c4e2-350a-434d-a46f-7f1b5493faa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:26.514768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976c4e2-350a-434d-a46f-7f1b5493faa2 admin admin] PATH_INFO: `/v3/projects/87c6fad1abc540beb1704336ffcbedc5/users/df136c9622524634b57282c8eb0277a3/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:26.533082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976c4e2-350a-434d-a46f-7f1b5493faa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c6fad1abc540beb1704336ffcbedc5, user_id=df136c9622524634b57282c8eb0277a3, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:26.536453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976c4e2-350a-434d-a46f-7f1b5493faa2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:26.562805 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 976/1920] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:26 2022] PUT /identity/v3/projects/87c6fad1abc540beb1704336ffcbedc5/users/df136c9622524634b57282c8eb0277a3/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:26.575676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76be34-df52-4e47-b1c9-7a441fe03001 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:26.576081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76be34-df52-4e47-b1c9-7a441fe03001 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:26.576630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76be34-df52-4e47-b1c9-7a441fe03001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:26.589392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 945/1921] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:26.615260 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fa76be34-df52-4e47-b1c9-7a441fe03001 None None] MFA Rules not processed for user `df136c9622524634b57282c8eb0277a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:26.617109 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fa76be34-df52-4e47-b1c9-7a441fe03001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:26.696559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:26.770051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 977/1922] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:26.776070 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6dd1d-86fa-4c05-8058-478868eb655a service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:26.830333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6dd1d-86fa-4c05-8058-478868eb655a service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:26.868680 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76be34-df52-4e47-b1c9-7a441fe03001 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:26.871410 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fa76be34-df52-4e47-b1c9-7a441fe03001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:27.018226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29451a0-702e-4568-a653-120026d3c2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:27.019324 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29451a0-702e-4568-a653-120026d3c2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:27.019832 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29451a0-702e-4568-a653-120026d3c2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:27.020337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29451a0-702e-4568-a653-120026d3c2a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:27.021639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29451a0-702e-4568-a653-120026d3c2a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:27.025866 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29451a0-702e-4568-a653-120026d3c2a1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:27.059124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76be34-df52-4e47-b1c9-7a441fe03001 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:27.066647 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:27.067473 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:27.067908 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:27.068200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] PATH_INFO: `/v3/projects/57bbb7eb8f2a401fac454010f1040239` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:27.069881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57bbb7eb8f2a401fac454010f1040239)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:27.073775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:27.091712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 946/1923] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:26 2022] POST /identity/v3/projects => generated 369 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:27.098145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29451a0-702e-4568-a653-120026d3c2a1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:27.185375 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57bbb7eb8f2a401fac454010f1040239', 'request_id': 'req-f8623942-23ac-4cf9-806c-2e63daf11c76'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:27.195868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57bbb7eb8f2a401fac454010f1040239', 'request_id': 'req-f8623942-23ac-4cf9-806c-2e63daf11c76'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:27.208954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57bbb7eb8f2a401fac454010f1040239', 'request_id': 'req-f8623942-23ac-4cf9-806c-2e63daf11c76'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:27.230062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] The token cache is being invalidate because project 57bbb7eb8f2a401fac454010f1040239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:27.231149 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:27.232442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:27.235227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 978/1924] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:26 2022] DELETE /identity/v3/projects/57bbb7eb8f2a401fac454010f1040239 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:24:27.242197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:27.246150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29451a0-702e-4568-a653-120026d3c2a1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:27.246997 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:27.385691 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:27.397073 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277749-0a5d-44cb-ae59-8b75ed394afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:27.398117 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277749-0a5d-44cb-ae59-8b75ed394afa admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:27.398566 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277749-0a5d-44cb-ae59-8b75ed394afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:27.398974 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277749-0a5d-44cb-ae59-8b75ed394afa admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:27.400116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41277749-0a5d-44cb-ae59-8b75ed394afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:27.403041 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41277749-0a5d-44cb-ae59-8b75ed394afa admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:27.440624 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 947/1925] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:27 2022] POST /identity/v3/users => generated 291 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:27.441943 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277749-0a5d-44cb-ae59-8b75ed394afa admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:27.450590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-41277749-0a5d-44cb-ae59-8b75ed394afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:27.470952 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277749-0a5d-44cb-ae59-8b75ed394afa admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:27.476171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bac2d-34f2-4126-81de-d3d2127bffbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:27.476843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bac2d-34f2-4126-81de-d3d2127bffbb admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:27.477120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bac2d-34f2-4126-81de-d3d2127bffbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:27.477567 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bac2d-34f2-4126-81de-d3d2127bffbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:27.478911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bac2d-34f2-4126-81de-d3d2127bffbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:27.481108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bac2d-34f2-4126-81de-d3d2127bffbb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:27.492221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8623942-23ac-4cf9-806c-2e63daf11c76 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:27.498654 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71cb49-6fb3-4a31-8c91-010f5cd64964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:27.499323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71cb49-6fb3-4a31-8c91-010f5cd64964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:27.499601 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71cb49-6fb3-4a31-8c91-010f5cd64964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:27.499894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71cb49-6fb3-4a31-8c91-010f5cd64964 admin admin] PATH_INFO: `/v3/users/83006148026c40e688f6e5822c41d908` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:27.501348 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71cb49-6fb3-4a31-8c91-010f5cd64964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83006148026c40e688f6e5822c41d908)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:27.503355 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71cb49-6fb3-4a31-8c91-010f5cd64964 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:27.506711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 948/1926] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:27.515054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bac2d-34f2-4126-81de-d3d2127bffbb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:27.528497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:27.536094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bac2d-34f2-4126-81de-d3d2127bffbb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:27.548734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2353a-8574-4d7d-900c-18aac8840f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:27.550396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2353a-8574-4d7d-900c-18aac8840f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:27.551106 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2353a-8574-4d7d-900c-18aac8840f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:27.551760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2353a-8574-4d7d-900c-18aac8840f3a admin admin] PATH_INFO: `/v3/projects/d2681520281146eaaa09c80132417ba8/users/97eade6e8ad74380a70310a47ab5cba1/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:27.589125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2353a-8574-4d7d-900c-18aac8840f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2681520281146eaaa09c80132417ba8, user_id=97eade6e8ad74380a70310a47ab5cba1, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:27.592714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2353a-8574-4d7d-900c-18aac8840f3a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:27.600320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca71cb49-6fb3-4a31-8c91-010f5cd64964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83006148026c40e688f6e5822c41d908'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:27.602636 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca71cb49-6fb3-4a31-8c91-010f5cd64964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83006148026c40e688f6e5822c41d908'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:27.623562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 949/1927] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:27 2022] PUT /identity/v3/projects/d2681520281146eaaa09c80132417ba8/users/97eade6e8ad74380a70310a47ab5cba1/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:27.630364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2353a-8574-4d7d-900c-18aac8840f3a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:27.630890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca71cb49-6fb3-4a31-8c91-010f5cd64964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83006148026c40e688f6e5822c41d908'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:27.632992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d6e2353a-8574-4d7d-900c-18aac8840f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:27.643087 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca71cb49-6fb3-4a31-8c91-010f5cd64964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83006148026c40e688f6e5822c41d908'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:27.643937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca71cb49-6fb3-4a31-8c91-010f5cd64964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83006148026c40e688f6e5822c41d908'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:27.675627 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 979/1928] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:27 2022] DELETE /identity/v3/users/83006148026c40e688f6e5822c41d908 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:27.734931 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2353a-8574-4d7d-900c-18aac8840f3a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:27.856783 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a2299-edfa-497a-aa40-330f910107dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:27.858047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a2299-edfa-497a-aa40-330f910107dc admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:27.858545 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a2299-edfa-497a-aa40-330f910107dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:27.859041 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a2299-edfa-497a-aa40-330f910107dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:27.860292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a2299-edfa-497a-aa40-330f910107dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:27.863543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a2299-edfa-497a-aa40-330f910107dc admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:27.883368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 950/1929] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:24:27.884165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71cb49-6fb3-4a31-8c91-010f5cd64964 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:27.914126 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71cb49-6fb3-4a31-8c91-010f5cd64964 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:27.924947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733d904-933b-4954-836b-00c5237586b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:27.926289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733d904-933b-4954-836b-00c5237586b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:27.926928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733d904-933b-4954-836b-00c5237586b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:27.927521 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733d904-933b-4954-836b-00c5237586b5 admin admin] PATH_INFO: `/v3/projects/d2681520281146eaaa09c80132417ba8/users/97eade6e8ad74380a70310a47ab5cba1/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:27.933805 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733d904-933b-4954-836b-00c5237586b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2681520281146eaaa09c80132417ba8, user_id=97eade6e8ad74380a70310a47ab5cba1, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:27.940004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733d904-933b-4954-836b-00c5237586b5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:27.976096 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 980/1930] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:27 2022] PUT /identity/v3/projects/d2681520281146eaaa09c80132417ba8/users/97eade6e8ad74380a70310a47ab5cba1/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:24:27.980255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef06a6-d1c3-4495-be48-98c93eb2eb27 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:27.980849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef06a6-d1c3-4495-be48-98c93eb2eb27 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:27.981277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef06a6-d1c3-4495-be48-98c93eb2eb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:28.053220 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a8ef06a6-d1c3-4495-be48-98c93eb2eb27 None None] MFA Rules not processed for user `97eade6e8ad74380a70310a47ab5cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:28.055423 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a8ef06a6-d1c3-4495-be48-98c93eb2eb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:28.173278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:28.235739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 951/1931] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:28.237858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733d904-933b-4954-836b-00c5237586b5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:28.240309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a733d904-933b-4954-836b-00c5237586b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:28.315104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef06a6-d1c3-4495-be48-98c93eb2eb27 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:28.316947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a8ef06a6-d1c3-4495-be48-98c93eb2eb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:28.334741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733d904-933b-4954-836b-00c5237586b5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:28.340816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112409b-9536-48ed-b722-f12a3397a5af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:28.341451 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112409b-9536-48ed-b722-f12a3397a5af service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:28.341791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112409b-9536-48ed-b722-f12a3397a5af service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:28.342062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112409b-9536-48ed-b722-f12a3397a5af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:28.367439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112409b-9536-48ed-b722-f12a3397a5af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:28.369525 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112409b-9536-48ed-b722-f12a3397a5af service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:28.382202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 981/1932] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:28.437335 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef06a6-d1c3-4495-be48-98c93eb2eb27 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:28.441029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec66976-315d-45c0-a1ff-6a64a7860713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:28.441920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec66976-315d-45c0-a1ff-6a64a7860713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:28.442293 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec66976-315d-45c0-a1ff-6a64a7860713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:28.442625 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec66976-315d-45c0-a1ff-6a64a7860713 admin admin] PATH_INFO: `/v3/projects/4504ff813aff4d88b13fb9f7c7018bb6` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:28.444016 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec66976-315d-45c0-a1ff-6a64a7860713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4504ff813aff4d88b13fb9f7c7018bb6)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:28.445196 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112409b-9536-48ed-b722-f12a3397a5af service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:28.446786 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1112409b-9536-48ed-b722-f12a3397a5af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:28.447982 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec66976-315d-45c0-a1ff-6a64a7860713 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:28.466631 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112409b-9536-48ed-b722-f12a3397a5af service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:28.472090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2d108-cf21-4339-9de8-c79095523fea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:28.472760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d108-cf21-4339-9de8-c79095523fea service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:28.473039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d108-cf21-4339-9de8-c79095523fea service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:28.473301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d108-cf21-4339-9de8-c79095523fea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:28.475148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fcf2d108-cf21-4339-9de8-c79095523fea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:28.550594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2d108-cf21-4339-9de8-c79095523fea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:28.552160 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4ec66976-315d-45c0-a1ff-6a64a7860713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4504ff813aff4d88b13fb9f7c7018bb6', 'request_id': 'req-4ec66976-315d-45c0-a1ff-6a64a7860713'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:28.552743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2d108-cf21-4339-9de8-c79095523fea service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:28.566589 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 982/1933] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:24:28.576906 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4ec66976-315d-45c0-a1ff-6a64a7860713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4504ff813aff4d88b13fb9f7c7018bb6', 'request_id': 'req-4ec66976-315d-45c0-a1ff-6a64a7860713'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:28.590539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4ec66976-315d-45c0-a1ff-6a64a7860713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4504ff813aff4d88b13fb9f7c7018bb6', 'request_id': 'req-4ec66976-315d-45c0-a1ff-6a64a7860713'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:28.616619 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4ec66976-315d-45c0-a1ff-6a64a7860713 admin admin] The token cache is being invalidate because project 4504ff813aff4d88b13fb9f7c7018bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:28.617176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4ec66976-315d-45c0-a1ff-6a64a7860713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:28.618661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4ec66976-315d-45c0-a1ff-6a64a7860713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:28.622280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 952/1934] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:28 2022] DELETE /identity/v3/projects/4504ff813aff4d88b13fb9f7c7018bb6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:24:28.629811 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a458d-fd34-45e3-ba31-0e47bcde17c2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:28.630084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a458d-fd34-45e3-ba31-0e47bcde17c2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:28.630364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a458d-fd34-45e3-ba31-0e47bcde17c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:28.678706 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-669a458d-fd34-45e3-ba31-0e47bcde17c2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:28.681918 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-669a458d-fd34-45e3-ba31-0e47bcde17c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:28.710784 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:28.836332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 983/1935] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:28.852846 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbf18c-bd72-45f9-98e4-32d97b4a0b82 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:28.853340 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbf18c-bd72-45f9-98e4-32d97b4a0b82 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:28.853839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbf18c-bd72-45f9-98e4-32d97b4a0b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:28.897519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-24cbf18c-bd72-45f9-98e4-32d97b4a0b82 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:28.901748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-24cbf18c-bd72-45f9-98e4-32d97b4a0b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:28.915901 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 953/1936] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:28.923107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a458d-fd34-45e3-ba31-0e47bcde17c2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:28.945583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a458d-fd34-45e3-ba31-0e47bcde17c2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:28.954960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a9396-94fb-43f3-845c-e8964206ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:28.956062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a9396-94fb-43f3-845c-e8964206ad94 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:28.956557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a9396-94fb-43f3-845c-e8964206ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:28.957356 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a9396-94fb-43f3-845c-e8964206ad94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:28.958559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a9396-94fb-43f3-845c-e8964206ad94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:28.959442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a9396-94fb-43f3-845c-e8964206ad94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:28.962725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a9396-94fb-43f3-845c-e8964206ad94 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:29.002721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 984/1937] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:24:29.008083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbf18c-bd72-45f9-98e4-32d97b4a0b82 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:29.027194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbf18c-bd72-45f9-98e4-32d97b4a0b82 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:29.035526 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6738867-7dd5-40bc-83ab-d49d4aa823e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:29.036633 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6738867-7dd5-40bc-83ab-d49d4aa823e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:29.037440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6738867-7dd5-40bc-83ab-d49d4aa823e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:29.037910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6738867-7dd5-40bc-83ab-d49d4aa823e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:29.038897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6738867-7dd5-40bc-83ab-d49d4aa823e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:29.043422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6738867-7dd5-40bc-83ab-d49d4aa823e3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:29.105836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 954/1938] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:29 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:29.122137 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a9396-94fb-43f3-845c-e8964206ad94 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:29.153541 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a9396-94fb-43f3-845c-e8964206ad94 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:29.301772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22888bcd-a8f9-4d5b-bd84-f500d6c4963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:29.302573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22888bcd-a8f9-4d5b-bd84-f500d6c4963c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:29.302910 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22888bcd-a8f9-4d5b-bd84-f500d6c4963c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:29.303194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22888bcd-a8f9-4d5b-bd84-f500d6c4963c admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:29.303865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22888bcd-a8f9-4d5b-bd84-f500d6c4963c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:29.306105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22888bcd-a8f9-4d5b-bd84-f500d6c4963c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:29.348506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 985/1939] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:29 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:29.354800 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6738867-7dd5-40bc-83ab-d49d4aa823e3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:29.377093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6738867-7dd5-40bc-83ab-d49d4aa823e3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:29.397265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9d254-3d6f-4868-8c0d-96b5aced5e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:29.397265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9d254-3d6f-4868-8c0d-96b5aced5e83 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:29.397265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9d254-3d6f-4868-8c0d-96b5aced5e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:29.397265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9d254-3d6f-4868-8c0d-96b5aced5e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:29.398147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9d254-3d6f-4868-8c0d-96b5aced5e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:29.407557 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9d254-3d6f-4868-8c0d-96b5aced5e83 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:29.439997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 955/1940] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:29.444743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22888bcd-a8f9-4d5b-bd84-f500d6c4963c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:29.467731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22888bcd-a8f9-4d5b-bd84-f500d6c4963c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:29.487516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b909c2-8bad-4810-965f-2f6b51fbbb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:29.488149 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b909c2-8bad-4810-965f-2f6b51fbbb07 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:29.488430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b909c2-8bad-4810-965f-2f6b51fbbb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:29.489271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b909c2-8bad-4810-965f-2f6b51fbbb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:29.489473 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b909c2-8bad-4810-965f-2f6b51fbbb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:29.491102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b909c2-8bad-4810-965f-2f6b51fbbb07 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:29.517404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 986/1941] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:24:29.521661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9d254-3d6f-4868-8c0d-96b5aced5e83 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:29.542004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9d254-3d6f-4868-8c0d-96b5aced5e83 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:29.566383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7df5dd-91f7-4dea-bb28-02b582cb15ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:29.567112 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7df5dd-91f7-4dea-bb28-02b582cb15ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:29.567402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7df5dd-91f7-4dea-bb28-02b582cb15ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:29.567686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7df5dd-91f7-4dea-bb28-02b582cb15ff admin admin] PATH_INFO: `/v3/projects/53ec75b7b5254f4c8e917bce3b118cd4/users/6cca565e04a649b18800293e8b23a86b/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:29.617635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7df5dd-91f7-4dea-bb28-02b582cb15ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ec75b7b5254f4c8e917bce3b118cd4, user_id=6cca565e04a649b18800293e8b23a86b, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:29.623217 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7df5dd-91f7-4dea-bb28-02b582cb15ff admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:29.657719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 956/1942] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:29 2022] PUT /identity/v3/projects/53ec75b7b5254f4c8e917bce3b118cd4/users/6cca565e04a649b18800293e8b23a86b/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:29.677540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480556b-fd2b-40b9-a0c9-f33d7ea62a79 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:29.678134 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480556b-fd2b-40b9-a0c9-f33d7ea62a79 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:29.678401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480556b-fd2b-40b9-a0c9-f33d7ea62a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:29.738491 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9480556b-fd2b-40b9-a0c9-f33d7ea62a79 None None] MFA Rules not processed for user `6cca565e04a649b18800293e8b23a86b`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:29.744173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9480556b-fd2b-40b9-a0c9-f33d7ea62a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:29.845912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 987/1943] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:29.851032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7df5dd-91f7-4dea-bb28-02b582cb15ff admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:29.857923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:29.932327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7df5dd-91f7-4dea-bb28-02b582cb15ff admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:29.939503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b35b13-2de5-4c37-885b-ab995407c953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:29.940217 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b35b13-2de5-4c37-885b-ab995407c953 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:29.940585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b35b13-2de5-4c37-885b-ab995407c953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:29.941042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b35b13-2de5-4c37-885b-ab995407c953 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:29.941820 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b35b13-2de5-4c37-885b-ab995407c953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:29.945012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b35b13-2de5-4c37-885b-ab995407c953 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:29.978199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 957/1944] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:29 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:29.983311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480556b-fd2b-40b9-a0c9-f33d7ea62a79 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:30.000677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480556b-fd2b-40b9-a0c9-f33d7ea62a79 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:30.013586 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:30.089988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fb141-fcb5-4fe3-8556-70a1a4a679ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:30.090806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fb141-fcb5-4fe3-8556-70a1a4a679ee admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:30.091139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fb141-fcb5-4fe3-8556-70a1a4a679ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:30.091471 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fb141-fcb5-4fe3-8556-70a1a4a679ee admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:30.092428 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fb141-fcb5-4fe3-8556-70a1a4a679ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:30.094516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fb141-fcb5-4fe3-8556-70a1a4a679ee admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:30.123854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 988/1945] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:29 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:30.128117 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b35b13-2de5-4c37-885b-ab995407c953 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:30.140000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b35b13-2de5-4c37-885b-ab995407c953 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:30.154673 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18dc92-dcf9-417e-87ff-19b2dc97c8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:30.154897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18dc92-dcf9-417e-87ff-19b2dc97c8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:30.155565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18dc92-dcf9-417e-87ff-19b2dc97c8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:30.155825 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18dc92-dcf9-417e-87ff-19b2dc97c8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:30.157117 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18dc92-dcf9-417e-87ff-19b2dc97c8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:30.160775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18dc92-dcf9-417e-87ff-19b2dc97c8e3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:30.246408 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 958/1946] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:24:30.260098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fb141-fcb5-4fe3-8556-70a1a4a679ee admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:30.290648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fb141-fcb5-4fe3-8556-70a1a4a679ee admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:30.303282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a4fe2-ee75-4451-87ce-b0fa644a5fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:30.304110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a4fe2-ee75-4451-87ce-b0fa644a5fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:30.304408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a4fe2-ee75-4451-87ce-b0fa644a5fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:30.304718 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a4fe2-ee75-4451-87ce-b0fa644a5fb6 admin admin] PATH_INFO: `/v3/projects/17f9b747e67f4169ba5db94492c0055a/users/8e8482b34edf44d5b27aec5944048bf4/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:30.348087 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a4fe2-ee75-4451-87ce-b0fa644a5fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f9b747e67f4169ba5db94492c0055a, user_id=8e8482b34edf44d5b27aec5944048bf4, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:30.349349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a4fe2-ee75-4451-87ce-b0fa644a5fb6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:30.372372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 989/1947] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:30 2022] PUT /identity/v3/projects/17f9b747e67f4169ba5db94492c0055a/users/8e8482b34edf44d5b27aec5944048bf4/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:30.383907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18dc92-dcf9-417e-87ff-19b2dc97c8e3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:30.405056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18dc92-dcf9-417e-87ff-19b2dc97c8e3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:30.634691 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214dbfc-348d-4a9e-a6a2-2987e7abf564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:30.635464 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214dbfc-348d-4a9e-a6a2-2987e7abf564 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:30.635725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214dbfc-348d-4a9e-a6a2-2987e7abf564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:30.636091 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214dbfc-348d-4a9e-a6a2-2987e7abf564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:30.636857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214dbfc-348d-4a9e-a6a2-2987e7abf564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:30.638577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214dbfc-348d-4a9e-a6a2-2987e7abf564 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:30.667151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 959/1948] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:30.672724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a4fe2-ee75-4451-87ce-b0fa644a5fb6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:30.688440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a4fe2-ee75-4451-87ce-b0fa644a5fb6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:30.695623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa35fa-0d25-49e9-b6b0-10fd5195f396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:30.697017 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa35fa-0d25-49e9-b6b0-10fd5195f396 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:30.697413 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa35fa-0d25-49e9-b6b0-10fd5195f396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:30.697697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa35fa-0d25-49e9-b6b0-10fd5195f396 admin admin] PATH_INFO: `/v3/projects/17f9b747e67f4169ba5db94492c0055a/users/8e8482b34edf44d5b27aec5944048bf4/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:30.699785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa35fa-0d25-49e9-b6b0-10fd5195f396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f9b747e67f4169ba5db94492c0055a, user_id=8e8482b34edf44d5b27aec5944048bf4, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:30.700893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214dbfc-348d-4a9e-a6a2-2987e7abf564 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:30.703092 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7214dbfc-348d-4a9e-a6a2-2987e7abf564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:30.703221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa35fa-0d25-49e9-b6b0-10fd5195f396 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:30.717786 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214dbfc-348d-4a9e-a6a2-2987e7abf564 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:30.728927 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 990/1949] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:30 2022] PUT /identity/v3/projects/17f9b747e67f4169ba5db94492c0055a/users/8e8482b34edf44d5b27aec5944048bf4/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:30.738791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f061f4-690d-402a-8bab-11554e299e31 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:30.738791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f061f4-690d-402a-8bab-11554e299e31 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:30.738791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f061f4-690d-402a-8bab-11554e299e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:30.810147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd509d59-9feb-45a6-bc1b-dbd1e7d118be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:30.811204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd509d59-9feb-45a6-bc1b-dbd1e7d118be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:30.811489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd509d59-9feb-45a6-bc1b-dbd1e7d118be admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:30.811895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd509d59-9feb-45a6-bc1b-dbd1e7d118be admin admin] PATH_INFO: `/v3/users/da219c913d7146d8b2c32ddce1649044` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:30.813903 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-16f061f4-690d-402a-8bab-11554e299e31 None None] MFA Rules not processed for user `8e8482b34edf44d5b27aec5944048bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:30.814279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd509d59-9feb-45a6-bc1b-dbd1e7d118be admin admin] RBAC: Authorizing `identity:delete_user(user_id=da219c913d7146d8b2c32ddce1649044)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:30.816058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-16f061f4-690d-402a-8bab-11554e299e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:30.817207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd509d59-9feb-45a6-bc1b-dbd1e7d118be admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:30.852371 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:30.965095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dd509d59-9feb-45a6-bc1b-dbd1e7d118be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da219c913d7146d8b2c32ddce1649044'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:30.965924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dd509d59-9feb-45a6-bc1b-dbd1e7d118be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da219c913d7146d8b2c32ddce1649044'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:30.967949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dd509d59-9feb-45a6-bc1b-dbd1e7d118be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da219c913d7146d8b2c32ddce1649044'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:30.997671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dd509d59-9feb-45a6-bc1b-dbd1e7d118be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da219c913d7146d8b2c32ddce1649044'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:31.034730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 991/1950] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:31.076315 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dd509d59-9feb-45a6-bc1b-dbd1e7d118be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da219c913d7146d8b2c32ddce1649044'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:31.136964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 960/1951] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:30 2022] DELETE /identity/v3/users/da219c913d7146d8b2c32ddce1649044 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:31.142201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4a422-3b1a-4b63-a19b-aa5a4948e6ca None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:31.142503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4a422-3b1a-4b63-a19b-aa5a4948e6ca None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:31.143006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4a422-3b1a-4b63-a19b-aa5a4948e6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:31.163570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd509d59-9feb-45a6-bc1b-dbd1e7d118be admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:31.166221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-dd509d59-9feb-45a6-bc1b-dbd1e7d118be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:31.205971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-eed4a422-3b1a-4b63-a19b-aa5a4948e6ca None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:31.207562 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-eed4a422-3b1a-4b63-a19b-aa5a4948e6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:31.308582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd509d59-9feb-45a6-bc1b-dbd1e7d118be admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:31.313038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa42f3a-3150-4db7-8c96-4c8a9b023ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:31.313895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa42f3a-3150-4db7-8c96-4c8a9b023ecd service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:31.314821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa42f3a-3150-4db7-8c96-4c8a9b023ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:31.315354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa42f3a-3150-4db7-8c96-4c8a9b023ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:31.364639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:31.398483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 992/1952] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:31.422333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4a422-3b1a-4b63-a19b-aa5a4948e6ca None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:31.425297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-eed4a422-3b1a-4b63-a19b-aa5a4948e6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:31.460557 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa42f3a-3150-4db7-8c96-4c8a9b023ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:31.462118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa42f3a-3150-4db7-8c96-4c8a9b023ecd service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:31.474579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 961/1953] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:31.541873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4a422-3b1a-4b63-a19b-aa5a4948e6ca None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:31.548329 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd00b7-7ce2-4c9b-8318-3c28c75b2839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:31.552245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd00b7-7ce2-4c9b-8318-3c28c75b2839 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:31.552760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd00b7-7ce2-4c9b-8318-3c28c75b2839 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:31.553247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd00b7-7ce2-4c9b-8318-3c28c75b2839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:31.573073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd00b7-7ce2-4c9b-8318-3c28c75b2839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:31.576008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd00b7-7ce2-4c9b-8318-3c28c75b2839 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:31.599630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 993/1954] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:31.908238 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa42f3a-3150-4db7-8c96-4c8a9b023ecd service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:31.916401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-faa42f3a-3150-4db7-8c96-4c8a9b023ecd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:31.939739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa42f3a-3150-4db7-8c96-4c8a9b023ecd service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:31.946560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bb9b6-f20f-4c5c-ab8d-93c91942b423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:31.947243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bb9b6-f20f-4c5c-ab8d-93c91942b423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:31.947517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bb9b6-f20f-4c5c-ab8d-93c91942b423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:31.947859 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bb9b6-f20f-4c5c-ab8d-93c91942b423 admin admin] PATH_INFO: `/v3/users/6cca565e04a649b18800293e8b23a86b` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:31.949384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bb9b6-f20f-4c5c-ab8d-93c91942b423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cca565e04a649b18800293e8b23a86b)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:31.951506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bb9b6-f20f-4c5c-ab8d-93c91942b423 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:32.019469 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:32.027895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d61bb9b6-f20f-4c5c-ab8d-93c91942b423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cca565e04a649b18800293e8b23a86b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:32.028718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d61bb9b6-f20f-4c5c-ab8d-93c91942b423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cca565e04a649b18800293e8b23a86b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:32.029679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d61bb9b6-f20f-4c5c-ab8d-93c91942b423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cca565e04a649b18800293e8b23a86b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:32.041043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d61bb9b6-f20f-4c5c-ab8d-93c91942b423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cca565e04a649b18800293e8b23a86b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:32.059799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d61bb9b6-f20f-4c5c-ab8d-93c91942b423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cca565e04a649b18800293e8b23a86b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:32.078180 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 962/1955] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:31 2022] DELETE /identity/v3/users/6cca565e04a649b18800293e8b23a86b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:32.084180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e485e-2538-4ece-b2c5-c7a9bdf8d67a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:32.088052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e485e-2538-4ece-b2c5-c7a9bdf8d67a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:32.088628 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e485e-2538-4ece-b2c5-c7a9bdf8d67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:32.120063 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ed6e485e-2538-4ece-b2c5-c7a9bdf8d67a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:32.121591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ed6e485e-2538-4ece-b2c5-c7a9bdf8d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:32.225001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 994/1956] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:32.237791 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bb9b6-f20f-4c5c-ab8d-93c91942b423 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:32.239333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d61bb9b6-f20f-4c5c-ab8d-93c91942b423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:32.338026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bb9b6-f20f-4c5c-ab8d-93c91942b423 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:32.343597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e198c-73ee-4c83-bd53-824dc369d4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:32.344351 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e198c-73ee-4c83-bd53-824dc369d4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:32.344639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e198c-73ee-4c83-bd53-824dc369d4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:32.344996 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e198c-73ee-4c83-bd53-824dc369d4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:32.367522 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e198c-73ee-4c83-bd53-824dc369d4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:32.369657 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e198c-73ee-4c83-bd53-824dc369d4c4 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:32.383115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 963/1957] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:32.888188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e485e-2538-4ece-b2c5-c7a9bdf8d67a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:32.890015 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ed6e485e-2538-4ece-b2c5-c7a9bdf8d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:32.912848 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e485e-2538-4ece-b2c5-c7a9bdf8d67a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:32.940557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:32.940557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:32.940557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:32.940557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] PATH_INFO: `/v3/projects/bf130a20cd9d465590718495d8371dcb` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:32.944183 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf130a20cd9d465590718495d8371dcb)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:32.945382 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:33.139470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf130a20cd9d465590718495d8371dcb', 'request_id': 'req-5f9e5624-3920-4b7d-ae79-e986e9ee4845'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.158681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf130a20cd9d465590718495d8371dcb', 'request_id': 'req-5f9e5624-3920-4b7d-ae79-e986e9ee4845'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.175576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf130a20cd9d465590718495d8371dcb', 'request_id': 'req-5f9e5624-3920-4b7d-ae79-e986e9ee4845'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.210940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] The token cache is being invalidate because project bf130a20cd9d465590718495d8371dcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:33.212852 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.214273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.225295 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 995/1958] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:32 2022] DELETE /identity/v3/projects/bf130a20cd9d465590718495d8371dcb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:33.228578 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e198c-73ee-4c83-bd53-824dc369d4c4 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:33.248141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e198c-73ee-4c83-bd53-824dc369d4c4 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:33.337289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ea5e7-fb90-418f-94e6-1921a28cd523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:33.338515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ea5e7-fb90-418f-94e6-1921a28cd523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:33.338997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ea5e7-fb90-418f-94e6-1921a28cd523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:33.339470 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ea5e7-fb90-418f-94e6-1921a28cd523 admin admin] PATH_INFO: `/v3/users/71ad4b0b35cd461d9f981c225edfe60c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:33.341514 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ea5e7-fb90-418f-94e6-1921a28cd523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ad4b0b35cd461d9f981c225edfe60c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:33.345444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ea5e7-fb90-418f-94e6-1921a28cd523 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:33.426922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-047ea5e7-fb90-418f-94e6-1921a28cd523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ad4b0b35cd461d9f981c225edfe60c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.427718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-047ea5e7-fb90-418f-94e6-1921a28cd523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ad4b0b35cd461d9f981c225edfe60c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.428889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-047ea5e7-fb90-418f-94e6-1921a28cd523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ad4b0b35cd461d9f981c225edfe60c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.463332 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-047ea5e7-fb90-418f-94e6-1921a28cd523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ad4b0b35cd461d9f981c225edfe60c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.477850 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:33.496468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-047ea5e7-fb90-418f-94e6-1921a28cd523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ad4b0b35cd461d9f981c225edfe60c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.527796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 964/1959] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:33 2022] DELETE /identity/v3/users/71ad4b0b35cd461d9f981c225edfe60c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:33.533703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:33.536026 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:33.567869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5624-3920-4b7d-ae79-e986e9ee4845 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:33.577652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ea5e7-fb90-418f-94e6-1921a28cd523 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:33.582846 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-047ea5e7-fb90-418f-94e6-1921a28cd523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:33.617510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:33.776973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed50b4a-6865-46ae-8218-fd96b303f9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:33.778144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed50b4a-6865-46ae-8218-fd96b303f9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:33.778636 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed50b4a-6865-46ae-8218-fd96b303f9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:33.783614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed50b4a-6865-46ae-8218-fd96b303f9cf admin admin] PATH_INFO: `/v3/users/df136c9622524634b57282c8eb0277a3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:33.787390 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed50b4a-6865-46ae-8218-fd96b303f9cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=df136c9622524634b57282c8eb0277a3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:33.796557 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ea5e7-fb90-418f-94e6-1921a28cd523 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:33.799724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed50b4a-6865-46ae-8218-fd96b303f9cf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:33.808784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:33.809662 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:33.810050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:33.810543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] PATH_INFO: `/v3/projects/53ec75b7b5254f4c8e917bce3b118cd4` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:33.811999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ec75b7b5254f4c8e917bce3b118cd4)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:33.814761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:33.901249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ec75b7b5254f4c8e917bce3b118cd4', 'request_id': 'req-fbcae9a6-b969-46af-8671-bcb7c8824a17'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.912372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ec75b7b5254f4c8e917bce3b118cd4', 'request_id': 'req-fbcae9a6-b969-46af-8671-bcb7c8824a17'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.923608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ec75b7b5254f4c8e917bce3b118cd4', 'request_id': 'req-fbcae9a6-b969-46af-8671-bcb7c8824a17'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.928042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6ed50b4a-6865-46ae-8218-fd96b303f9cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df136c9622524634b57282c8eb0277a3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.928850 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6ed50b4a-6865-46ae-8218-fd96b303f9cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df136c9622524634b57282c8eb0277a3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.945232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] The token cache is being invalidate because project 53ec75b7b5254f4c8e917bce3b118cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:33.945870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.947584 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:33.950746 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 965/1960] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:33 2022] DELETE /identity/v3/projects/53ec75b7b5254f4c8e917bce3b118cd4 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:33.959929 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:33.965612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:33.968536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6ed50b4a-6865-46ae-8218-fd96b303f9cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df136c9622524634b57282c8eb0277a3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:34.014326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6ed50b4a-6865-46ae-8218-fd96b303f9cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df136c9622524634b57282c8eb0277a3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:34.017339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6ed50b4a-6865-46ae-8218-fd96b303f9cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df136c9622524634b57282c8eb0277a3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:34.048540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 996/1961] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:33 2022] DELETE /identity/v3/users/df136c9622524634b57282c8eb0277a3 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:34.050339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8619c-95c7-4d9b-b0e1-8d760b1aa903 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:34.050740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8619c-95c7-4d9b-b0e1-8d760b1aa903 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:34.051104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8619c-95c7-4d9b-b0e1-8d760b1aa903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:34.086531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-47a8619c-95c7-4d9b-b0e1-8d760b1aa903 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:34.091106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-47a8619c-95c7-4d9b-b0e1-8d760b1aa903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:34.188859 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcae9a6-b969-46af-8671-bcb7c8824a17 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:34.229609 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:34.264301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 997/1962] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:34.325554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8619c-95c7-4d9b-b0e1-8d760b1aa903 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:34.327174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-47a8619c-95c7-4d9b-b0e1-8d760b1aa903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:34.426803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee88c0-ca47-4a04-bb03-17649f9d6de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:34.427667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee88c0-ca47-4a04-bb03-17649f9d6de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:34.428096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee88c0-ca47-4a04-bb03-17649f9d6de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:34.428555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee88c0-ca47-4a04-bb03-17649f9d6de7 admin admin] PATH_INFO: `/v3/users/8e8482b34edf44d5b27aec5944048bf4` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:34.430764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee88c0-ca47-4a04-bb03-17649f9d6de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e8482b34edf44d5b27aec5944048bf4)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:34.433602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee88c0-ca47-4a04-bb03-17649f9d6de7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:34.492744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:34.537728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8619c-95c7-4d9b-b0e1-8d760b1aa903 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:34.544311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff85c6c-c2ad-4ec2-84fc-57543ae4d7e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:34.549624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff85c6c-c2ad-4ec2-84fc-57543ae4d7e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:34.549624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff85c6c-c2ad-4ec2-84fc-57543ae4d7e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:34.549624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff85c6c-c2ad-4ec2-84fc-57543ae4d7e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:34.573205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff85c6c-c2ad-4ec2-84fc-57543ae4d7e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:34.578071 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff85c6c-c2ad-4ec2-84fc-57543ae4d7e2 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:34.583032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bfee88c0-ca47-4a04-bb03-17649f9d6de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e8482b34edf44d5b27aec5944048bf4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:34.584030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bfee88c0-ca47-4a04-bb03-17649f9d6de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e8482b34edf44d5b27aec5944048bf4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:34.585711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bfee88c0-ca47-4a04-bb03-17649f9d6de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e8482b34edf44d5b27aec5944048bf4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:34.605873 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bfee88c0-ca47-4a04-bb03-17649f9d6de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e8482b34edf44d5b27aec5944048bf4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:34.619410 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 998/1963] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:34.620559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff85c6c-c2ad-4ec2-84fc-57543ae4d7e2 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:34.629150 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3ff85c6c-c2ad-4ec2-84fc-57543ae4d7e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:34.641212 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bfee88c0-ca47-4a04-bb03-17649f9d6de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e8482b34edf44d5b27aec5944048bf4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:34.677444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 966/1964] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:33 2022] DELETE /identity/v3/users/8e8482b34edf44d5b27aec5944048bf4 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:34.689711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff85c6c-c2ad-4ec2-84fc-57543ae4d7e2 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:34.882166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:34.889710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:34.891337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:34.898195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] PATH_INFO: `/v3/projects/ccafb93195574f9bb4ca31c45c870189` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:34.903299 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccafb93195574f9bb4ca31c45c870189)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:34.911239 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:34.995333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccafb93195574f9bb4ca31c45c870189', 'request_id': 'req-4c467fb4-f068-47fc-8ac0-98465e180f95'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.010837 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccafb93195574f9bb4ca31c45c870189', 'request_id': 'req-4c467fb4-f068-47fc-8ac0-98465e180f95'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.044607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccafb93195574f9bb4ca31c45c870189', 'request_id': 'req-4c467fb4-f068-47fc-8ac0-98465e180f95'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.084613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] The token cache is being invalidate because project ccafb93195574f9bb4ca31c45c870189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:35.084949 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.088292 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.091797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 999/1965] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:34 2022] DELETE /identity/v3/projects/ccafb93195574f9bb4ca31c45c870189 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:35.096141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee88c0-ca47-4a04-bb03-17649f9d6de7 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:35.098795 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bfee88c0-ca47-4a04-bb03-17649f9d6de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:35.121156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee88c0-ca47-4a04-bb03-17649f9d6de7 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:35.230988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd5dd0-10a2-4009-ab81-6fd6f15ecb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:35.231924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd5dd0-10a2-4009-ab81-6fd6f15ecb6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:35.231924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd5dd0-10a2-4009-ab81-6fd6f15ecb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:35.232485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd5dd0-10a2-4009-ab81-6fd6f15ecb6b admin admin] PATH_INFO: `/v3/users/80d98b82cdcc49ba87321b0c1d4efbbd` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:35.233772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd5dd0-10a2-4009-ab81-6fd6f15ecb6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d98b82cdcc49ba87321b0c1d4efbbd)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:35.236539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd5dd0-10a2-4009-ab81-6fd6f15ecb6b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:35.332584 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:35.363592 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a0dd5dd0-10a2-4009-ab81-6fd6f15ecb6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d98b82cdcc49ba87321b0c1d4efbbd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.364675 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a0dd5dd0-10a2-4009-ab81-6fd6f15ecb6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d98b82cdcc49ba87321b0c1d4efbbd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.365470 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a0dd5dd0-10a2-4009-ab81-6fd6f15ecb6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d98b82cdcc49ba87321b0c1d4efbbd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.393581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:35.395008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a0dd5dd0-10a2-4009-ab81-6fd6f15ecb6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d98b82cdcc49ba87321b0c1d4efbbd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.395162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:35.419333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c467fb4-f068-47fc-8ac0-98465e180f95 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:35.423452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a0dd5dd0-10a2-4009-ab81-6fd6f15ecb6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d98b82cdcc49ba87321b0c1d4efbbd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.431939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:35.432614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:35.433141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:35.433421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] PATH_INFO: `/v3/projects/87c6fad1abc540beb1704336ffcbedc5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:35.462408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c6fad1abc540beb1704336ffcbedc5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:35.489598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:35.490279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 967/1966] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:35 2022] DELETE /identity/v3/users/80d98b82cdcc49ba87321b0c1d4efbbd => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:35.550136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd5dd0-10a2-4009-ab81-6fd6f15ecb6b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:35.551835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a0dd5dd0-10a2-4009-ab81-6fd6f15ecb6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:35.593777 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c6fad1abc540beb1704336ffcbedc5', 'request_id': 'req-9093f2b0-7d27-4d2a-8cca-4779e47c85de'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.612558 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c6fad1abc540beb1704336ffcbedc5', 'request_id': 'req-9093f2b0-7d27-4d2a-8cca-4779e47c85de'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.626741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c6fad1abc540beb1704336ffcbedc5', 'request_id': 'req-9093f2b0-7d27-4d2a-8cca-4779e47c85de'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.629586 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:35.659334 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] The token cache is being invalidate because project 87c6fad1abc540beb1704336ffcbedc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:35.659853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.660494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:35.665852 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1000/1967] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:35 2022] DELETE /identity/v3/projects/87c6fad1abc540beb1704336ffcbedc5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:35.668304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:35.672182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:35.716066 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd5dd0-10a2-4009-ab81-6fd6f15ecb6b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:35.859106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093f2b0-7d27-4d2a-8cca-4779e47c85de admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:35.876790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451a37e-369c-4cd9-bc29-dcc6c4133a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:35.878337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451a37e-369c-4cd9-bc29-dcc6c4133a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:35.878730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451a37e-369c-4cd9-bc29-dcc6c4133a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:35.879110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451a37e-369c-4cd9-bc29-dcc6c4133a69 admin admin] PATH_INFO: `/v3/users/97eade6e8ad74380a70310a47ab5cba1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:35.881198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451a37e-369c-4cd9-bc29-dcc6c4133a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97eade6e8ad74380a70310a47ab5cba1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:35.887279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451a37e-369c-4cd9-bc29-dcc6c4133a69 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:35.891067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:35.891976 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:35.892318 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:35.892708 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4 admin admin] PATH_INFO: `/v3/projects/17f9b747e67f4169ba5db94492c0055a` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:35.900385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f9b747e67f4169ba5db94492c0055a)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:35.922120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:36.006420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5451a37e-369c-4cd9-bc29-dcc6c4133a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97eade6e8ad74380a70310a47ab5cba1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.007855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5451a37e-369c-4cd9-bc29-dcc6c4133a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97eade6e8ad74380a70310a47ab5cba1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.089555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5451a37e-369c-4cd9-bc29-dcc6c4133a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97eade6e8ad74380a70310a47ab5cba1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.119574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5451a37e-369c-4cd9-bc29-dcc6c4133a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97eade6e8ad74380a70310a47ab5cba1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.121065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5451a37e-369c-4cd9-bc29-dcc6c4133a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97eade6e8ad74380a70310a47ab5cba1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.129272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f9b747e67f4169ba5db94492c0055a', 'request_id': 'req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.151926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f9b747e67f4169ba5db94492c0055a', 'request_id': 'req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.162351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1001/1968] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:35 2022] DELETE /identity/v3/users/97eade6e8ad74380a70310a47ab5cba1 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:36.201648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f9b747e67f4169ba5db94492c0055a', 'request_id': 'req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.204223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:36.232280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4 admin admin] The token cache is being invalidate because project 17f9b747e67f4169ba5db94492c0055a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:36.232874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.236016 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5fbb5c95-1b4a-4321-9fd3-a34bebe5a1d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.247013 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 968/1969] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:35 2022] DELETE /identity/v3/projects/17f9b747e67f4169ba5db94492c0055a => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:24:36.249921 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f01a-131a-4488-9e94-65e095881ae6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:36.250217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f01a-131a-4488-9e94-65e095881ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:36.250598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f01a-131a-4488-9e94-65e095881ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:36.300050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d764f01a-131a-4488-9e94-65e095881ae6 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:36.302519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d764f01a-131a-4488-9e94-65e095881ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:36.451606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1002/1970] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:36.458401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b910e5b-15a0-4590-b9fc-b0974af727fd None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:36.458866 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b910e5b-15a0-4590-b9fc-b0974af727fd None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:36.459191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b910e5b-15a0-4590-b9fc-b0974af727fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:36.526008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-4b910e5b-15a0-4590-b9fc-b0974af727fd None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:36.531419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4b910e5b-15a0-4590-b9fc-b0974af727fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:36.550100 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764f01a-131a-4488-9e94-65e095881ae6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:36.552057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d764f01a-131a-4488-9e94-65e095881ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:36.585147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 969/1971] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:36.586247 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b910e5b-15a0-4590-b9fc-b0974af727fd None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:36.593327 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764f01a-131a-4488-9e94-65e095881ae6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:36.616150 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816ded1-af23-4b95-9e56-f7fa117ae625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:36.616815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816ded1-af23-4b95-9e56-f7fa117ae625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:36.617640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816ded1-af23-4b95-9e56-f7fa117ae625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:36.617640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816ded1-af23-4b95-9e56-f7fa117ae625 admin admin] PATH_INFO: `/v3/projects/fd0c2f69ebb94986a8877183d12a5100` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:36.620093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816ded1-af23-4b95-9e56-f7fa117ae625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0c2f69ebb94986a8877183d12a5100)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:36.632077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b910e5b-15a0-4590-b9fc-b0974af727fd None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:36.640027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816ded1-af23-4b95-9e56-f7fa117ae625 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:36.662910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e660e-5588-4c58-9367-032c7834aa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:36.663868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:36.664391 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e660e-5588-4c58-9367-032c7834aa3a admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:36.665548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e660e-5588-4c58-9367-032c7834aa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:36.666067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e660e-5588-4c58-9367-032c7834aa3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:36.668659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e660e-5588-4c58-9367-032c7834aa3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:36.670087 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e660e-5588-4c58-9367-032c7834aa3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:36.673527 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e660e-5588-4c58-9367-032c7834aa3a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:36.708926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 970/1972] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:24:36.715174 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e660e-5588-4c58-9367-032c7834aa3a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:36.736175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e660e-5588-4c58-9367-032c7834aa3a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:36.745699 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec5bac-0992-46c3-ad10-5ff360ff0f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:36.746013 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec5bac-0992-46c3-ad10-5ff360ff0f0b admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:36.747823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec5bac-0992-46c3-ad10-5ff360ff0f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:36.749979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec5bac-0992-46c3-ad10-5ff360ff0f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:36.750920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec5bac-0992-46c3-ad10-5ff360ff0f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:36.759085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec5bac-0992-46c3-ad10-5ff360ff0f0b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:36.818514 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a816ded1-af23-4b95-9e56-f7fa117ae625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0c2f69ebb94986a8877183d12a5100', 'request_id': 'req-a816ded1-af23-4b95-9e56-f7fa117ae625'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.833093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a816ded1-af23-4b95-9e56-f7fa117ae625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0c2f69ebb94986a8877183d12a5100', 'request_id': 'req-a816ded1-af23-4b95-9e56-f7fa117ae625'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.851421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a816ded1-af23-4b95-9e56-f7fa117ae625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0c2f69ebb94986a8877183d12a5100', 'request_id': 'req-a816ded1-af23-4b95-9e56-f7fa117ae625'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.864493 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 971/1973] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:36 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:36.865869 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec5bac-0992-46c3-ad10-5ff360ff0f0b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:36.882306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a816ded1-af23-4b95-9e56-f7fa117ae625 admin admin] The token cache is being invalidate because project fd0c2f69ebb94986a8877183d12a5100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:36.883305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a816ded1-af23-4b95-9e56-f7fa117ae625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.886063 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a816ded1-af23-4b95-9e56-f7fa117ae625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:36.889161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1003/1974] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:36 2022] DELETE /identity/v3/projects/fd0c2f69ebb94986a8877183d12a5100 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:36.896877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02154dad-e2cc-43bb-84c0-7a9389e712ec None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:36.897365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02154dad-e2cc-43bb-84c0-7a9389e712ec None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:36.897858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02154dad-e2cc-43bb-84c0-7a9389e712ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:36.956511 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-02154dad-e2cc-43bb-84c0-7a9389e712ec None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:36.961105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-02154dad-e2cc-43bb-84c0-7a9389e712ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:37.034573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec5bac-0992-46c3-ad10-5ff360ff0f0b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:37.041479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d42dbb-5e07-4568-88e6-7312ab1dcf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:37.042029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d42dbb-5e07-4568-88e6-7312ab1dcf01 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:37.042343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d42dbb-5e07-4568-88e6-7312ab1dcf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:37.042692 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d42dbb-5e07-4568-88e6-7312ab1dcf01 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:37.043264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d42dbb-5e07-4568-88e6-7312ab1dcf01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:37.046413 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d42dbb-5e07-4568-88e6-7312ab1dcf01 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:37.084748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 972/1975] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:36 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:37.085680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d42dbb-5e07-4568-88e6-7312ab1dcf01 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:37.088156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b0d42dbb-5e07-4568-88e6-7312ab1dcf01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:37.090175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1004/1976] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:37.098724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02154dad-e2cc-43bb-84c0-7a9389e712ec None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:37.101045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-02154dad-e2cc-43bb-84c0-7a9389e712ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:37.115649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d42dbb-5e07-4568-88e6-7312ab1dcf01 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:37.116071 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02154dad-e2cc-43bb-84c0-7a9389e712ec None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:37.122777 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab29922-e3be-4ead-8ece-06fa16b5baa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:37.123297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:37.123910 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab29922-e3be-4ead-8ece-06fa16b5baa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:37.124200 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:37.124580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:37.124796 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab29922-e3be-4ead-8ece-06fa16b5baa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:37.125294 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab29922-e3be-4ead-8ece-06fa16b5baa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:37.126146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] PATH_INFO: `/v3/projects/d2681520281146eaaa09c80132417ba8` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:37.126429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab29922-e3be-4ead-8ece-06fa16b5baa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:37.129474 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab29922-e3be-4ead-8ece-06fa16b5baa1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:37.130286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2681520281146eaaa09c80132417ba8)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:37.137133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:37.150560 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1005/1977] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:37.152924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe1a6f-fa5f-413b-9531-179770bbeb5c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:37.153563 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe1a6f-fa5f-413b-9531-179770bbeb5c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:37.154089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe1a6f-fa5f-413b-9531-179770bbeb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:37.182749 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e4fe1a6f-fa5f-413b-9531-179770bbeb5c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:37.184084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e4fe1a6f-fa5f-413b-9531-179770bbeb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:37.197718 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1006/1978] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:37.197718 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe1a6f-fa5f-413b-9531-179770bbeb5c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:37.212384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe1a6f-fa5f-413b-9531-179770bbeb5c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:37.226929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0e48c-0622-42fc-8bc8-e8eab17c7815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:37.228832 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0e48c-0622-42fc-8bc8-e8eab17c7815 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:37.229252 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0e48c-0622-42fc-8bc8-e8eab17c7815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:37.230403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0e48c-0622-42fc-8bc8-e8eab17c7815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:37.232278 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0e48c-0622-42fc-8bc8-e8eab17c7815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:37.235766 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0e48c-0622-42fc-8bc8-e8eab17c7815 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:37.242905 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2681520281146eaaa09c80132417ba8', 'request_id': 'req-bdae709f-ca3e-41a8-b06e-0687e603177d'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:37.257650 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2681520281146eaaa09c80132417ba8', 'request_id': 'req-bdae709f-ca3e-41a8-b06e-0687e603177d'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:37.262201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1007/1979] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:37.269703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0e48c-0622-42fc-8bc8-e8eab17c7815 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:37.272145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2681520281146eaaa09c80132417ba8', 'request_id': 'req-bdae709f-ca3e-41a8-b06e-0687e603177d'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:37.288230 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0e48c-0622-42fc-8bc8-e8eab17c7815 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:37.306945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] The token cache is being invalidate because project d2681520281146eaaa09c80132417ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:37.307560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:37.311099 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:37.317324 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 973/1980] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:37 2022] DELETE /identity/v3/projects/d2681520281146eaaa09c80132417ba8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:37.318565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:37.320390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:37.374217 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:INSERT=6,keystone:DELETE=8,keystone:SELECT=86 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:37.382424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca23b1-bfc0-4da8-a2d7-e25dc7cae3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:37.385254 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca23b1-bfc0-4da8-a2d7-e25dc7cae3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:37.386061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca23b1-bfc0-4da8-a2d7-e25dc7cae3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:37.386969 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca23b1-bfc0-4da8-a2d7-e25dc7cae3cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:37.388493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca23b1-bfc0-4da8-a2d7-e25dc7cae3cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:37.388929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca23b1-bfc0-4da8-a2d7-e25dc7cae3cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:37.391135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca23b1-bfc0-4da8-a2d7-e25dc7cae3cb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:37.412483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1008/1981] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:24:37.412483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca23b1-bfc0-4da8-a2d7-e25dc7cae3cb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:37.415715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f0ca23b1-bfc0-4da8-a2d7-e25dc7cae3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:37.426571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:37.434623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca23b1-bfc0-4da8-a2d7-e25dc7cae3cb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:37.450030 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e7250-573b-4bd5-8c96-9ed03dc297bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:37.450987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e7250-573b-4bd5-8c96-9ed03dc297bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:37.451450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e7250-573b-4bd5-8c96-9ed03dc297bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:37.452461 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e7250-573b-4bd5-8c96-9ed03dc297bc admin admin] PATH_INFO: `/v3/projects/bb892adc892947308ee023a04f5edcb3/users/9f3a2d2138ad4280897c7bd5b8d56b58/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:37.462074 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae709f-ca3e-41a8-b06e-0687e603177d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:37.468208 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69774c76-7124-4446-9ca5-c1e0b104225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:37.468830 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774c76-7124-4446-9ca5-c1e0b104225e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:37.469908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774c76-7124-4446-9ca5-c1e0b104225e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:37.469908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774c76-7124-4446-9ca5-c1e0b104225e admin admin] PATH_INFO: `/v3/users/d3ab779712fc421c88af7e503c0090b4` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:37.471322 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69774c76-7124-4446-9ca5-c1e0b104225e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ab779712fc421c88af7e503c0090b4)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:37.473358 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69774c76-7124-4446-9ca5-c1e0b104225e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:37.481734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e7250-573b-4bd5-8c96-9ed03dc297bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb892adc892947308ee023a04f5edcb3, user_id=9f3a2d2138ad4280897c7bd5b8d56b58, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:37.485643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e7250-573b-4bd5-8c96-9ed03dc297bc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:37.513364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1009/1982] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:37 2022] PUT /identity/v3/projects/bb892adc892947308ee023a04f5edcb3/users/9f3a2d2138ad4280897c7bd5b8d56b58/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:37.513364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2e098-c740-47d9-8919-f0ed42a237b8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:37.513364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2e098-c740-47d9-8919-f0ed42a237b8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:37.513364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2e098-c740-47d9-8919-f0ed42a237b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:37.541207 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8ef2e098-c740-47d9-8919-f0ed42a237b8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:37.544961 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8ef2e098-c740-47d9-8919-f0ed42a237b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:37.552214 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-69774c76-7124-4446-9ca5-c1e0b104225e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ab779712fc421c88af7e503c0090b4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:37.552933 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-69774c76-7124-4446-9ca5-c1e0b104225e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ab779712fc421c88af7e503c0090b4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:37.554884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-69774c76-7124-4446-9ca5-c1e0b104225e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ab779712fc421c88af7e503c0090b4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:37.564698 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-69774c76-7124-4446-9ca5-c1e0b104225e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ab779712fc421c88af7e503c0090b4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:37.580766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-69774c76-7124-4446-9ca5-c1e0b104225e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ab779712fc421c88af7e503c0090b4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:37.604533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 974/1983] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:37 2022] DELETE /identity/v3/users/d3ab779712fc421c88af7e503c0090b4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:37.607443 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69774c76-7124-4446-9ca5-c1e0b104225e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:37.609017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-69774c76-7124-4446-9ca5-c1e0b104225e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:37.648834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1010/1984] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:37.651095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da357e8b-ffff-48bf-9004-34719c014583 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:37.651478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da357e8b-ffff-48bf-9004-34719c014583 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:37.651852 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da357e8b-ffff-48bf-9004-34719c014583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:37.693422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-da357e8b-ffff-48bf-9004-34719c014583 None None] MFA Rules not processed for user `9f3a2d2138ad4280897c7bd5b8d56b58`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:37.695307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-da357e8b-ffff-48bf-9004-34719c014583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:37.706430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69774c76-7124-4446-9ca5-c1e0b104225e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:37.712754 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a527ef-5d63-4862-8fba-160057423522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:37.713791 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a527ef-5d63-4862-8fba-160057423522 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:37.714071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a527ef-5d63-4862-8fba-160057423522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:37.714343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a527ef-5d63-4862-8fba-160057423522 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:37.714993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a527ef-5d63-4862-8fba-160057423522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:37.717981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a527ef-5d63-4862-8fba-160057423522 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:37.780796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 975/1985] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:37 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:37.783226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326b603-009b-450a-a9a7-eb67059e7eb5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:37.783919 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326b603-009b-450a-a9a7-eb67059e7eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:37.783919 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326b603-009b-450a-a9a7-eb67059e7eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:37.827585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c326b603-009b-450a-a9a7-eb67059e7eb5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:37.834898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1011/1986] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:37.834898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fb1ff-9269-423c-ae42-28db68cc00c9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:37.834898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fb1ff-9269-423c-ae42-28db68cc00c9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:37.834898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fb1ff-9269-423c-ae42-28db68cc00c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:37.835311 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c326b603-009b-450a-a9a7-eb67059e7eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:37.903824 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d88fb1ff-9269-423c-ae42-28db68cc00c9 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:37.905405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d88fb1ff-9269-423c-ae42-28db68cc00c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:37.911522 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:38.024470 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 976/1987] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:38.026498 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326b603-009b-450a-a9a7-eb67059e7eb5 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:38.051032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326b603-009b-450a-a9a7-eb67059e7eb5 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:38.063834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247a9c5-4a1d-44f3-8f81-0bc61f0ab859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:38.064480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247a9c5-4a1d-44f3-8f81-0bc61f0ab859 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:38.064779 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247a9c5-4a1d-44f3-8f81-0bc61f0ab859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:38.065048 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247a9c5-4a1d-44f3-8f81-0bc61f0ab859 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:38.065690 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247a9c5-4a1d-44f3-8f81-0bc61f0ab859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:38.067747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247a9c5-4a1d-44f3-8f81-0bc61f0ab859 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:38.073209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1012/1988] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:38.074233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fb1ff-9269-423c-ae42-28db68cc00c9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:38.080130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d88fb1ff-9269-423c-ae42-28db68cc00c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:38.101206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:38.119508 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 977/1989] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:38 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:38.120972 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247a9c5-4a1d-44f3-8f81-0bc61f0ab859 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:38.169427 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247a9c5-4a1d-44f3-8f81-0bc61f0ab859 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:38.195449 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017af87-fc3c-4616-8627-ced54616ce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:38.196582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017af87-fc3c-4616-8627-ced54616ce94 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:38.197126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017af87-fc3c-4616-8627-ced54616ce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:38.197621 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017af87-fc3c-4616-8627-ced54616ce94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:38.198711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017af87-fc3c-4616-8627-ced54616ce94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:38.199139 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017af87-fc3c-4616-8627-ced54616ce94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:38.202418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017af87-fc3c-4616-8627-ced54616ce94 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:38.249122 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 978/1990] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:24:38.250170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017af87-fc3c-4616-8627-ced54616ce94 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:38.278251 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017af87-fc3c-4616-8627-ced54616ce94 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:38.284018 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacfad7-3cbc-4597-986b-1932946f50b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:38.284636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacfad7-3cbc-4597-986b-1932946f50b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:38.284939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacfad7-3cbc-4597-986b-1932946f50b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:38.285208 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacfad7-3cbc-4597-986b-1932946f50b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:38.286143 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacfad7-3cbc-4597-986b-1932946f50b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:38.291751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacfad7-3cbc-4597-986b-1932946f50b8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:38.325350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 979/1991] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:38.328351 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacfad7-3cbc-4597-986b-1932946f50b8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:38.343441 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fb1ff-9269-423c-ae42-28db68cc00c9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:38.350946 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacfad7-3cbc-4597-986b-1932946f50b8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:38.355497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac30d16-4e56-49fc-aa2d-73ae5ca4bf24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2974669e9d1a417892b1d59dbc9e87ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:38.360160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac30d16-4e56-49fc-aa2d-73ae5ca4bf24 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:38.360566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac30d16-4e56-49fc-aa2d-73ae5ca4bf24 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:38.360970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac30d16-4e56-49fc-aa2d-73ae5ca4bf24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:38.362081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcfb87-5481-46e7-a0db-a87e1c50475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:38.362767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcfb87-5481-46e7-a0db-a87e1c50475a admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:38.363047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcfb87-5481-46e7-a0db-a87e1c50475a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:38.363312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcfb87-5481-46e7-a0db-a87e1c50475a admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:38.363945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dcfb87-5481-46e7-a0db-a87e1c50475a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:38.365944 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dcfb87-5481-46e7-a0db-a87e1c50475a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:38.426768 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 980/1992] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:38 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:38.431966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcfb87-5481-46e7-a0db-a87e1c50475a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:38.437913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-87dcfb87-5481-46e7-a0db-a87e1c50475a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:38.488785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac30d16-4e56-49fc-aa2d-73ae5ca4bf24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:38.494024 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac30d16-4e56-49fc-aa2d-73ae5ca4bf24 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:38.521627 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1013/1993] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:38.524649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac30d16-4e56-49fc-aa2d-73ae5ca4bf24 service glance] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:38.552653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac30d16-4e56-49fc-aa2d-73ae5ca4bf24 service glance] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:38.570522 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcfb87-5481-46e7-a0db-a87e1c50475a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:38.585107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12945e1-3218-4f52-b709-672f58fb3c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:38.585107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12945e1-3218-4f52-b709-672f58fb3c25 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:38.585107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12945e1-3218-4f52-b709-672f58fb3c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:38.585107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12945e1-3218-4f52-b709-672f58fb3c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:38.700303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1c44c-fc19-4223-a7ba-bbb8219c39d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:38.701202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c44c-fc19-4223-a7ba-bbb8219c39d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:38.701633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c44c-fc19-4223-a7ba-bbb8219c39d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:38.702068 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c44c-fc19-4223-a7ba-bbb8219c39d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:38.702967 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1c44c-fc19-4223-a7ba-bbb8219c39d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:38.704735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1c44c-fc19-4223-a7ba-bbb8219c39d8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:38.710777 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12945e1-3218-4f52-b709-672f58fb3c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:38.713494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12945e1-3218-4f52-b709-672f58fb3c25 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:38.720295 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1014/1994] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:38.721326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1c44c-fc19-4223-a7ba-bbb8219c39d8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:38.738572 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1c44c-fc19-4223-a7ba-bbb8219c39d8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:38.743252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 981/1995] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:38.744076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12945e1-3218-4f52-b709-672f58fb3c25 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:38.745559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497498dc-33cb-46f2-a785-62a9ea91a30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:38.747191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497498dc-33cb-46f2-a785-62a9ea91a30a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:38.747695 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497498dc-33cb-46f2-a785-62a9ea91a30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:38.748169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497498dc-33cb-46f2-a785-62a9ea91a30a admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:38.749066 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497498dc-33cb-46f2-a785-62a9ea91a30a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:38.754607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497498dc-33cb-46f2-a785-62a9ea91a30a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:38.755761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12945e1-3218-4f52-b709-672f58fb3c25 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:38.763183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72cb17-d536-4d12-a393-1f12d41008ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:38.763893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72cb17-d536-4d12-a393-1f12d41008ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:38.764176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72cb17-d536-4d12-a393-1f12d41008ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:38.764455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72cb17-d536-4d12-a393-1f12d41008ab admin admin] PATH_INFO: `/v3/projects/395a6e4373814771bf62808792ebd000/users/6a3f984a20b14a74b44c5d12f475e302/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:38.791005 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:38.799839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72cb17-d536-4d12-a393-1f12d41008ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=395a6e4373814771bf62808792ebd000, user_id=6a3f984a20b14a74b44c5d12f475e302, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:38.803298 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1015/1996] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:38 2022] POST /identity/v3/users => generated 293 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:38.803472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72cb17-d536-4d12-a393-1f12d41008ab admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:38.810538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497498dc-33cb-46f2-a785-62a9ea91a30a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:38.830229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497498dc-33cb-46f2-a785-62a9ea91a30a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:38.836818 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 982/1997] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:38 2022] PUT /identity/v3/projects/395a6e4373814771bf62808792ebd000/users/6a3f984a20b14a74b44c5d12f475e302/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:38.852338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee21e3-4ef5-4317-a4d2-d96091d4bbba None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:38.854134 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee21e3-4ef5-4317-a4d2-d96091d4bbba None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:38.855697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee21e3-4ef5-4317-a4d2-d96091d4bbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:38.898506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:38.972440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-35ee21e3-4ef5-4317-a4d2-d96091d4bbba None None] MFA Rules not processed for user `6a3f984a20b14a74b44c5d12f475e302`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:38.974337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-35ee21e3-4ef5-4317-a4d2-d96091d4bbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:39.004634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a85a4-894b-4c33-b840-dafe6f0229b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:39.005572 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a85a4-894b-4c33-b840-dafe6f0229b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:39.005915 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a85a4-894b-4c33-b840-dafe6f0229b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:39.006684 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a85a4-894b-4c33-b840-dafe6f0229b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:39.006992 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a85a4-894b-4c33-b840-dafe6f0229b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:39.008836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a85a4-894b-4c33-b840-dafe6f0229b6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:39.028048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1016/1998] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:39.030562 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a85a4-894b-4c33-b840-dafe6f0229b6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:39.059714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a85a4-894b-4c33-b840-dafe6f0229b6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:39.074539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab74e3-01af-4b24-80d4-58c5fa92f203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:39.075329 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab74e3-01af-4b24-80d4-58c5fa92f203 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:39.076311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab74e3-01af-4b24-80d4-58c5fa92f203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:39.076648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab74e3-01af-4b24-80d4-58c5fa92f203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:39.080110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab74e3-01af-4b24-80d4-58c5fa92f203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:39.083428 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab74e3-01af-4b24-80d4-58c5fa92f203 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:39.112760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1017/1999] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:39.117035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab74e3-01af-4b24-80d4-58c5fa92f203 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:39.134066 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab74e3-01af-4b24-80d4-58c5fa92f203 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:39.142036 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b9e3b-df34-4f30-8e40-3c0b2d46ed20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:39.142782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b9e3b-df34-4f30-8e40-3c0b2d46ed20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:39.143329 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b9e3b-df34-4f30-8e40-3c0b2d46ed20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:39.143852 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b9e3b-df34-4f30-8e40-3c0b2d46ed20 admin admin] PATH_INFO: `/v3/projects/1e6bc3cf6256407a97271c4f85682cf4/users/2f1eedb7146043fb9d74eaf3f87ab1be/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:39.180063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 983/2000] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:39.186536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee21e3-4ef5-4317-a4d2-d96091d4bbba None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:39.201603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee21e3-4ef5-4317-a4d2-d96091d4bbba None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:39.205350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b9e3b-df34-4f30-8e40-3c0b2d46ed20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6bc3cf6256407a97271c4f85682cf4, user_id=2f1eedb7146043fb9d74eaf3f87ab1be, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:39.207992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c836a0-6c11-4d81-972f-aebaf6699967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:39.210001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b9e3b-df34-4f30-8e40-3c0b2d46ed20 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:39.210148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c836a0-6c11-4d81-972f-aebaf6699967 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:39.210908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c836a0-6c11-4d81-972f-aebaf6699967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:39.211309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c836a0-6c11-4d81-972f-aebaf6699967 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:39.212938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c836a0-6c11-4d81-972f-aebaf6699967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:39.219583 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c836a0-6c11-4d81-972f-aebaf6699967 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:39.269666 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1018/2001] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:39 2022] PUT /identity/v3/projects/1e6bc3cf6256407a97271c4f85682cf4/users/2f1eedb7146043fb9d74eaf3f87ab1be/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:39.273624 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 984/2002] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:39 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:39.281601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c836a0-6c11-4d81-972f-aebaf6699967 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:39.283159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305980ee-7de7-4919-8d4f-0c862e120a77 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:39.287061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305980ee-7de7-4919-8d4f-0c862e120a77 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:39.287778 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305980ee-7de7-4919-8d4f-0c862e120a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:39.455693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-305980ee-7de7-4919-8d4f-0c862e120a77 None None] MFA Rules not processed for user `2f1eedb7146043fb9d74eaf3f87ab1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:39.458325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-305980ee-7de7-4919-8d4f-0c862e120a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:39.521955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c836a0-6c11-4d81-972f-aebaf6699967 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:39.533460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad4667-bf89-4895-8e04-2d2d859c31ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:39.534251 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad4667-bf89-4895-8e04-2d2d859c31ac admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:39.534460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad4667-bf89-4895-8e04-2d2d859c31ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:39.534725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad4667-bf89-4895-8e04-2d2d859c31ac admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:39.535389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad4667-bf89-4895-8e04-2d2d859c31ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:39.540392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad4667-bf89-4895-8e04-2d2d859c31ac admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:39.578881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 985/2003] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:39 2022] POST /identity/v3/users => generated 296 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:39.578881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad4667-bf89-4895-8e04-2d2d859c31ac admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:39.578881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-18ad4667-bf89-4895-8e04-2d2d859c31ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:39.594336 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad4667-bf89-4895-8e04-2d2d859c31ac admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:39.600608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:39.601392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:39.601746 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:39.602126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] PATH_INFO: `/v3/projects/3a0ec05c87204f0abdf9634def502417` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:39.603549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0ec05c87204f0abdf9634def502417)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:39.606195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:39.671764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:39.713628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0ec05c87204f0abdf9634def502417', 'request_id': 'req-002d0135-9eb9-444f-b00c-82af29554e39'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:39.745884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0ec05c87204f0abdf9634def502417', 'request_id': 'req-002d0135-9eb9-444f-b00c-82af29554e39'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:39.748653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1019/2004] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:39.752370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305980ee-7de7-4919-8d4f-0c862e120a77 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:39.779718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0ec05c87204f0abdf9634def502417', 'request_id': 'req-002d0135-9eb9-444f-b00c-82af29554e39'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:39.800654 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305980ee-7de7-4919-8d4f-0c862e120a77 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:39.813486 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] The token cache is being invalidate because project 3a0ec05c87204f0abdf9634def502417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:39.813760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:39.814338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:39.817059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 986/2005] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:39 2022] DELETE /identity/v3/projects/3a0ec05c87204f0abdf9634def502417 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:39.818160 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:39.819950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:39.949373 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fd5f9-7cc3-4ece-9359-65c746b41c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:39.950726 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd5f9-7cc3-4ece-9359-65c746b41c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:39.951425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd5f9-7cc3-4ece-9359-65c746b41c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:39.952967 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd5f9-7cc3-4ece-9359-65c746b41c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:39.954080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fd5f9-7cc3-4ece-9359-65c746b41c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:39.956849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fd5f9-7cc3-4ece-9359-65c746b41c28 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:39.973045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1020/2006] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:39.974672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fd5f9-7cc3-4ece-9359-65c746b41c28 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:39.979376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-321fd5f9-7cc3-4ece-9359-65c746b41c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:40.011765 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fd5f9-7cc3-4ece-9359-65c746b41c28 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:40.030341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed7fcd-091d-475a-b7f1-6b2a363fbf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:40.031185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7fcd-091d-475a-b7f1-6b2a363fbf52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:40.031477 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7fcd-091d-475a-b7f1-6b2a363fbf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:40.031747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7fcd-091d-475a-b7f1-6b2a363fbf52 admin admin] PATH_INFO: `/v3/users/adce145df5ef44a0a933309385ecee76` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:40.034161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed7fcd-091d-475a-b7f1-6b2a363fbf52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adce145df5ef44a0a933309385ecee76)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:40.036496 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d0135-9eb9-444f-b00c-82af29554e39 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:40.037939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed7fcd-091d-475a-b7f1-6b2a363fbf52 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:40.046318 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f2644-69ec-4638-8489-30c38999cff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:40.047526 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f2644-69ec-4638-8489-30c38999cff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:40.048154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f2644-69ec-4638-8489-30c38999cff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:40.049153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f2644-69ec-4638-8489-30c38999cff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:40.050673 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f2644-69ec-4638-8489-30c38999cff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:40.054548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f2644-69ec-4638-8489-30c38999cff8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:40.054908 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:40.131219 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9fed7fcd-091d-475a-b7f1-6b2a363fbf52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adce145df5ef44a0a933309385ecee76'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:40.131935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9fed7fcd-091d-475a-b7f1-6b2a363fbf52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adce145df5ef44a0a933309385ecee76'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:40.158747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9fed7fcd-091d-475a-b7f1-6b2a363fbf52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adce145df5ef44a0a933309385ecee76'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:40.166880 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9fed7fcd-091d-475a-b7f1-6b2a363fbf52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adce145df5ef44a0a933309385ecee76'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:40.167781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9fed7fcd-091d-475a-b7f1-6b2a363fbf52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adce145df5ef44a0a933309385ecee76'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:40.183261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 987/2007] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:39 2022] POST /identity/v3/projects => generated 387 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:40.185896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f2644-69ec-4638-8489-30c38999cff8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:40.192635 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1021/2008] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:39 2022] DELETE /identity/v3/users/adce145df5ef44a0a933309385ecee76 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:40.193572 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed7fcd-091d-475a-b7f1-6b2a363fbf52 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:40.194787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-889f2644-69ec-4638-8489-30c38999cff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:40.203504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9fed7fcd-091d-475a-b7f1-6b2a363fbf52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:40.298559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed7fcd-091d-475a-b7f1-6b2a363fbf52 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:40.307076 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47be9-3d41-4235-8ea0-a726feffc545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:40.307944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47be9-3d41-4235-8ea0-a726feffc545 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:40.308322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47be9-3d41-4235-8ea0-a726feffc545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:40.308808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47be9-3d41-4235-8ea0-a726feffc545 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:40.309844 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d47be9-3d41-4235-8ea0-a726feffc545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:40.312803 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d47be9-3d41-4235-8ea0-a726feffc545 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:40.376258 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1022/2009] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:40 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:40.381381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47be9-3d41-4235-8ea0-a726feffc545 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:40.431554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47be9-3d41-4235-8ea0-a726feffc545 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:40.442480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f2644-69ec-4638-8489-30c38999cff8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:40.443119 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802d729-945d-4a30-a579-c6e24f7f5859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:40.448716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d729-945d-4a30-a579-c6e24f7f5859 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:40.448716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d729-945d-4a30-a579-c6e24f7f5859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:40.448716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d729-945d-4a30-a579-c6e24f7f5859 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:40.448716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802d729-945d-4a30-a579-c6e24f7f5859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:40.450361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802d729-945d-4a30-a579-c6e24f7f5859 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:40.465722 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d090e3b-df2a-40b3-aab1-dab27190ab72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:40.467850 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d090e3b-df2a-40b3-aab1-dab27190ab72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:40.468250 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d090e3b-df2a-40b3-aab1-dab27190ab72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:40.470448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d090e3b-df2a-40b3-aab1-dab27190ab72 admin admin] PATH_INFO: `/v3/projects/f5e3572c4a124e099ac170f6385d851a/users/55d72e1f6e59418a96122f419b463250/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:40.471753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1023/2010] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:40.477728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802d729-945d-4a30-a579-c6e24f7f5859 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:40.488996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802d729-945d-4a30-a579-c6e24f7f5859 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:40.495289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25888b57-337c-418f-af1a-0be168a82cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:40.496889 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25888b57-337c-418f-af1a-0be168a82cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:40.497687 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25888b57-337c-418f-af1a-0be168a82cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:40.498047 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25888b57-337c-418f-af1a-0be168a82cb3 admin admin] PATH_INFO: `/v3/projects/854ed71336ff4a7886e9ddf4ddde7636/users/76efdb4962014e84b23667e879e46d7b/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:40.500791 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d090e3b-df2a-40b3-aab1-dab27190ab72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e3572c4a124e099ac170f6385d851a, user_id=55d72e1f6e59418a96122f419b463250, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:40.503843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d090e3b-df2a-40b3-aab1-dab27190ab72 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:40.534184 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 988/2011] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:40 2022] PUT /identity/v3/projects/f5e3572c4a124e099ac170f6385d851a/users/55d72e1f6e59418a96122f419b463250/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:40.541774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d090e3b-df2a-40b3-aab1-dab27190ab72 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:40.552043 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25888b57-337c-418f-af1a-0be168a82cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854ed71336ff4a7886e9ddf4ddde7636, user_id=76efdb4962014e84b23667e879e46d7b, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:40.555149 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25888b57-337c-418f-af1a-0be168a82cb3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:40.588416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1024/2012] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:40 2022] PUT /identity/v3/projects/854ed71336ff4a7886e9ddf4ddde7636/users/76efdb4962014e84b23667e879e46d7b/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:40.593612 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25888b57-337c-418f-af1a-0be168a82cb3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:40.642280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:40.681259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:40.725122 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d090e3b-df2a-40b3-aab1-dab27190ab72 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:40.827662 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25888b57-337c-418f-af1a-0be168a82cb3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:40.845236 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4174-01d9-48b0-a1de-b0fbe34ee3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:40.845920 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4174-01d9-48b0-a1de-b0fbe34ee3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:40.846201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4174-01d9-48b0-a1de-b0fbe34ee3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:40.846470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4174-01d9-48b0-a1de-b0fbe34ee3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:40.847127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b4174-01d9-48b0-a1de-b0fbe34ee3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:40.849483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b4174-01d9-48b0-a1de-b0fbe34ee3d2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:40.865363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1025/2013] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:40.867033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4174-01d9-48b0-a1de-b0fbe34ee3d2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:40.905822 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4174-01d9-48b0-a1de-b0fbe34ee3d2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:40.914119 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e238124-c7f9-4850-9ff3-3b76888d85c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:40.916230 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e238124-c7f9-4850-9ff3-3b76888d85c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:40.916721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e238124-c7f9-4850-9ff3-3b76888d85c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:40.924034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e238124-c7f9-4850-9ff3-3b76888d85c8 admin admin] PATH_INFO: `/v3/projects/854ed71336ff4a7886e9ddf4ddde7636/users/76efdb4962014e84b23667e879e46d7b/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:40.933584 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e238124-c7f9-4850-9ff3-3b76888d85c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854ed71336ff4a7886e9ddf4ddde7636, user_id=76efdb4962014e84b23667e879e46d7b, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:40.939530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e238124-c7f9-4850-9ff3-3b76888d85c8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:40.946885 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5007f4e-2f09-43ba-ad87-945a3b91e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:40.947909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5007f4e-2f09-43ba-ad87-945a3b91e2cb admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:40.948405 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5007f4e-2f09-43ba-ad87-945a3b91e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:40.948945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5007f4e-2f09-43ba-ad87-945a3b91e2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:40.949874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5007f4e-2f09-43ba-ad87-945a3b91e2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:40.952478 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5007f4e-2f09-43ba-ad87-945a3b91e2cb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:40.981598 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 989/2015] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:40.982558 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5007f4e-2f09-43ba-ad87-945a3b91e2cb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:40.985148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a5007f4e-2f09-43ba-ad87-945a3b91e2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:40.985602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1026/2015] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:40 2022] PUT /identity/v3/projects/854ed71336ff4a7886e9ddf4ddde7636/users/76efdb4962014e84b23667e879e46d7b/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:24:40.987690 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8128ad3-dde1-41f7-9206-c83324e23b64 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:40.988285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8128ad3-dde1-41f7-9206-c83324e23b64 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:40.989324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8128ad3-dde1-41f7-9206-c83324e23b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:41.009913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5007f4e-2f09-43ba-ad87-945a3b91e2cb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:41.031907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f8128ad3-dde1-41f7-9206-c83324e23b64 None None] MFA Rules not processed for user `76efdb4962014e84b23667e879e46d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:41.033473 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f8128ad3-dde1-41f7-9206-c83324e23b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:41.152136 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:41.152975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:41.153444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:41.153866 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad admin admin] PATH_INFO: `/v3/projects/1c0a1ede8abd4675bc982d1ea08493f0` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:41.156252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0a1ede8abd4675bc982d1ea08493f0)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:41.158620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:41.223808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1027/2016] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:41.224819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8128ad3-dde1-41f7-9206-c83324e23b64 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:41.246885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8128ad3-dde1-41f7-9206-c83324e23b64 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:41.254600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e874840-f57f-4a76-b009-4aad4bc5e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:41.255545 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e874840-f57f-4a76-b009-4aad4bc5e97d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:41.255980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e874840-f57f-4a76-b009-4aad4bc5e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:41.256480 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e874840-f57f-4a76-b009-4aad4bc5e97d admin admin] PATH_INFO: `/v3/projects/f5e3572c4a124e099ac170f6385d851a/users/55d72e1f6e59418a96122f419b463250/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:41.260027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e874840-f57f-4a76-b009-4aad4bc5e97d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e3572c4a124e099ac170f6385d851a, user_id=55d72e1f6e59418a96122f419b463250, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:41.265960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e874840-f57f-4a76-b009-4aad4bc5e97d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:41.283759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0a1ede8abd4675bc982d1ea08493f0', 'request_id': 'req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:41.296088 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0a1ede8abd4675bc982d1ea08493f0', 'request_id': 'req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:41.315584 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1028/2017] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:41 2022] PUT /identity/v3/projects/f5e3572c4a124e099ac170f6385d851a/users/55d72e1f6e59418a96122f419b463250/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:41.316676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e874840-f57f-4a76-b009-4aad4bc5e97d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:41.322730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9e874840-f57f-4a76-b009-4aad4bc5e97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:41.329472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0a1ede8abd4675bc982d1ea08493f0', 'request_id': 'req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:41.375870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad admin admin] The token cache is being invalidate because project 1c0a1ede8abd4675bc982d1ea08493f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:41.376164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:41.378359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dcd1d7ee-5b6f-485d-aa90-13fac46e1aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:41.390985 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 990/2018] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:40 2022] DELETE /identity/v3/projects/1c0a1ede8abd4675bc982d1ea08493f0 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:41.395588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c3906-fc48-4900-afc9-fa9a6a0447cd None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:41.395875 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c3906-fc48-4900-afc9-fa9a6a0447cd None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:41.396160 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c3906-fc48-4900-afc9-fa9a6a0447cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:41.463746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e874840-f57f-4a76-b009-4aad4bc5e97d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:41.467116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:41.469135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b0870-17c4-436f-830b-4d533fe57704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:41.469763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b0870-17c4-436f-830b-4d533fe57704 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:41.470098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b0870-17c4-436f-830b-4d533fe57704 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:41.470379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b0870-17c4-436f-830b-4d533fe57704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:41.472419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ec9b0870-17c4-436f-830b-4d533fe57704 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:41.479490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e03c3906-fc48-4900-afc9-fa9a6a0447cd None None] MFA Rules not processed for user `55d72e1f6e59418a96122f419b463250`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:41.481234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e03c3906-fc48-4900-afc9-fa9a6a0447cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:41.564917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:41.598380 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b0870-17c4-436f-830b-4d533fe57704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:41.600243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b0870-17c4-436f-830b-4d533fe57704 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:41.611046 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 991/2019] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:41.612524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2393ba-02e8-4c15-bccc-4c7789e844bc None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:41.612852 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2393ba-02e8-4c15-bccc-4c7789e844bc None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:41.613132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2393ba-02e8-4c15-bccc-4c7789e844bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:41.629131 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1029/2020] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:41.636103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b0870-17c4-436f-830b-4d533fe57704 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:41.643326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ec9b0870-17c4-436f-830b-4d533fe57704 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:41.670537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b0870-17c4-436f-830b-4d533fe57704 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:41.676399 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56402fb0-5162-4d28-a19b-18aba5f3f0a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:41.677321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56402fb0-5162-4d28-a19b-18aba5f3f0a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:41.677595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56402fb0-5162-4d28-a19b-18aba5f3f0a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:41.678026 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56402fb0-5162-4d28-a19b-18aba5f3f0a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:41.680931 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0a2393ba-02e8-4c15-bccc-4c7789e844bc None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:41.682330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0a2393ba-02e8-4c15-bccc-4c7789e844bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:41.692059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56402fb0-5162-4d28-a19b-18aba5f3f0a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:41.693747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56402fb0-5162-4d28-a19b-18aba5f3f0a0 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:41.706114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1030/2021] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:41.707367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56402fb0-5162-4d28-a19b-18aba5f3f0a0 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:41.709529 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-56402fb0-5162-4d28-a19b-18aba5f3f0a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:41.804323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 992/2022] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:41.812384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a391e82-d3eb-48a9-b965-26d1d2a52043 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:41.813017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a391e82-d3eb-48a9-b965-26d1d2a52043 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:41.813439 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a391e82-d3eb-48a9-b965-26d1d2a52043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:41.850923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3a391e82-d3eb-48a9-b965-26d1d2a52043 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:41.853194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3a391e82-d3eb-48a9-b965-26d1d2a52043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:41.863557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56402fb0-5162-4d28-a19b-18aba5f3f0a0 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:41.874879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 993/2023] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:41.876731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87998abb-0a99-4e6d-82f0-f9827a21d4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:41.877473 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87998abb-0a99-4e6d-82f0-f9827a21d4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:41.878035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87998abb-0a99-4e6d-82f0-f9827a21d4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:41.878337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87998abb-0a99-4e6d-82f0-f9827a21d4ee admin admin] PATH_INFO: `/v3/users/2f1eedb7146043fb9d74eaf3f87ab1be` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:41.880096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a391e82-d3eb-48a9-b965-26d1d2a52043 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:41.881252 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87998abb-0a99-4e6d-82f0-f9827a21d4ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f1eedb7146043fb9d74eaf3f87ab1be)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:41.889304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87998abb-0a99-4e6d-82f0-f9827a21d4ee admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:41.909666 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a391e82-d3eb-48a9-b965-26d1d2a52043 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:41.921221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403575c-937a-4635-aef0-c473af911652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:41.921879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403575c-937a-4635-aef0-c473af911652 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:41.922227 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403575c-937a-4635-aef0-c473af911652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:41.922593 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403575c-937a-4635-aef0-c473af911652 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:41.923391 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403575c-937a-4635-aef0-c473af911652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:41.924076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403575c-937a-4635-aef0-c473af911652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:41.925860 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403575c-937a-4635-aef0-c473af911652 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:41.974602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 994/2024] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:24:41.976287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403575c-937a-4635-aef0-c473af911652 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:42.004444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403575c-937a-4635-aef0-c473af911652 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:42.017059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-87998abb-0a99-4e6d-82f0-f9827a21d4ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1eedb7146043fb9d74eaf3f87ab1be'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:42.020560 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-87998abb-0a99-4e6d-82f0-f9827a21d4ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1eedb7146043fb9d74eaf3f87ab1be'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:42.038581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-87998abb-0a99-4e6d-82f0-f9827a21d4ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1eedb7146043fb9d74eaf3f87ab1be'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:42.042509 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f99987-1fd1-4dec-b379-e43af8646507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:42.048394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-87998abb-0a99-4e6d-82f0-f9827a21d4ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1eedb7146043fb9d74eaf3f87ab1be'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:42.049264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-87998abb-0a99-4e6d-82f0-f9827a21d4ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1eedb7146043fb9d74eaf3f87ab1be'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:42.056657 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f99987-1fd1-4dec-b379-e43af8646507 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:42.056970 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f99987-1fd1-4dec-b379-e43af8646507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:42.059929 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f99987-1fd1-4dec-b379-e43af8646507 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:42.060636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f99987-1fd1-4dec-b379-e43af8646507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:42.066822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f99987-1fd1-4dec-b379-e43af8646507 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:42.094225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1031/2025] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:41 2022] DELETE /identity/v3/users/2f1eedb7146043fb9d74eaf3f87ab1be => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:42.098934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f704a-19a0-42c5-8b3f-49e124ffbdee None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:42.099404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f704a-19a0-42c5-8b3f-49e124ffbdee None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:42.099780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f704a-19a0-42c5-8b3f-49e124ffbdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:42.125888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e55f704a-19a0-42c5-8b3f-49e124ffbdee None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:42.128303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e55f704a-19a0-42c5-8b3f-49e124ffbdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:42.138945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 995/2026] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:41 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:42.139924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f99987-1fd1-4dec-b379-e43af8646507 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:42.142773 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f9f99987-1fd1-4dec-b379-e43af8646507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:42.241397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:42.286964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1032/2027] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:42.294069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f704a-19a0-42c5-8b3f-49e124ffbdee None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:42.296202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e55f704a-19a0-42c5-8b3f-49e124ffbdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:42.330706 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:42.337976 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f99987-1fd1-4dec-b379-e43af8646507 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:42.353403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f8cd-86d8-40f2-9333-596e2ad4895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:42.354164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f8cd-86d8-40f2-9333-596e2ad4895d admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:42.354448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f8cd-86d8-40f2-9333-596e2ad4895d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:42.354764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f8cd-86d8-40f2-9333-596e2ad4895d admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:42.355357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2f8cd-86d8-40f2-9333-596e2ad4895d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:42.358176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2f8cd-86d8-40f2-9333-596e2ad4895d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:42.393598 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 996/2028] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:42 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:42.399375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f8cd-86d8-40f2-9333-596e2ad4895d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:42.434882 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f8cd-86d8-40f2-9333-596e2ad4895d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:42.444874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95668c-b2f0-437d-abe0-ddc58288e823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:42.453339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f704a-19a0-42c5-8b3f-49e124ffbdee None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:42.455922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95668c-b2f0-437d-abe0-ddc58288e823 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:42.456939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95668c-b2f0-437d-abe0-ddc58288e823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:42.457410 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95668c-b2f0-437d-abe0-ddc58288e823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:42.458807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95668c-b2f0-437d-abe0-ddc58288e823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:42.466782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95668c-b2f0-437d-abe0-ddc58288e823 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:42.490651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 997/2029] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:24:42.491962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95668c-b2f0-437d-abe0-ddc58288e823 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:42.509548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95668c-b2f0-437d-abe0-ddc58288e823 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:42.525699 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b743f83-a022-48e3-b745-057d17e1d410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:42.527092 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b743f83-a022-48e3-b745-057d17e1d410 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:42.527723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b743f83-a022-48e3-b745-057d17e1d410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:42.528225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b743f83-a022-48e3-b745-057d17e1d410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:42.530451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b743f83-a022-48e3-b745-057d17e1d410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:42.536149 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522464f2-4752-4ce4-bd76-c4a383cbb412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:42.536408 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b743f83-a022-48e3-b745-057d17e1d410 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:42.536876 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522464f2-4752-4ce4-bd76-c4a383cbb412 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:42.537155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522464f2-4752-4ce4-bd76-c4a383cbb412 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:42.537423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522464f2-4752-4ce4-bd76-c4a383cbb412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:42.549369 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522464f2-4752-4ce4-bd76-c4a383cbb412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:42.550863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522464f2-4752-4ce4-bd76-c4a383cbb412 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:42.556900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 998/2030] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:24:42.563697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b743f83-a022-48e3-b745-057d17e1d410 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:42.564148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1033/2031] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:24:42.565111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522464f2-4752-4ce4-bd76-c4a383cbb412 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:42.566615 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-522464f2-4752-4ce4-bd76-c4a383cbb412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:42.582159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b743f83-a022-48e3-b745-057d17e1d410 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:42.590210 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e62979-cb73-4351-bf58-1b981e2dd05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:42.591019 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e62979-cb73-4351-bf58-1b981e2dd05b admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:42.591362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e62979-cb73-4351-bf58-1b981e2dd05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:42.591478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522464f2-4752-4ce4-bd76-c4a383cbb412 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:42.591629 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e62979-cb73-4351-bf58-1b981e2dd05b admin admin] PATH_INFO: `/v3/projects/22a136dbf6fc4fbc855d0beb5fa2b122/users/aee141e372894903a9590422d0887bac/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:42.598270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ff773-d85f-4264-b716-99be4d597c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:42.599300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff773-d85f-4264-b716-99be4d597c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:42.599587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff773-d85f-4264-b716-99be4d597c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:42.599857 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff773-d85f-4264-b716-99be4d597c52 admin admin] PATH_INFO: `/v3/users/6a3f984a20b14a74b44c5d12f475e302` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:42.605433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff773-d85f-4264-b716-99be4d597c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a3f984a20b14a74b44c5d12f475e302)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:42.608200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff773-d85f-4264-b716-99be4d597c52 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:42.613395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e62979-cb73-4351-bf58-1b981e2dd05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a136dbf6fc4fbc855d0beb5fa2b122, user_id=aee141e372894903a9590422d0887bac, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:42.616159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e62979-cb73-4351-bf58-1b981e2dd05b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:42.636128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 999/2032] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:42 2022] PUT /identity/v3/projects/22a136dbf6fc4fbc855d0beb5fa2b122/users/aee141e372894903a9590422d0887bac/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:42.648414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e823df-63d2-4aaf-82f8-d2db70afb863 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:42.648867 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e823df-63d2-4aaf-82f8-d2db70afb863 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:42.649212 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e823df-63d2-4aaf-82f8-d2db70afb863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:42.715711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bb0ff773-d85f-4264-b716-99be4d597c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a3f984a20b14a74b44c5d12f475e302'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:42.717197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bb0ff773-d85f-4264-b716-99be4d597c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a3f984a20b14a74b44c5d12f475e302'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:42.719738 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-72e823df-63d2-4aaf-82f8-d2db70afb863 None None] MFA Rules not processed for user `aee141e372894903a9590422d0887bac`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:42.721048 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-72e823df-63d2-4aaf-82f8-d2db70afb863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:42.763199 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bb0ff773-d85f-4264-b716-99be4d597c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a3f984a20b14a74b44c5d12f475e302'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:42.777169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bb0ff773-d85f-4264-b716-99be4d597c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a3f984a20b14a74b44c5d12f475e302'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:42.778458 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bb0ff773-d85f-4264-b716-99be4d597c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a3f984a20b14a74b44c5d12f475e302'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:42.816633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1034/2033] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:42 2022] DELETE /identity/v3/users/6a3f984a20b14a74b44c5d12f475e302 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:42.818451 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb11ba9-c357-4fad-915b-acdb5e649f62 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:42.818837 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb11ba9-c357-4fad-915b-acdb5e649f62 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:42.819080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb11ba9-c357-4fad-915b-acdb5e649f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:42.824581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1000/2034] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:42.826521 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e823df-63d2-4aaf-82f8-d2db70afb863 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:42.841553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-72e823df-63d2-4aaf-82f8-d2db70afb863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:42.843177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dbb11ba9-c357-4fad-915b-acdb5e649f62 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:42.848294 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dbb11ba9-c357-4fad-915b-acdb5e649f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:42.860858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:42.919850 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e823df-63d2-4aaf-82f8-d2db70afb863 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:42.926541 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1035/2035] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:42.945875 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb11ba9-c357-4fad-915b-acdb5e649f62 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:42.948039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dbb11ba9-c357-4fad-915b-acdb5e649f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:43.028102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:43.051310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61aa63-7517-419b-888e-3fbcb82ea8cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:43.052924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61aa63-7517-419b-888e-3fbcb82ea8cf service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:43.053204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61aa63-7517-419b-888e-3fbcb82ea8cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:43.053516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61aa63-7517-419b-888e-3fbcb82ea8cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:43.134127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb11ba9-c357-4fad-915b-acdb5e649f62 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:43.142595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223463a-2301-4e3a-bb20-8c3e4d090b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:43.144334 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223463a-2301-4e3a-bb20-8c3e4d090b0b service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:43.144869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223463a-2301-4e3a-bb20-8c3e4d090b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:43.145547 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223463a-2301-4e3a-bb20-8c3e4d090b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:43.166913 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223463a-2301-4e3a-bb20-8c3e4d090b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:43.167076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61aa63-7517-419b-888e-3fbcb82ea8cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:43.168562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61aa63-7517-419b-888e-3fbcb82ea8cf service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:43.169714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223463a-2301-4e3a-bb20-8c3e4d090b0b service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:43.183546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1001/2036] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:43.186404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61aa63-7517-419b-888e-3fbcb82ea8cf service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:43.190603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2e61aa63-7517-419b-888e-3fbcb82ea8cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:43.192141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1036/2037] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:24:43.208266 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61aa63-7517-419b-888e-3fbcb82ea8cf service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:43.217465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:43.218253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:43.218891 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:43.219099 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] PATH_INFO: `/v3/projects/1e6bc3cf6256407a97271c4f85682cf4` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:43.220346 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6bc3cf6256407a97271c4f85682cf4)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:43.222368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:43.226810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223463a-2301-4e3a-bb20-8c3e4d090b0b service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:43.230495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e223463a-2301-4e3a-bb20-8c3e4d090b0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:43.247352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223463a-2301-4e3a-bb20-8c3e4d090b0b service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:43.254492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a998a60-9e1d-4b55-9734-2870b7a68104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:43.256267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a998a60-9e1d-4b55-9734-2870b7a68104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:43.256267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a998a60-9e1d-4b55-9734-2870b7a68104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:43.256775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a998a60-9e1d-4b55-9734-2870b7a68104 admin admin] PATH_INFO: `/v3/users/aee141e372894903a9590422d0887bac` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:43.259559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a998a60-9e1d-4b55-9734-2870b7a68104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee141e372894903a9590422d0887bac)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:43.262376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a998a60-9e1d-4b55-9734-2870b7a68104 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:43.340992 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a998a60-9e1d-4b55-9734-2870b7a68104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee141e372894903a9590422d0887bac'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.342088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a998a60-9e1d-4b55-9734-2870b7a68104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee141e372894903a9590422d0887bac'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.345865 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6bc3cf6256407a97271c4f85682cf4', 'request_id': 'req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.361579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a998a60-9e1d-4b55-9734-2870b7a68104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee141e372894903a9590422d0887bac'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.367911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6bc3cf6256407a97271c4f85682cf4', 'request_id': 'req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.378926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a998a60-9e1d-4b55-9734-2870b7a68104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee141e372894903a9590422d0887bac'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.378926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a998a60-9e1d-4b55-9734-2870b7a68104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee141e372894903a9590422d0887bac'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.389861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6bc3cf6256407a97271c4f85682cf4', 'request_id': 'req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.401430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1037/2038] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:43 2022] DELETE /identity/v3/users/aee141e372894903a9590422d0887bac => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:24:43.404277 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb3f2f-584d-4e7e-9d8d-c5f39fd13592 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:43.404564 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb3f2f-584d-4e7e-9d8d-c5f39fd13592 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:43.404926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb3f2f-584d-4e7e-9d8d-c5f39fd13592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:43.436357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] The token cache is being invalidate because project 1e6bc3cf6256407a97271c4f85682cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:43.439413 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.449202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3bfb3f2f-584d-4e7e-9d8d-c5f39fd13592 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:43.451084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.455030 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3bfb3f2f-584d-4e7e-9d8d-c5f39fd13592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:43.459611 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1002/2039] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:43 2022] DELETE /identity/v3/projects/1e6bc3cf6256407a97271c4f85682cf4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:43.474615 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:43.474615 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:43.513372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:43.562284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1038/2040] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:43.573646 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb3f2f-584d-4e7e-9d8d-c5f39fd13592 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:43.575640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3bfb3f2f-584d-4e7e-9d8d-c5f39fd13592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:43.591988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae2824-b7cf-484b-9c87-5b8a917cecc5 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:43.600346 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dc4e1-f290-4832-8320-83d64ff2db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:43.601232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dc4e1-f290-4832-8320-83d64ff2db9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:43.601663 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dc4e1-f290-4832-8320-83d64ff2db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:43.602649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dc4e1-f290-4832-8320-83d64ff2db9d admin admin] PATH_INFO: `/v3/users/76efdb4962014e84b23667e879e46d7b` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:43.604067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dc4e1-f290-4832-8320-83d64ff2db9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=76efdb4962014e84b23667e879e46d7b)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:43.606389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dc4e1-f290-4832-8320-83d64ff2db9d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:43.644235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:43.682960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb3f2f-584d-4e7e-9d8d-c5f39fd13592 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:43.693700 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f8836-273c-438b-9748-45a25372acb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:43.694350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f8836-273c-438b-9748-45a25372acb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:43.695176 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f8836-273c-438b-9748-45a25372acb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:43.695176 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f8836-273c-438b-9748-45a25372acb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:43.703302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-210dc4e1-f290-4832-8320-83d64ff2db9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76efdb4962014e84b23667e879e46d7b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.704731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-210dc4e1-f290-4832-8320-83d64ff2db9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76efdb4962014e84b23667e879e46d7b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.705630 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-210dc4e1-f290-4832-8320-83d64ff2db9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76efdb4962014e84b23667e879e46d7b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.708221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f8836-273c-438b-9748-45a25372acb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:43.711126 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f8836-273c-438b-9748-45a25372acb1 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:43.723788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1039/2041] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:24:43.724724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f8836-273c-438b-9748-45a25372acb1 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:43.734712 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0d0f8836-273c-438b-9748-45a25372acb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:43.738966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-210dc4e1-f290-4832-8320-83d64ff2db9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76efdb4962014e84b23667e879e46d7b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.754754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f8836-273c-438b-9748-45a25372acb1 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:43.762765 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:43.763743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:43.764286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:43.764863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] PATH_INFO: `/v3/projects/395a6e4373814771bf62808792ebd000` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:43.768190 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=395a6e4373814771bf62808792ebd000)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:43.768676 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-210dc4e1-f290-4832-8320-83d64ff2db9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76efdb4962014e84b23667e879e46d7b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.771841 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:43.811142 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1003/2042] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:43 2022] DELETE /identity/v3/users/76efdb4962014e84b23667e879e46d7b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:43.894266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395a6e4373814771bf62808792ebd000', 'request_id': 'req-e91f1f29-bff2-4de7-b35f-df269af7a9d4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.909570 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395a6e4373814771bf62808792ebd000', 'request_id': 'req-e91f1f29-bff2-4de7-b35f-df269af7a9d4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.933983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395a6e4373814771bf62808792ebd000', 'request_id': 'req-e91f1f29-bff2-4de7-b35f-df269af7a9d4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.956093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] The token cache is being invalidate because project 395a6e4373814771bf62808792ebd000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:43.956395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.958698 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:43.960671 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1040/2043] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:43 2022] DELETE /identity/v3/projects/395a6e4373814771bf62808792ebd000 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:43.965310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dc4e1-f290-4832-8320-83d64ff2db9d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:43.967374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-210dc4e1-f290-4832-8320-83d64ff2db9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:44.121482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dc4e1-f290-4832-8320-83d64ff2db9d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:44.283745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe055668-58c0-4ed2-b0bb-517b5d2a03e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:44.284804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe055668-58c0-4ed2-b0bb-517b5d2a03e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:44.286613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe055668-58c0-4ed2-b0bb-517b5d2a03e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:44.287241 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe055668-58c0-4ed2-b0bb-517b5d2a03e3 admin admin] PATH_INFO: `/v3/users/55d72e1f6e59418a96122f419b463250` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:44.290116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe055668-58c0-4ed2-b0bb-517b5d2a03e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d72e1f6e59418a96122f419b463250)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:44.296856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:44.298484 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe055668-58c0-4ed2-b0bb-517b5d2a03e3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:44.299524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:44.340786 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f1f29-bff2-4de7-b35f-df269af7a9d4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:44.372089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5122b07-9c12-41bb-be72-d81d516b25ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:44.374253 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5122b07-9c12-41bb-be72-d81d516b25ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:44.380620 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5122b07-9c12-41bb-be72-d81d516b25ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:44.381060 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5122b07-9c12-41bb-be72-d81d516b25ab admin admin] PATH_INFO: `/v3/projects/22a136dbf6fc4fbc855d0beb5fa2b122` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:44.389069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5122b07-9c12-41bb-be72-d81d516b25ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a136dbf6fc4fbc855d0beb5fa2b122)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:44.391985 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5122b07-9c12-41bb-be72-d81d516b25ab admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:44.450770 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fe055668-58c0-4ed2-b0bb-517b5d2a03e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d72e1f6e59418a96122f419b463250'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.451517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fe055668-58c0-4ed2-b0bb-517b5d2a03e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d72e1f6e59418a96122f419b463250'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.459244 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fe055668-58c0-4ed2-b0bb-517b5d2a03e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d72e1f6e59418a96122f419b463250'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.464226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:44.478036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fe055668-58c0-4ed2-b0bb-517b5d2a03e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d72e1f6e59418a96122f419b463250'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.487803 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b5122b07-9c12-41bb-be72-d81d516b25ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a136dbf6fc4fbc855d0beb5fa2b122', 'request_id': 'req-b5122b07-9c12-41bb-be72-d81d516b25ab'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.496548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:44.500719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b5122b07-9c12-41bb-be72-d81d516b25ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a136dbf6fc4fbc855d0beb5fa2b122', 'request_id': 'req-b5122b07-9c12-41bb-be72-d81d516b25ab'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.501227 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fe055668-58c0-4ed2-b0bb-517b5d2a03e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d72e1f6e59418a96122f419b463250'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.518728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b5122b07-9c12-41bb-be72-d81d516b25ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a136dbf6fc4fbc855d0beb5fa2b122', 'request_id': 'req-b5122b07-9c12-41bb-be72-d81d516b25ab'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.522297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1004/2044] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:43 2022] DELETE /identity/v3/users/55d72e1f6e59418a96122f419b463250 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:44.523309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe055668-58c0-4ed2-b0bb-517b5d2a03e3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:44.525289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-fe055668-58c0-4ed2-b0bb-517b5d2a03e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:44.543268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b5122b07-9c12-41bb-be72-d81d516b25ab admin admin] The token cache is being invalidate because project 22a136dbf6fc4fbc855d0beb5fa2b122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:44.543688 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b5122b07-9c12-41bb-be72-d81d516b25ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.544715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b5122b07-9c12-41bb-be72-d81d516b25ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.547069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1041/2045] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:44 2022] DELETE /identity/v3/projects/22a136dbf6fc4fbc855d0beb5fa2b122 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:44.552645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056db41-cb64-46e5-ba7c-e1ee4afe5ed9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:44.553015 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056db41-cb64-46e5-ba7c-e1ee4afe5ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:44.553267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056db41-cb64-46e5-ba7c-e1ee4afe5ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:44.587946 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7056db41-cb64-46e5-ba7c-e1ee4afe5ed9 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:44.590300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7056db41-cb64-46e5-ba7c-e1ee4afe5ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:44.640748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe055668-58c0-4ed2-b0bb-517b5d2a03e3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:44.648252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:44.649597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:44.649874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:44.650138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9 admin admin] PATH_INFO: `/v3/projects/854ed71336ff4a7886e9ddf4ddde7636` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:44.651952 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=854ed71336ff4a7886e9ddf4ddde7636)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:44.654595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:44.712634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1042/2046] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:44.721062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc828-051e-4b37-a69c-148a4fa95a3f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:44.721413 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc828-051e-4b37-a69c-148a4fa95a3f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:44.721717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc828-051e-4b37-a69c-148a4fa95a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:44.740083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854ed71336ff4a7886e9ddf4ddde7636', 'request_id': 'req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.746256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1b0dc828-051e-4b37-a69c-148a4fa95a3f None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:44.748613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1b0dc828-051e-4b37-a69c-148a4fa95a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:44.753573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854ed71336ff4a7886e9ddf4ddde7636', 'request_id': 'req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.773546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854ed71336ff4a7886e9ddf4ddde7636', 'request_id': 'req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.799632 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9 admin admin] The token cache is being invalidate because project 854ed71336ff4a7886e9ddf4ddde7636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:44.800114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.801232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a8bd265-1924-49ba-ac0c-7ee9d61b6dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:44.807384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1005/2047] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:44 2022] DELETE /identity/v3/projects/854ed71336ff4a7886e9ddf4ddde7636 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:44.813184 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21421b2f-4da2-48bf-bdc1-648810a20b44 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:44.813826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21421b2f-4da2-48bf-bdc1-648810a20b44 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:44.814309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21421b2f-4da2-48bf-bdc1-648810a20b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:44.840711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-21421b2f-4da2-48bf-bdc1-648810a20b44 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:44.842572 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-21421b2f-4da2-48bf-bdc1-648810a20b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:44.877750 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1043/2048] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:44.883148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dc828-051e-4b37-a69c-148a4fa95a3f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:44.907051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dc828-051e-4b37-a69c-148a4fa95a3f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:44.916185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764c11e-c8a9-4a65-85a8-f819c8a5887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:44.916861 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764c11e-c8a9-4a65-85a8-f819c8a5887e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:44.917141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764c11e-c8a9-4a65-85a8-f819c8a5887e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:44.917419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764c11e-c8a9-4a65-85a8-f819c8a5887e admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:44.918087 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764c11e-c8a9-4a65-85a8-f819c8a5887e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:44.918393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764c11e-c8a9-4a65-85a8-f819c8a5887e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:44.920057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764c11e-c8a9-4a65-85a8-f819c8a5887e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:44.931572 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:44.943463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1044/2049] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:24:44.945353 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764c11e-c8a9-4a65-85a8-f819c8a5887e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:44.951347 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1006/2050] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:44.962317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f164af4-80d5-41cb-8265-8a5aed2fa265 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:44.962932 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f164af4-80d5-41cb-8265-8a5aed2fa265 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:44.964303 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f164af4-80d5-41cb-8265-8a5aed2fa265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:44.965497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764c11e-c8a9-4a65-85a8-f819c8a5887e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:44.980586 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c04169-f296-4d37-b1f1-f31f7c71a5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:44.981582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c04169-f296-4d37-b1f1-f31f7c71a5dc admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:44.982215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c04169-f296-4d37-b1f1-f31f7c71a5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:44.983340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c04169-f296-4d37-b1f1-f31f7c71a5dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:44.984839 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c04169-f296-4d37-b1f1-f31f7c71a5dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:44.988215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c04169-f296-4d37-b1f1-f31f7c71a5dc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:45.005126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5f164af4-80d5-41cb-8265-8a5aed2fa265 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:45.007304 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5f164af4-80d5-41cb-8265-8a5aed2fa265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:45.036905 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1007/2051] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:45.038368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f164af4-80d5-41cb-8265-8a5aed2fa265 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:45.040356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5f164af4-80d5-41cb-8265-8a5aed2fa265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:45.046297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1045/2052] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:44 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:45.046297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c04169-f296-4d37-b1f1-f31f7c71a5dc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:45.056462 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f164af4-80d5-41cb-8265-8a5aed2fa265 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:45.106632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:45.122294 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c04169-f296-4d37-b1f1-f31f7c71a5dc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:45.127664 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2066d-5a7c-4075-a908-4f968799c511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:45.128284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2066d-5a7c-4075-a908-4f968799c511 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.128559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2066d-5a7c-4075-a908-4f968799c511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.128905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2066d-5a7c-4075-a908-4f968799c511 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.129568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2066d-5a7c-4075-a908-4f968799c511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:45.129877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2066d-5a7c-4075-a908-4f968799c511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:45.131472 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2066d-5a7c-4075-a908-4f968799c511 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:45.135169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:45.136020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.136402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.136891 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] PATH_INFO: `/v3/projects/f5e3572c4a124e099ac170f6385d851a` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.138285 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e3572c4a124e099ac170f6385d851a)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:45.143166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:45.145969 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1046/2053] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:24:45.146934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2066d-5a7c-4075-a908-4f968799c511 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:45.161767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2066d-5a7c-4075-a908-4f968799c511 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:45.169286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e14ed4-8e77-4b4d-a999-3b9e719ea07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:45.169913 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e14ed4-8e77-4b4d-a999-3b9e719ea07f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.170355 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e14ed4-8e77-4b4d-a999-3b9e719ea07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.170533 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e14ed4-8e77-4b4d-a999-3b9e719ea07f admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.171098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e14ed4-8e77-4b4d-a999-3b9e719ea07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:45.173105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e14ed4-8e77-4b4d-a999-3b9e719ea07f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:45.224885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1047/2054] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:45 2022] POST /identity/v3/users => generated 293 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:45.224885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e14ed4-8e77-4b4d-a999-3b9e719ea07f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:45.232396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e3572c4a124e099ac170f6385d851a', 'request_id': 'req-c682c4a9-ee74-4a0b-a167-65c905bd880a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:45.235247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e14ed4-8e77-4b4d-a999-3b9e719ea07f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:45.239841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e3572c4a124e099ac170f6385d851a', 'request_id': 'req-c682c4a9-ee74-4a0b-a167-65c905bd880a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:45.246012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e3572c4a124e099ac170f6385d851a', 'request_id': 'req-c682c4a9-ee74-4a0b-a167-65c905bd880a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:45.264801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] The token cache is being invalidate because project f5e3572c4a124e099ac170f6385d851a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:45.265094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:45.269730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:45.269730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1008/2055] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:45 2022] DELETE /identity/v3/projects/f5e3572c4a124e099ac170f6385d851a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:45.273258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:45.275334 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:45.320400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911f99b-4ace-4c1f-a846-b187b5e2fb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:45.324218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911f99b-4ace-4c1f-a846-b187b5e2fb25 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.324417 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911f99b-4ace-4c1f-a846-b187b5e2fb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.325339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911f99b-4ace-4c1f-a846-b187b5e2fb25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.326158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911f99b-4ace-4c1f-a846-b187b5e2fb25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:45.330385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911f99b-4ace-4c1f-a846-b187b5e2fb25 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:45.370579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682c4a9-ee74-4a0b-a167-65c905bd880a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:45.374347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1048/2056] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:45 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:45.376527 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8daf5-2558-4aec-8c48-5cc8be2581ac None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.377079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8daf5-2558-4aec-8c48-5cc8be2581ac None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.377558 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8daf5-2558-4aec-8c48-5cc8be2581ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.380219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe8fb7-6076-40e3-a644-ceb4f062c797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:45.380901 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8fb7-6076-40e3-a644-ceb4f062c797 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.381211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8fb7-6076-40e3-a644-ceb4f062c797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.381484 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8fb7-6076-40e3-a644-ceb4f062c797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.382154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe8fb7-6076-40e3-a644-ceb4f062c797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:45.384347 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe8fb7-6076-40e3-a644-ceb4f062c797 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:45.400523 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1009/2057] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:45.400523 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe8fb7-6076-40e3-a644-ceb4f062c797 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:45.402864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-befe8fb7-6076-40e3-a644-ceb4f062c797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:45.407502 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2fc8daf5-2558-4aec-8c48-5cc8be2581ac None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:45.408825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2fc8daf5-2558-4aec-8c48-5cc8be2581ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:45.416146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe8fb7-6076-40e3-a644-ceb4f062c797 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:45.433262 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:45.498672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e25f82-9e6f-430d-8536-8e350e924b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:45.499571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e25f82-9e6f-430d-8536-8e350e924b74 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.500084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e25f82-9e6f-430d-8536-8e350e924b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.500610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e25f82-9e6f-430d-8536-8e350e924b74 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.501857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e25f82-9e6f-430d-8536-8e350e924b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:45.504973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1049/2058] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:45.506299 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8daf5-2558-4aec-8c48-5cc8be2581ac None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:45.506896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e25f82-9e6f-430d-8536-8e350e924b74 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:45.518491 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8daf5-2558-4aec-8c48-5cc8be2581ac None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:45.523536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe44f3-e08a-4bbf-8552-4059d1ffa44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:45.524310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe44f3-e08a-4bbf-8552-4059d1ffa44d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.524583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe44f3-e08a-4bbf-8552-4059d1ffa44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.524960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe44f3-e08a-4bbf-8552-4059d1ffa44d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.525763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe44f3-e08a-4bbf-8552-4059d1ffa44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:45.527456 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe44f3-e08a-4bbf-8552-4059d1ffa44d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:45.540813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1010/2059] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:45 2022] POST /identity/v3/users => generated 284 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:45.541503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1050/2060] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:45.542269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a91c84-579f-4d13-9cd6-34f17ff368fb None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.542557 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a91c84-579f-4d13-9cd6-34f17ff368fb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.542829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a91c84-579f-4d13-9cd6-34f17ff368fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.549076 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe44f3-e08a-4bbf-8552-4059d1ffa44d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:45.569575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e4a91c84-579f-4d13-9cd6-34f17ff368fb None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:45.570830 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e4a91c84-579f-4d13-9cd6-34f17ff368fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:45.574590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe44f3-e08a-4bbf-8552-4059d1ffa44d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:45.584174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65976f-3dc1-4cd8-ae3f-62c980b8ae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:45.585256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65976f-3dc1-4cd8-ae3f-62c980b8ae92 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.585822 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65976f-3dc1-4cd8-ae3f-62c980b8ae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.586357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65976f-3dc1-4cd8-ae3f-62c980b8ae92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.587797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65976f-3dc1-4cd8-ae3f-62c980b8ae92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:45.588108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1011/2061] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:45.591614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65976f-3dc1-4cd8-ae3f-62c980b8ae92 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:45.593787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a91c84-579f-4d13-9cd6-34f17ff368fb None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:45.607362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a91c84-579f-4d13-9cd6-34f17ff368fb None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:45.613179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1051/2062] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:24:45.614640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65976f-3dc1-4cd8-ae3f-62c980b8ae92 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:45.618094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225239c-c139-48e3-bfc0-bf4079d94f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:45.618769 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225239c-c139-48e3-bfc0-bf4079d94f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.619052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225239c-c139-48e3-bfc0-bf4079d94f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.619308 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225239c-c139-48e3-bfc0-bf4079d94f9f admin admin] PATH_INFO: `/v3/projects/1eea05d75a4f46bea3a086c8da9a6992/users/52b6073b6be24f0d961aca49dbcfd172/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.628863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65976f-3dc1-4cd8-ae3f-62c980b8ae92 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:45.636823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20854dc-b6c4-4b8d-bca9-3214d56e4e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:45.637964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20854dc-b6c4-4b8d-bca9-3214d56e4e13 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.638413 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20854dc-b6c4-4b8d-bca9-3214d56e4e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.638869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20854dc-b6c4-4b8d-bca9-3214d56e4e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.639972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20854dc-b6c4-4b8d-bca9-3214d56e4e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:45.640471 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20854dc-b6c4-4b8d-bca9-3214d56e4e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:45.642768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20854dc-b6c4-4b8d-bca9-3214d56e4e13 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:45.645694 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225239c-c139-48e3-bfc0-bf4079d94f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eea05d75a4f46bea3a086c8da9a6992, user_id=52b6073b6be24f0d961aca49dbcfd172, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:45.648866 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225239c-c139-48e3-bfc0-bf4079d94f9f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:45.673476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1052/2063] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:24:45.673476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20854dc-b6c4-4b8d-bca9-3214d56e4e13 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:45.678618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1012/2064] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:45 2022] PUT /identity/v3/projects/1eea05d75a4f46bea3a086c8da9a6992/users/52b6073b6be24f0d961aca49dbcfd172/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:45.678618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225239c-c139-48e3-bfc0-bf4079d94f9f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:45.694020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20854dc-b6c4-4b8d-bca9-3214d56e4e13 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:45.714512 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:45.783108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225239c-c139-48e3-bfc0-bf4079d94f9f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:45.788673 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a854b-a291-475d-a82b-492111cfb999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:45.789916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a854b-a291-475d-a82b-492111cfb999 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.790197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a854b-a291-475d-a82b-492111cfb999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.790454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a854b-a291-475d-a82b-492111cfb999 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.791129 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a854b-a291-475d-a82b-492111cfb999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:45.793109 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a854b-a291-475d-a82b-492111cfb999 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:45.810902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b4881-274b-4a78-8c41-a0eea44e93c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:45.813443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b4881-274b-4a78-8c41-a0eea44e93c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.814298 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b4881-274b-4a78-8c41-a0eea44e93c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.814536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b4881-274b-4a78-8c41-a0eea44e93c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.815482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b4881-274b-4a78-8c41-a0eea44e93c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:45.818779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b4881-274b-4a78-8c41-a0eea44e93c2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:45.834379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1013/2065] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:45 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:45.834379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3ff51-ef2d-4ca7-9848-ecec5df763d2 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.834379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3ff51-ef2d-4ca7-9848-ecec5df763d2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.834379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3ff51-ef2d-4ca7-9848-ecec5df763d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.848005 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1053/2066] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:45.851100 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b4881-274b-4a78-8c41-a0eea44e93c2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:45.868610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9dc3ff51-ef2d-4ca7-9848-ecec5df763d2 None None] MFA Rules not processed for user `52b6073b6be24f0d961aca49dbcfd172`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:45.870220 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9dc3ff51-ef2d-4ca7-9848-ecec5df763d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:45.871954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b4881-274b-4a78-8c41-a0eea44e93c2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:45.944562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:45.966481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5710501-b9c0-4e07-90b4-9838f35409cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:45.967155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710501-b9c0-4e07-90b4-9838f35409cd admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.967379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710501-b9c0-4e07-90b4-9838f35409cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.967658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710501-b9c0-4e07-90b4-9838f35409cd admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.968344 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5710501-b9c0-4e07-90b4-9838f35409cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:45.974111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5710501-b9c0-4e07-90b4-9838f35409cd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:45.974310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1014/2067] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:45.974310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3ff51-ef2d-4ca7-9848-ecec5df763d2 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:45.985431 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3ff51-ef2d-4ca7-9848-ecec5df763d2 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:45.992231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01acc21-cdff-4f22-8db1-561fc91746c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:45.993215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01acc21-cdff-4f22-8db1-561fc91746c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:45.993382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01acc21-cdff-4f22-8db1-561fc91746c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:45.993789 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01acc21-cdff-4f22-8db1-561fc91746c6 admin admin] PATH_INFO: `/v3/projects/a18492f211f3499dbef958042517277b/users/039bbc21d88f402db0714ffb3ee38366/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:45.997793 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1054/2068] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:45 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:45.999092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5710501-b9c0-4e07-90b4-9838f35409cd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:46.011214 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5710501-b9c0-4e07-90b4-9838f35409cd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:46.015049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01acc21-cdff-4f22-8db1-561fc91746c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18492f211f3499dbef958042517277b, user_id=039bbc21d88f402db0714ffb3ee38366, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:46.017602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3dcfc-47b6-4055-8679-84e81d7d3205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:46.017936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01acc21-cdff-4f22-8db1-561fc91746c6 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:46.018155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3dcfc-47b6-4055-8679-84e81d7d3205 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.018566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3dcfc-47b6-4055-8679-84e81d7d3205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.019051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3dcfc-47b6-4055-8679-84e81d7d3205 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.020079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3dcfc-47b6-4055-8679-84e81d7d3205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:46.028941 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3dcfc-47b6-4055-8679-84e81d7d3205 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:46.046822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1015/2069] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:45 2022] PUT /identity/v3/projects/a18492f211f3499dbef958042517277b/users/039bbc21d88f402db0714ffb3ee38366/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:46.048221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01acc21-cdff-4f22-8db1-561fc91746c6 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:46.085116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1055/2070] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:45 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:46.088227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3760a-cedc-4979-a2ac-2ade0b4b4068 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.088782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3760a-cedc-4979-a2ac-2ade0b4b4068 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.089276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3760a-cedc-4979-a2ac-2ade0b4b4068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.143420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01acc21-cdff-4f22-8db1-561fc91746c6 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:46.147055 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-aef3760a-cedc-4979-a2ac-2ade0b4b4068 None None] MFA Rules not processed for user `039bbc21d88f402db0714ffb3ee38366`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:46.149608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aef3760a-cedc-4979-a2ac-2ade0b4b4068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:46.215207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0758e1-6750-4359-9644-06d5f440c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:46.215838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0758e1-6750-4359-9644-06d5f440c9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.216123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0758e1-6750-4359-9644-06d5f440c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.216397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0758e1-6750-4359-9644-06d5f440c9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.217357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0758e1-6750-4359-9644-06d5f440c9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:46.219026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0758e1-6750-4359-9644-06d5f440c9f2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:46.233104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1016/2071] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:46.234342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0758e1-6750-4359-9644-06d5f440c9f2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:46.248569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0758e1-6750-4359-9644-06d5f440c9f2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:46.254959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae078d9-0887-40c9-9982-72120213f45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:46.255543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae078d9-0887-40c9-9982-72120213f45c admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.255829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae078d9-0887-40c9-9982-72120213f45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.256101 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae078d9-0887-40c9-9982-72120213f45c admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.256794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae078d9-0887-40c9-9982-72120213f45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:46.259403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae078d9-0887-40c9-9982-72120213f45c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:46.260645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1056/2072] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:46.262309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3760a-cedc-4979-a2ac-2ade0b4b4068 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:46.275036 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3760a-cedc-4979-a2ac-2ade0b4b4068 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:46.280105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fb09b-118d-4aad-90d5-0f504735cf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:46.280776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fb09b-118d-4aad-90d5-0f504735cf00 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.281098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fb09b-118d-4aad-90d5-0f504735cf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.281342 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fb09b-118d-4aad-90d5-0f504735cf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.282011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288fb09b-118d-4aad-90d5-0f504735cf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:46.283679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288fb09b-118d-4aad-90d5-0f504735cf00 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:46.286479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:46.295534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1017/2073] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:46 2022] POST /identity/v3/users => generated 293 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:46.296161 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae078d9-0887-40c9-9982-72120213f45c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:46.299961 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1057/2074] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:46.301493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fb09b-118d-4aad-90d5-0f504735cf00 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:46.316581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fb09b-118d-4aad-90d5-0f504735cf00 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:46.326157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99535af-be8c-4316-bd7a-202ccb145d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:46.326157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99535af-be8c-4316-bd7a-202ccb145d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.326612 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99535af-be8c-4316-bd7a-202ccb145d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.326778 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99535af-be8c-4316-bd7a-202ccb145d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.327122 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae078d9-0887-40c9-9982-72120213f45c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:46.327654 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99535af-be8c-4316-bd7a-202ccb145d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:46.329379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99535af-be8c-4316-bd7a-202ccb145d28 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:46.340041 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3028f1-759f-4a87-9a3f-f6e7456e6ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:46.341073 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3028f1-759f-4a87-9a3f-f6e7456e6ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.341579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3028f1-759f-4a87-9a3f-f6e7456e6ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.342020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3028f1-759f-4a87-9a3f-f6e7456e6ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.343068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3028f1-759f-4a87-9a3f-f6e7456e6ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:46.358295 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3028f1-759f-4a87-9a3f-f6e7456e6ba9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:46.360772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1058/2075] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:46.361965 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99535af-be8c-4316-bd7a-202ccb145d28 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:46.380098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99535af-be8c-4316-bd7a-202ccb145d28 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:46.386778 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f083835-bfc0-41d4-aa7a-65195e89445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:46.387455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f083835-bfc0-41d4-aa7a-65195e89445a admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.387734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f083835-bfc0-41d4-aa7a-65195e89445a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.388008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f083835-bfc0-41d4-aa7a-65195e89445a admin admin] PATH_INFO: `/v3/projects/1201b4235bd8435990ad6e157790b961/users/a230eb7eaafd43bea74d4a8909676f1f/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.429500 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f083835-bfc0-41d4-aa7a-65195e89445a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1201b4235bd8435990ad6e157790b961, user_id=a230eb7eaafd43bea74d4a8909676f1f, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:46.434009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f083835-bfc0-41d4-aa7a-65195e89445a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:46.434506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1018/2076] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:46 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:46.436119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3028f1-759f-4a87-9a3f-f6e7456e6ba9 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:46.469649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1059/2077] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:46 2022] PUT /identity/v3/projects/1201b4235bd8435990ad6e157790b961/users/a230eb7eaafd43bea74d4a8909676f1f/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:46.473759 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f083835-bfc0-41d4-aa7a-65195e89445a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:46.502532 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:46.542705 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3028f1-759f-4a87-9a3f-f6e7456e6ba9 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:46.564724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f083835-bfc0-41d4-aa7a-65195e89445a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:46.570978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b2dd4-385e-4e8a-babb-f28254ab611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:46.571730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b2dd4-385e-4e8a-babb-f28254ab611b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.572006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b2dd4-385e-4e8a-babb-f28254ab611b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.572273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b2dd4-385e-4e8a-babb-f28254ab611b admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.572937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b2dd4-385e-4e8a-babb-f28254ab611b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:46.574888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b2dd4-385e-4e8a-babb-f28254ab611b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:46.622948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1060/2078] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:46 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:46.624850 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270e027-622b-4adb-8968-2e08405e382e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.625448 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270e027-622b-4adb-8968-2e08405e382e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.626014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270e027-622b-4adb-8968-2e08405e382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.628897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b67a2d-f364-4c2d-aed4-1d17fd57d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:46.630036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b67a2d-f364-4c2d-aed4-1d17fd57d512 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.630659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b67a2d-f364-4c2d-aed4-1d17fd57d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.631150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b67a2d-f364-4c2d-aed4-1d17fd57d512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.632231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b67a2d-f364-4c2d-aed4-1d17fd57d512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:46.634869 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b67a2d-f364-4c2d-aed4-1d17fd57d512 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:46.659939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1019/2079] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:46.659939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b67a2d-f364-4c2d-aed4-1d17fd57d512 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:46.662472 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5270e027-622b-4adb-8968-2e08405e382e None None] MFA Rules not processed for user `a230eb7eaafd43bea74d4a8909676f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:46.665264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5270e027-622b-4adb-8968-2e08405e382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:46.684789 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b67a2d-f364-4c2d-aed4-1d17fd57d512 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:46.693255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa1c59-cc19-45b8-8090-c6f54ddbf1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:46.694428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa1c59-cc19-45b8-8090-c6f54ddbf1ad admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.694956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa1c59-cc19-45b8-8090-c6f54ddbf1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.695532 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa1c59-cc19-45b8-8090-c6f54ddbf1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.696871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa1c59-cc19-45b8-8090-c6f54ddbf1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:46.699530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa1c59-cc19-45b8-8090-c6f54ddbf1ad admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:46.719020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1020/2080] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:46.719849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa1c59-cc19-45b8-8090-c6f54ddbf1ad admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:46.737763 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa1c59-cc19-45b8-8090-c6f54ddbf1ad admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:46.744962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c448575-cce8-479c-9976-117b22d00cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:46.745994 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c448575-cce8-479c-9976-117b22d00cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.746267 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c448575-cce8-479c-9976-117b22d00cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.746663 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c448575-cce8-479c-9976-117b22d00cf2 admin admin] PATH_INFO: `/v3/projects/de05f9f70b2c41898b7c07a2f7a02441/users/8e164d40c28e449f81e97b2b35221ed8/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.765688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c448575-cce8-479c-9976-117b22d00cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de05f9f70b2c41898b7c07a2f7a02441, user_id=8e164d40c28e449f81e97b2b35221ed8, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:46.768401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c448575-cce8-479c-9976-117b22d00cf2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:46.787322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1061/2081] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:46.787322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270e027-622b-4adb-8968-2e08405e382e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:46.801384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1021/2082] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:46 2022] PUT /identity/v3/projects/de05f9f70b2c41898b7c07a2f7a02441/users/8e164d40c28e449f81e97b2b35221ed8/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:46.802954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270e027-622b-4adb-8968-2e08405e382e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:46.803140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abdbee-e8c7-45b2-b544-884ffb1cd294 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.803409 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abdbee-e8c7-45b2-b544-884ffb1cd294 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.803658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abdbee-e8c7-45b2-b544-884ffb1cd294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.839319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-28abdbee-e8c7-45b2-b544-884ffb1cd294 None None] MFA Rules not processed for user `8e164d40c28e449f81e97b2b35221ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:46.840545 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-28abdbee-e8c7-45b2-b544-884ffb1cd294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:46.871095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:46.895983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadd729-df9c-48bb-b806-3aefae2f1be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:46.896661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadd729-df9c-48bb-b806-3aefae2f1be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:46.896974 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadd729-df9c-48bb-b806-3aefae2f1be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:46.897244 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadd729-df9c-48bb-b806-3aefae2f1be9 admin admin] PATH_INFO: `/v3/projects/b042c8b3c7fc42b7b7815c552fe8fbbc/users/318fdea198c444549760be21ef26a179/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:46.917042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadd729-df9c-48bb-b806-3aefae2f1be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b042c8b3c7fc42b7b7815c552fe8fbbc, user_id=318fdea198c444549760be21ef26a179, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:46.919785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadd729-df9c-48bb-b806-3aefae2f1be9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:46.930756 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1022/2083] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:46.933111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abdbee-e8c7-45b2-b544-884ffb1cd294 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:46.935086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-28abdbee-e8c7-45b2-b544-884ffb1cd294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:46.950445 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1062/2084] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:46 2022] PUT /identity/v3/projects/b042c8b3c7fc42b7b7815c552fe8fbbc/users/318fdea198c444549760be21ef26a179/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:46.952289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadd729-df9c-48bb-b806-3aefae2f1be9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:46.979466 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:47.021209 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abdbee-e8c7-45b2-b544-884ffb1cd294 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:47.072951 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadd729-df9c-48bb-b806-3aefae2f1be9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:47.080259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e59f86-f120-4d52-aee2-e41702049acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:47.081113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e59f86-f120-4d52-aee2-e41702049acf admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:47.081831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e59f86-f120-4d52-aee2-e41702049acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:47.082171 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e59f86-f120-4d52-aee2-e41702049acf admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:47.083549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e59f86-f120-4d52-aee2-e41702049acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:47.085183 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e59f86-f120-4d52-aee2-e41702049acf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:47.127465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ec108-f291-4f0c-8d7b-ffcbb9eed7bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:47.128663 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ec108-f291-4f0c-8d7b-ffcbb9eed7bd service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:47.129175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ec108-f291-4f0c-8d7b-ffcbb9eed7bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:47.129857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ec108-f291-4f0c-8d7b-ffcbb9eed7bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:47.140969 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1063/2085] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:46 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:47.142130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e59f86-f120-4d52-aee2-e41702049acf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:47.213366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ec108-f291-4f0c-8d7b-ffcbb9eed7bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:47.215589 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ec108-f291-4f0c-8d7b-ffcbb9eed7bd service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:47.225950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1023/2086] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:47.227639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ec108-f291-4f0c-8d7b-ffcbb9eed7bd service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:47.251295 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ec108-f291-4f0c-8d7b-ffcbb9eed7bd service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:47.255883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e59f86-f120-4d52-aee2-e41702049acf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:47.256049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f06652-4825-4651-8455-f28df15d73ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:47.256792 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f06652-4825-4651-8455-f28df15d73ff admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:47.257176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f06652-4825-4651-8455-f28df15d73ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:47.257460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f06652-4825-4651-8455-f28df15d73ff admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:47.258720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f06652-4825-4651-8455-f28df15d73ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:47.260675 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f06652-4825-4651-8455-f28df15d73ff admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:47.262140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6b7e9-124a-4494-89e2-da09df7cb3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:47.262843 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6b7e9-124a-4494-89e2-da09df7cb3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:47.263116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6b7e9-124a-4494-89e2-da09df7cb3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:47.263526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6b7e9-124a-4494-89e2-da09df7cb3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:47.264126 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6b7e9-124a-4494-89e2-da09df7cb3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:47.265873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6b7e9-124a-4494-89e2-da09df7cb3f7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:47.282086 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1064/2087] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:47.282970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6b7e9-124a-4494-89e2-da09df7cb3f7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:47.292420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1024/2088] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:47 2022] POST /identity/v3/users => generated 299 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:47.292420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f06652-4825-4651-8455-f28df15d73ff admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:47.294221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6b7e9-124a-4494-89e2-da09df7cb3f7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:47.303639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f06652-4825-4651-8455-f28df15d73ff admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:47.308874 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff8e41-86dd-4cc1-8b4f-894d4be65cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:47.309535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8e41-86dd-4cc1-8b4f-894d4be65cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:47.309815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8e41-86dd-4cc1-8b4f-894d4be65cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:47.310085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8e41-86dd-4cc1-8b4f-894d4be65cf1 admin admin] PATH_INFO: `/v3/users/a230eb7eaafd43bea74d4a8909676f1f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:47.310641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe539f68-5d21-4e56-8002-0c90e37a4493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:47.311308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff8e41-86dd-4cc1-8b4f-894d4be65cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a230eb7eaafd43bea74d4a8909676f1f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:47.311647 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe539f68-5d21-4e56-8002-0c90e37a4493 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:47.312067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe539f68-5d21-4e56-8002-0c90e37a4493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:47.312648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe539f68-5d21-4e56-8002-0c90e37a4493 admin admin] PATH_INFO: `/v3/projects/b042c8b3c7fc42b7b7815c552fe8fbbc/users/318fdea198c444549760be21ef26a179/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:47.313283 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff8e41-86dd-4cc1-8b4f-894d4be65cf1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:47.315017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe539f68-5d21-4e56-8002-0c90e37a4493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b042c8b3c7fc42b7b7815c552fe8fbbc, user_id=318fdea198c444549760be21ef26a179, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:47.318126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe539f68-5d21-4e56-8002-0c90e37a4493 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:47.330665 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1025/2089] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:47 2022] PUT /identity/v3/projects/b042c8b3c7fc42b7b7815c552fe8fbbc/users/318fdea198c444549760be21ef26a179/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:47.332094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe539f68-5d21-4e56-8002-0c90e37a4493 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:47.387249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:47.391754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f7ff8e41-86dd-4cc1-8b4f-894d4be65cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a230eb7eaafd43bea74d4a8909676f1f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:47.393017 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f7ff8e41-86dd-4cc1-8b4f-894d4be65cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a230eb7eaafd43bea74d4a8909676f1f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:47.417605 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f7ff8e41-86dd-4cc1-8b4f-894d4be65cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a230eb7eaafd43bea74d4a8909676f1f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:47.429163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f7ff8e41-86dd-4cc1-8b4f-894d4be65cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a230eb7eaafd43bea74d4a8909676f1f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:47.430969 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f7ff8e41-86dd-4cc1-8b4f-894d4be65cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a230eb7eaafd43bea74d4a8909676f1f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:47.474670 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1065/2090] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:47 2022] DELETE /identity/v3/users/a230eb7eaafd43bea74d4a8909676f1f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:47.476370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a247f68-39f1-4cdc-b0db-c8b5ea0912c8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:47.477301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a247f68-39f1-4cdc-b0db-c8b5ea0912c8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:47.477560 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a247f68-39f1-4cdc-b0db-c8b5ea0912c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:47.480863 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe539f68-5d21-4e56-8002-0c90e37a4493 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:47.513556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:47.516399 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4a247f68-39f1-4cdc-b0db-c8b5ea0912c8 None None] MFA Rules not processed for user `318fdea198c444549760be21ef26a179`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:47.529368 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4a247f68-39f1-4cdc-b0db-c8b5ea0912c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:47.615549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3c07c-57ed-46e7-926b-f34fee328860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:47.617745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3c07c-57ed-46e7-926b-f34fee328860 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:47.618306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3c07c-57ed-46e7-926b-f34fee328860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:47.618782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3c07c-57ed-46e7-926b-f34fee328860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:47.619674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3c07c-57ed-46e7-926b-f34fee328860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:47.621624 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3c07c-57ed-46e7-926b-f34fee328860 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:47.637058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1026/2091] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:47.639140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a461848-f032-4ed5-b572-ab3903ec1824 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:47.639534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a461848-f032-4ed5-b572-ab3903ec1824 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:47.639962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a461848-f032-4ed5-b572-ab3903ec1824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:47.662233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2a461848-f032-4ed5-b572-ab3903ec1824 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:47.663605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2a461848-f032-4ed5-b572-ab3903ec1824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:47.681974 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1027/2092] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:47.685438 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a461848-f032-4ed5-b572-ab3903ec1824 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:47.685438 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2a461848-f032-4ed5-b572-ab3903ec1824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:47.698752 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1066/2093] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:47.699188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a461848-f032-4ed5-b572-ab3903ec1824 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:47.700300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a247f68-39f1-4cdc-b0db-c8b5ea0912c8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:47.702524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4a247f68-39f1-4cdc-b0db-c8b5ea0912c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:47.705272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22534fb-72fc-43c2-83a9-2cbc2609e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:47.706029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22534fb-72fc-43c2-83a9-2cbc2609e488 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:47.706749 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22534fb-72fc-43c2-83a9-2cbc2609e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:47.707105 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22534fb-72fc-43c2-83a9-2cbc2609e488 admin admin] PATH_INFO: `/v3/projects/4a04f83533f14d18bdb2ccc00a54b576/users/077ac83f06a34c808945d234db30354a/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:47.726044 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22534fb-72fc-43c2-83a9-2cbc2609e488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a04f83533f14d18bdb2ccc00a54b576, user_id=077ac83f06a34c808945d234db30354a, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:47.729259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22534fb-72fc-43c2-83a9-2cbc2609e488 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:47.749734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1028/2094] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:47 2022] PUT /identity/v3/projects/4a04f83533f14d18bdb2ccc00a54b576/users/077ac83f06a34c808945d234db30354a/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:47.753341 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22534fb-72fc-43c2-83a9-2cbc2609e488 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:47.755100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f22534fb-72fc-43c2-83a9-2cbc2609e488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:47.802337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a247f68-39f1-4cdc-b0db-c8b5ea0912c8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:47.824255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22534fb-72fc-43c2-83a9-2cbc2609e488 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:47.828871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5aa33-5c95-421b-b15f-9722e41ad9e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:47.829887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5aa33-5c95-421b-b15f-9722e41ad9e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:47.830110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5aa33-5c95-421b-b15f-9722e41ad9e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:47.830734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5aa33-5c95-421b-b15f-9722e41ad9e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:47.871770 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df8fc6-ba36-41a8-91e9-20235c127f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:47.872760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df8fc6-ba36-41a8-91e9-20235c127f14 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:47.873233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df8fc6-ba36-41a8-91e9-20235c127f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:47.873689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df8fc6-ba36-41a8-91e9-20235c127f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:47.889249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:47.916522 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5aa33-5c95-421b-b15f-9722e41ad9e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:47.918413 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5aa33-5c95-421b-b15f-9722e41ad9e5 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:47.934625 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1029/2095] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:47.941287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5aa33-5c95-421b-b15f-9722e41ad9e5 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:48.003658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:48.009068 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df8fc6-ba36-41a8-91e9-20235c127f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:48.011405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df8fc6-ba36-41a8-91e9-20235c127f14 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:48.031665 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1067/2096] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:48.051847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5aa33-5c95-421b-b15f-9722e41ad9e5 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:48.057454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031823b2-3985-4b3e-9c99-ea0667f18186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:48.058231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031823b2-3985-4b3e-9c99-ea0667f18186 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:48.058497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031823b2-3985-4b3e-9c99-ea0667f18186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:48.058771 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031823b2-3985-4b3e-9c99-ea0667f18186 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:48.060080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031823b2-3985-4b3e-9c99-ea0667f18186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:48.062194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031823b2-3985-4b3e-9c99-ea0667f18186 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:48.075072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1030/2097] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:48.079161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df8fc6-ba36-41a8-91e9-20235c127f14 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:48.089210 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031823b2-3985-4b3e-9c99-ea0667f18186 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:48.092323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df8fc6-ba36-41a8-91e9-20235c127f14 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:48.103671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031823b2-3985-4b3e-9c99-ea0667f18186 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:48.107680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33939621-17db-4df6-a1db-cf97360f61f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:48.108358 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33939621-17db-4df6-a1db-cf97360f61f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:48.108644 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33939621-17db-4df6-a1db-cf97360f61f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:48.109631 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33939621-17db-4df6-a1db-cf97360f61f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:48.111645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-33939621-17db-4df6-a1db-cf97360f61f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:48.117089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad09e7-36a8-4a2b-84bc-f30ab4c7bdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:48.118804 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad09e7-36a8-4a2b-84bc-f30ab4c7bdd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:48.119305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad09e7-36a8-4a2b-84bc-f30ab4c7bdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:48.121481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad09e7-36a8-4a2b-84bc-f30ab4c7bdd0 admin admin] PATH_INFO: `/v3/projects/4a04f83533f14d18bdb2ccc00a54b576/users/077ac83f06a34c808945d234db30354a/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:48.128463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad09e7-36a8-4a2b-84bc-f30ab4c7bdd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a04f83533f14d18bdb2ccc00a54b576, user_id=077ac83f06a34c808945d234db30354a, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:48.142541 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad09e7-36a8-4a2b-84bc-f30ab4c7bdd0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:48.183497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1068/2098] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:48 2022] PUT /identity/v3/projects/4a04f83533f14d18bdb2ccc00a54b576/users/077ac83f06a34c808945d234db30354a/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:48.200598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73196e-b8b9-4989-ae9c-fc9d30642443 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:48.201240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73196e-b8b9-4989-ae9c-fc9d30642443 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:48.201643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73196e-b8b9-4989-ae9c-fc9d30642443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:48.229245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33939621-17db-4df6-a1db-cf97360f61f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:48.231395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33939621-17db-4df6-a1db-cf97360f61f1 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:48.240042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0e73196e-b8b9-4989-ae9c-fc9d30642443 None None] MFA Rules not processed for user `077ac83f06a34c808945d234db30354a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:48.241738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0e73196e-b8b9-4989-ae9c-fc9d30642443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:48.263109 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1031/2099] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:24:48.360895 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1069/2100] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:48.361361 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33939621-17db-4df6-a1db-cf97360f61f1 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:48.362836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-33939621-17db-4df6-a1db-cf97360f61f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:48.381106 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33939621-17db-4df6-a1db-cf97360f61f1 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:48.495687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32786d78-4e08-41d9-9049-b6d3cfec4c74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:48.496829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32786d78-4e08-41d9-9049-b6d3cfec4c74 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:48.497507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32786d78-4e08-41d9-9049-b6d3cfec4c74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:48.497853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32786d78-4e08-41d9-9049-b6d3cfec4c74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:48.500979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-32786d78-4e08-41d9-9049-b6d3cfec4c74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:48.603231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32786d78-4e08-41d9-9049-b6d3cfec4c74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:48.605282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73196e-b8b9-4989-ae9c-fc9d30642443 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:48.605708 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32786d78-4e08-41d9-9049-b6d3cfec4c74 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:48.607468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0e73196e-b8b9-4989-ae9c-fc9d30642443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:48.619431 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1032/2101] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:24:48.771980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73196e-b8b9-4989-ae9c-fc9d30642443 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:48.784909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d3b12-c728-48fa-be2e-59c3817e6617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:48.784909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d3b12-c728-48fa-be2e-59c3817e6617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:48.785120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d3b12-c728-48fa-be2e-59c3817e6617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:48.785316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d3b12-c728-48fa-be2e-59c3817e6617 admin admin] PATH_INFO: `/v3/projects/1201b4235bd8435990ad6e157790b961` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:48.787917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d3b12-c728-48fa-be2e-59c3817e6617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1201b4235bd8435990ad6e157790b961)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:48.790391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d3b12-c728-48fa-be2e-59c3817e6617 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:48.830000 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:48.874303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bf1d3b12-c728-48fa-be2e-59c3817e6617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1201b4235bd8435990ad6e157790b961', 'request_id': 'req-bf1d3b12-c728-48fa-be2e-59c3817e6617'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:48.894380 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bf1d3b12-c728-48fa-be2e-59c3817e6617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1201b4235bd8435990ad6e157790b961', 'request_id': 'req-bf1d3b12-c728-48fa-be2e-59c3817e6617'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:48.909052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bf1d3b12-c728-48fa-be2e-59c3817e6617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1201b4235bd8435990ad6e157790b961', 'request_id': 'req-bf1d3b12-c728-48fa-be2e-59c3817e6617'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:48.929606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bf1d3b12-c728-48fa-be2e-59c3817e6617 admin admin] The token cache is being invalidate because project 1201b4235bd8435990ad6e157790b961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:48.930541 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bf1d3b12-c728-48fa-be2e-59c3817e6617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:48.931181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bf1d3b12-c728-48fa-be2e-59c3817e6617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:48.933067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1070/2102] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:48 2022] DELETE /identity/v3/projects/1201b4235bd8435990ad6e157790b961 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:24:48.937675 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643971-c628-47e8-99f6-c2b5fff1f5ec None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:48.938169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643971-c628-47e8-99f6-c2b5fff1f5ec None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:48.938248 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643971-c628-47e8-99f6-c2b5fff1f5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:48.965122 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-74643971-c628-47e8-99f6-c2b5fff1f5ec None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:48.966369 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-74643971-c628-47e8-99f6-c2b5fff1f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:48.983635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:49.043042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1033/2103] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:49.051324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf635afb-f8ea-4d0b-aa87-4e56f49df47a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:49.051526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf635afb-f8ea-4d0b-aa87-4e56f49df47a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:49.051830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf635afb-f8ea-4d0b-aa87-4e56f49df47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:49.073993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cf635afb-f8ea-4d0b-aa87-4e56f49df47a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:49.075357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cf635afb-f8ea-4d0b-aa87-4e56f49df47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:49.095513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1071/2104] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:49.099466 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74643971-c628-47e8-99f6-c2b5fff1f5ec None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:49.117297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74643971-c628-47e8-99f6-c2b5fff1f5ec None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:49.128651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b705bb-58e4-404c-889f-330c14452e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:49.130131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b705bb-58e4-404c-889f-330c14452e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:49.130765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b705bb-58e4-404c-889f-330c14452e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:49.131402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b705bb-58e4-404c-889f-330c14452e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:49.133222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b705bb-58e4-404c-889f-330c14452e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:49.134090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b705bb-58e4-404c-889f-330c14452e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:49.140074 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b705bb-58e4-404c-889f-330c14452e8d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:49.169908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1034/2105] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:24:49.174125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf635afb-f8ea-4d0b-aa87-4e56f49df47a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:49.185263 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf635afb-f8ea-4d0b-aa87-4e56f49df47a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:49.190023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b05845-f0a4-4fb5-bc19-a255bd44ff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:49.190658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b05845-f0a4-4fb5-bc19-a255bd44ff99 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:49.190929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b05845-f0a4-4fb5-bc19-a255bd44ff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:49.191198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b05845-f0a4-4fb5-bc19-a255bd44ff99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:49.191846 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b05845-f0a4-4fb5-bc19-a255bd44ff99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:49.193776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b05845-f0a4-4fb5-bc19-a255bd44ff99 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:49.224716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1072/2106] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:49 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:49.229311 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b705bb-58e4-404c-889f-330c14452e8d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:49.241586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b705bb-58e4-404c-889f-330c14452e8d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:49.323177 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17779f70-2281-4d10-9b26-3879af3d4750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:49.323794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17779f70-2281-4d10-9b26-3879af3d4750 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:49.324077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17779f70-2281-4d10-9b26-3879af3d4750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:49.324350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17779f70-2281-4d10-9b26-3879af3d4750 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:49.325180 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17779f70-2281-4d10-9b26-3879af3d4750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:49.327323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17779f70-2281-4d10-9b26-3879af3d4750 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:49.357229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1035/2107] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:49 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:49.358628 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b05845-f0a4-4fb5-bc19-a255bd44ff99 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:49.372901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b05845-f0a4-4fb5-bc19-a255bd44ff99 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:49.378483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c438cd-24c7-4f2a-872f-c02c2e16efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:49.379112 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c438cd-24c7-4f2a-872f-c02c2e16efe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:49.379491 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c438cd-24c7-4f2a-872f-c02c2e16efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:49.380055 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c438cd-24c7-4f2a-872f-c02c2e16efe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:49.380730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c438cd-24c7-4f2a-872f-c02c2e16efe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:49.382338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c438cd-24c7-4f2a-872f-c02c2e16efe6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:49.394065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1073/2108] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:24:49.398166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17779f70-2281-4d10-9b26-3879af3d4750 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:49.408612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17779f70-2281-4d10-9b26-3879af3d4750 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:49.413540 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb88f8-61e1-4302-b4ea-acf12d593dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:49.414711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb88f8-61e1-4302-b4ea-acf12d593dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:49.414993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb88f8-61e1-4302-b4ea-acf12d593dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:49.415259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb88f8-61e1-4302-b4ea-acf12d593dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:49.415900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb88f8-61e1-4302-b4ea-acf12d593dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:49.417535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb88f8-61e1-4302-b4ea-acf12d593dd7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:49.428651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1036/2109] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:49.432497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c438cd-24c7-4f2a-872f-c02c2e16efe6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:49.442649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c438cd-24c7-4f2a-872f-c02c2e16efe6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:49.448189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40007d82-3690-48d0-b094-829b59728d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:49.448908 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40007d82-3690-48d0-b094-829b59728d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:49.449181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40007d82-3690-48d0-b094-829b59728d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:49.449888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40007d82-3690-48d0-b094-829b59728d9b admin admin] PATH_INFO: `/v3/projects/f473f913e2bc474a8be784800372a701/users/33aa590f713f4b43971f9fbd4a62ba1a/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:49.466434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40007d82-3690-48d0-b094-829b59728d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f473f913e2bc474a8be784800372a701, user_id=33aa590f713f4b43971f9fbd4a62ba1a, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:49.469190 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40007d82-3690-48d0-b094-829b59728d9b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:49.482416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1074/2110] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:49 2022] PUT /identity/v3/projects/f473f913e2bc474a8be784800372a701/users/33aa590f713f4b43971f9fbd4a62ba1a/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:24:49.493982 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d391c7-9c7f-4cb0-b3aa-3b8f28ce9f36 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:49.494262 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d391c7-9c7f-4cb0-b3aa-3b8f28ce9f36 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:49.494528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d391c7-9c7f-4cb0-b3aa-3b8f28ce9f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:49.526254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-18d391c7-9c7f-4cb0-b3aa-3b8f28ce9f36 None None] MFA Rules not processed for user `33aa590f713f4b43971f9fbd4a62ba1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:49.527511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-18d391c7-9c7f-4cb0-b3aa-3b8f28ce9f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:49.595702 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1037/2111] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:49.608808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40007d82-3690-48d0-b094-829b59728d9b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:49.610672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-40007d82-3690-48d0-b094-829b59728d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:49.678341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40007d82-3690-48d0-b094-829b59728d9b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:49.683652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57210ca0-53b9-4392-b5ff-649d97a40206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:49.684326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210ca0-53b9-4392-b5ff-649d97a40206 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:49.684610 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210ca0-53b9-4392-b5ff-649d97a40206 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:49.685862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210ca0-53b9-4392-b5ff-649d97a40206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:49.702177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57210ca0-53b9-4392-b5ff-649d97a40206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:49.704797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57210ca0-53b9-4392-b5ff-649d97a40206 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:49.720619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1075/2112] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:50.693110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d391c7-9c7f-4cb0-b3aa-3b8f28ce9f36 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:50.694531 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-18d391c7-9c7f-4cb0-b3aa-3b8f28ce9f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:50.703040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543cfed-fc13-4d5c-acdc-f2cc3f754669 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:50.703565 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543cfed-fc13-4d5c-acdc-f2cc3f754669 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:50.703565 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543cfed-fc13-4d5c-acdc-f2cc3f754669 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:50.705241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1076/2113] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 21 16:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 16:24:50.708468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d391c7-9c7f-4cb0-b3aa-3b8f28ce9f36 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:50.712539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e830e-8902-406b-8e49-6daf500d81a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:50.713563 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e830e-8902-406b-8e49-6daf500d81a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:50.713980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e830e-8902-406b-8e49-6daf500d81a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:50.714421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e830e-8902-406b-8e49-6daf500d81a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:50.717068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5d2e830e-8902-406b-8e49-6daf500d81a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:50.726406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ebaf0-4ffc-4733-a149-385710dba44b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:50.726854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ebaf0-4ffc-4733-a149-385710dba44b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:50.727233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ebaf0-4ffc-4733-a149-385710dba44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:50.731019 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:50.751727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-080ebaf0-4ffc-4733-a149-385710dba44b None None] MFA Rules not processed for user `7cd3076ca5a84ff7ada13065f9531f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:50.753391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-080ebaf0-4ffc-4733-a149-385710dba44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:50.788978 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e830e-8902-406b-8e49-6daf500d81a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:50.790701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e830e-8902-406b-8e49-6daf500d81a8 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:50.812163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:50.813043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1038/2114] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:50.814039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e830e-8902-406b-8e49-6daf500d81a8 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:50.815752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5d2e830e-8902-406b-8e49-6daf500d81a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:50.848497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1077/2115] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 21 16:24:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:50.861871 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ebaf0-4ffc-4733-a149-385710dba44b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:50.863585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-080ebaf0-4ffc-4733-a149-385710dba44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:50.886249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ebaf0-4ffc-4733-a149-385710dba44b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:50.891853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73873396-cae8-4977-bcbc-bbd5faafab7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd3076ca5a84ff7ada13065f9531f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:50.892463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873396-cae8-4977-bcbc-bbd5faafab7b service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:50.892766 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873396-cae8-4977-bcbc-bbd5faafab7b service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:50.893038 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873396-cae8-4977-bcbc-bbd5faafab7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:50.902011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73873396-cae8-4977-bcbc-bbd5faafab7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:50.903575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73873396-cae8-4977-bcbc-bbd5faafab7b service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:50.916307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1078/2116] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:50.918123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e830e-8902-406b-8e49-6daf500d81a8 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:50.924144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caf086-595b-47d5-9012-1aa106968e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:50.924843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caf086-595b-47d5-9012-1aa106968e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:50.925123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caf086-595b-47d5-9012-1aa106968e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:50.925409 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caf086-595b-47d5-9012-1aa106968e58 admin admin] PATH_INFO: `/v3/users/2e22e9e7fbf1419b8359f38b4a0f154e` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:50.926543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caf086-595b-47d5-9012-1aa106968e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e22e9e7fbf1419b8359f38b4a0f154e)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:50.928507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caf086-595b-47d5-9012-1aa106968e58 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:50.985562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-37caf086-595b-47d5-9012-1aa106968e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e22e9e7fbf1419b8359f38b4a0f154e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:50.986272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-37caf086-595b-47d5-9012-1aa106968e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e22e9e7fbf1419b8359f38b4a0f154e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:50.987175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-37caf086-595b-47d5-9012-1aa106968e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e22e9e7fbf1419b8359f38b4a0f154e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:50.996824 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-37caf086-595b-47d5-9012-1aa106968e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e22e9e7fbf1419b8359f38b4a0f154e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:51.010857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-37caf086-595b-47d5-9012-1aa106968e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e22e9e7fbf1419b8359f38b4a0f154e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:51.024117 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1039/2117] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:50 2022] DELETE /identity/v3/users/2e22e9e7fbf1419b8359f38b4a0f154e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:51.251526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73873396-cae8-4977-bcbc-bbd5faafab7b service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:51.275742 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73873396-cae8-4977-bcbc-bbd5faafab7b service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:51.386094 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:51.387120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:51.387637 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:51.388005 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] PATH_INFO: `/v3/projects/8129ced583d0478ab61b6564643cf4c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:51.389956 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8129ced583d0478ab61b6564643cf4c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:51.393454 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:51.530039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8129ced583d0478ab61b6564643cf4c5', 'request_id': 'req-90c52afa-cd54-4df0-ae20-bed94c58eca0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:51.552382 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8129ced583d0478ab61b6564643cf4c5', 'request_id': 'req-90c52afa-cd54-4df0-ae20-bed94c58eca0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:51.568159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8129ced583d0478ab61b6564643cf4c5', 'request_id': 'req-90c52afa-cd54-4df0-ae20-bed94c58eca0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:51.610392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] The token cache is being invalidate because project 8129ced583d0478ab61b6564643cf4c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:51.611122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:51.612233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:51.620598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1079/2118] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:51 2022] DELETE /identity/v3/projects/8129ced583d0478ab61b6564643cf4c5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:51.628916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c89344-3e43-4ea7-a6b6-aedfcc9655ca None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:51.629595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c89344-3e43-4ea7-a6b6-aedfcc9655ca None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:51.630086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c89344-3e43-4ea7-a6b6-aedfcc9655ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:51.682068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d3c89344-3e43-4ea7-a6b6-aedfcc9655ca None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:51.683328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d3c89344-3e43-4ea7-a6b6-aedfcc9655ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:51.694384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:51.695872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:51.738702 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:51.784565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1040/2119] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:51.797575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c52afa-cd54-4df0-ae20-bed94c58eca0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:51.798115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d2e5e-f278-4cfd-959d-0e177e532259 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:51.798115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d2e5e-f278-4cfd-959d-0e177e532259 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:51.798115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d2e5e-f278-4cfd-959d-0e177e532259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:51.801238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81024c73-de8d-4c18-b70c-e8265ba22b8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:51.801847 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81024c73-de8d-4c18-b70c-e8265ba22b8a service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:51.802152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81024c73-de8d-4c18-b70c-e8265ba22b8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:51.802398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81024c73-de8d-4c18-b70c-e8265ba22b8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:51.805683 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-81024c73-de8d-4c18-b70c-e8265ba22b8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:51.823372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-892d2e5e-f278-4cfd-959d-0e177e532259 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:51.824599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-892d2e5e-f278-4cfd-959d-0e177e532259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:51.826256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:51.834018 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1041/2120] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:51.839371 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d2e5e-f278-4cfd-959d-0e177e532259 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:51.849716 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d2e5e-f278-4cfd-959d-0e177e532259 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:51.858060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e07a8-b5ed-4cd3-989c-f4d903f4ba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:51.859571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e07a8-b5ed-4cd3-989c-f4d903f4ba3f admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:51.860113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e07a8-b5ed-4cd3-989c-f4d903f4ba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:51.860379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e07a8-b5ed-4cd3-989c-f4d903f4ba3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:51.861089 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e07a8-b5ed-4cd3-989c-f4d903f4ba3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:51.861401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e07a8-b5ed-4cd3-989c-f4d903f4ba3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:51.863016 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e07a8-b5ed-4cd3-989c-f4d903f4ba3f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:51.876603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1042/2121] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:24:51.880068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e07a8-b5ed-4cd3-989c-f4d903f4ba3f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:51.891435 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e07a8-b5ed-4cd3-989c-f4d903f4ba3f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:51.896575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7c898-d83f-42e6-9c94-2ff4700a3931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:51.897219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c898-d83f-42e6-9c94-2ff4700a3931 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:51.897502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c898-d83f-42e6-9c94-2ff4700a3931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:51.897776 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c898-d83f-42e6-9c94-2ff4700a3931 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:51.898506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7c898-d83f-42e6-9c94-2ff4700a3931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:51.901847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7c898-d83f-42e6-9c94-2ff4700a3931 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:51.902316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81024c73-de8d-4c18-b70c-e8265ba22b8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:51.903902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81024c73-de8d-4c18-b70c-e8265ba22b8a service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:51.915505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1080/2122] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:24:51.944997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1043/2123] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:51 2022] POST /identity/v3/projects => generated 393 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:51.945944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81024c73-de8d-4c18-b70c-e8265ba22b8a service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:51.958197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81024c73-de8d-4c18-b70c-e8265ba22b8a service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:52.054198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc708f1-41f4-45d1-931b-84af4fc3ca2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:52.055590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc708f1-41f4-45d1-931b-84af4fc3ca2e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:52.055674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc708f1-41f4-45d1-931b-84af4fc3ca2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:52.056813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc708f1-41f4-45d1-931b-84af4fc3ca2e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:52.057573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc708f1-41f4-45d1-931b-84af4fc3ca2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:52.059659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc708f1-41f4-45d1-931b-84af4fc3ca2e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:52.082403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1081/2124] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:51 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:52.086892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7c898-d83f-42e6-9c94-2ff4700a3931 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:52.098008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7c898-d83f-42e6-9c94-2ff4700a3931 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:52.103979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de191d4-6b8f-4824-897d-5201a5f8d19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:52.104636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de191d4-6b8f-4824-897d-5201a5f8d19a admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:52.105210 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de191d4-6b8f-4824-897d-5201a5f8d19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:52.105515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de191d4-6b8f-4824-897d-5201a5f8d19a admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:52.106177 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de191d4-6b8f-4824-897d-5201a5f8d19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:52.107938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de191d4-6b8f-4824-897d-5201a5f8d19a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:52.118661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1044/2125] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:52.122978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc708f1-41f4-45d1-931b-84af4fc3ca2e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:52.134426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc708f1-41f4-45d1-931b-84af4fc3ca2e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:52.140070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0c488-7668-4223-bbb1-385ab8bfcf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:52.140708 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0c488-7668-4223-bbb1-385ab8bfcf7f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:52.140993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0c488-7668-4223-bbb1-385ab8bfcf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:52.141259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0c488-7668-4223-bbb1-385ab8bfcf7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:52.141902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0c488-7668-4223-bbb1-385ab8bfcf7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:52.143469 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0c488-7668-4223-bbb1-385ab8bfcf7f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:52.157840 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1082/2126] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:24:52.161896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de191d4-6b8f-4824-897d-5201a5f8d19a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:52.173447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de191d4-6b8f-4824-897d-5201a5f8d19a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:52.178922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2312e-7782-4090-86e1-7affd00f1c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:52.179633 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2312e-7782-4090-86e1-7affd00f1c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:52.179892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2312e-7782-4090-86e1-7affd00f1c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:52.180156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2312e-7782-4090-86e1-7affd00f1c8f admin admin] PATH_INFO: `/v3/projects/b28034a4f7de46279403c30849e490de/users/cce8cd0756024404815ebf4e0ffa0209/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:52.196660 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2312e-7782-4090-86e1-7affd00f1c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28034a4f7de46279403c30849e490de, user_id=cce8cd0756024404815ebf4e0ffa0209, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:52.199412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2312e-7782-4090-86e1-7affd00f1c8f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:52.215001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1045/2127] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:52 2022] PUT /identity/v3/projects/b28034a4f7de46279403c30849e490de/users/cce8cd0756024404815ebf4e0ffa0209/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:52.220139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2f0f6-8ce9-4408-9814-c215f593bbbb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:52.220633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2f0f6-8ce9-4408-9814-c215f593bbbb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:52.220949 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2f0f6-8ce9-4408-9814-c215f593bbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:52.244859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cca2f0f6-8ce9-4408-9814-c215f593bbbb None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:52.246132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cca2f0f6-8ce9-4408-9814-c215f593bbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:52.310418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1083/2128] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:52.320179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2312e-7782-4090-86e1-7affd00f1c8f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:52.322502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cbf2312e-7782-4090-86e1-7affd00f1c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:52.385539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2312e-7782-4090-86e1-7affd00f1c8f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:52.389253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07285f41-bb98-4da2-9504-336e9e3e79e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:52.389857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07285f41-bb98-4da2-9504-336e9e3e79e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:52.390133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07285f41-bb98-4da2-9504-336e9e3e79e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:52.390400 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07285f41-bb98-4da2-9504-336e9e3e79e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:52.400256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07285f41-bb98-4da2-9504-336e9e3e79e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:52.401713 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07285f41-bb98-4da2-9504-336e9e3e79e0 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:52.421459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1046/2129] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:52.957621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2f0f6-8ce9-4408-9814-c215f593bbbb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:52.960241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cca2f0f6-8ce9-4408-9814-c215f593bbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:52.987690 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2f0f6-8ce9-4408-9814-c215f593bbbb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:53.004511 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ffdd9-69a1-4ddd-a069-46784bba49c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:53.005192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ffdd9-69a1-4ddd-a069-46784bba49c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:53.005474 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ffdd9-69a1-4ddd-a069-46784bba49c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:53.009612 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ffdd9-69a1-4ddd-a069-46784bba49c7 admin admin] PATH_INFO: `/v3/users/33aa590f713f4b43971f9fbd4a62ba1a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:53.011174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ffdd9-69a1-4ddd-a069-46784bba49c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33aa590f713f4b43971f9fbd4a62ba1a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:53.013433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ffdd9-69a1-4ddd-a069-46784bba49c7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:53.050130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:53.081165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7d7ffdd9-69a1-4ddd-a069-46784bba49c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33aa590f713f4b43971f9fbd4a62ba1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:53.093498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7d7ffdd9-69a1-4ddd-a069-46784bba49c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33aa590f713f4b43971f9fbd4a62ba1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:53.119893 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7d7ffdd9-69a1-4ddd-a069-46784bba49c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33aa590f713f4b43971f9fbd4a62ba1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:53.128587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7d7ffdd9-69a1-4ddd-a069-46784bba49c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33aa590f713f4b43971f9fbd4a62ba1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:53.129393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7d7ffdd9-69a1-4ddd-a069-46784bba49c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33aa590f713f4b43971f9fbd4a62ba1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:53.153324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1084/2130] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:52 2022] DELETE /identity/v3/users/33aa590f713f4b43971f9fbd4a62ba1a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:24:53.158999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4f1f6-8deb-437f-a735-15b60804bc58 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:53.159883 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4f1f6-8deb-437f-a735-15b60804bc58 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:53.160294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4f1f6-8deb-437f-a735-15b60804bc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:53.192858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-19a4f1f6-8deb-437f-a735-15b60804bc58 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:53.194555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-19a4f1f6-8deb-437f-a735-15b60804bc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:53.269151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:53.289343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1047/2131] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:53.299549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ffdd9-69a1-4ddd-a069-46784bba49c7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:53.301435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7d7ffdd9-69a1-4ddd-a069-46784bba49c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:53.388590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ffdd9-69a1-4ddd-a069-46784bba49c7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:53.393902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c509b35-15fc-4aec-bb25-dd125d5d19c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:53.394540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c509b35-15fc-4aec-bb25-dd125d5d19c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:53.394818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c509b35-15fc-4aec-bb25-dd125d5d19c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:53.395090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c509b35-15fc-4aec-bb25-dd125d5d19c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:53.409557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c509b35-15fc-4aec-bb25-dd125d5d19c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:53.411485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c509b35-15fc-4aec-bb25-dd125d5d19c3 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:53.427013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1085/2132] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:54.024536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4f1f6-8deb-437f-a735-15b60804bc58 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:54.026354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-19a4f1f6-8deb-437f-a735-15b60804bc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:54.062406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4f1f6-8deb-437f-a735-15b60804bc58 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:54.073395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:54.074253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:54.074716 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:54.075135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] PATH_INFO: `/v3/projects/f473f913e2bc474a8be784800372a701` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:54.078166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f473f913e2bc474a8be784800372a701)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:54.097312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:54.195113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f473f913e2bc474a8be784800372a701', 'request_id': 'req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:54.202652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f473f913e2bc474a8be784800372a701', 'request_id': 'req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:54.209897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f473f913e2bc474a8be784800372a701', 'request_id': 'req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:54.231209 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] The token cache is being invalidate because project f473f913e2bc474a8be784800372a701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:54.231503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:54.233519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:54.239767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1048/2133] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:54 2022] DELETE /identity/v3/projects/f473f913e2bc474a8be784800372a701 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:54.245297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991a27-65f9-4403-bd70-bbc6395e4ca3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:54.245783 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991a27-65f9-4403-bd70-bbc6395e4ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:54.245983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991a27-65f9-4403-bd70-bbc6395e4ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:54.300256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:54.301719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:54.306552 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b4991a27-65f9-4403-bd70-bbc6395e4ca3 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:54.307979 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b4991a27-65f9-4403-bd70-bbc6395e4ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:54.389414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2f3d7-efad-49b4-a603-c2ecbbcbca2f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:54.395940 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6025c-92bb-47b7-97d9-d383d0f7aa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:54.396595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6025c-92bb-47b7-97d9-d383d0f7aa77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:54.397080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6025c-92bb-47b7-97d9-d383d0f7aa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:54.397344 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6025c-92bb-47b7-97d9-d383d0f7aa77 admin admin] PATH_INFO: `/v3/users/039bbc21d88f402db0714ffb3ee38366` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:54.399746 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6025c-92bb-47b7-97d9-d383d0f7aa77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=039bbc21d88f402db0714ffb3ee38366)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:54.402437 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6025c-92bb-47b7-97d9-d383d0f7aa77 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:54.418894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1086/2134] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:54.427321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e384a-581c-4f6d-baf1-92dfd3af4dd1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:54.427681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e384a-581c-4f6d-baf1-92dfd3af4dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:54.428031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e384a-581c-4f6d-baf1-92dfd3af4dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:54.459472 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dc8e384a-581c-4f6d-baf1-92dfd3af4dd1 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:54.461439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dc8e384a-581c-4f6d-baf1-92dfd3af4dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:54.476091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1087/2135] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:54.480301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e384a-581c-4f6d-baf1-92dfd3af4dd1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:54.489982 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e384a-581c-4f6d-baf1-92dfd3af4dd1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:54.490611 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cdf6025c-92bb-47b7-97d9-d383d0f7aa77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '039bbc21d88f402db0714ffb3ee38366'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:54.491479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cdf6025c-92bb-47b7-97d9-d383d0f7aa77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '039bbc21d88f402db0714ffb3ee38366'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:54.492959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cdf6025c-92bb-47b7-97d9-d383d0f7aa77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '039bbc21d88f402db0714ffb3ee38366'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:54.495194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247e9db-89fd-4537-a02d-eb1e95c34bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:54.495825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e9db-89fd-4537-a02d-eb1e95c34bdb admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:54.496105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e9db-89fd-4537-a02d-eb1e95c34bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:54.496376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e9db-89fd-4537-a02d-eb1e95c34bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:54.497180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247e9db-89fd-4537-a02d-eb1e95c34bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:54.497542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247e9db-89fd-4537-a02d-eb1e95c34bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:54.499135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247e9db-89fd-4537-a02d-eb1e95c34bdb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:54.500760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cdf6025c-92bb-47b7-97d9-d383d0f7aa77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '039bbc21d88f402db0714ffb3ee38366'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:54.513747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1088/2136] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:24:54.517199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cdf6025c-92bb-47b7-97d9-d383d0f7aa77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '039bbc21d88f402db0714ffb3ee38366'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:54.518888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247e9db-89fd-4537-a02d-eb1e95c34bdb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:54.520450 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6247e9db-89fd-4537-a02d-eb1e95c34bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:54.537719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1049/2137] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:54 2022] DELETE /identity/v3/users/039bbc21d88f402db0714ffb3ee38366 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:24:54.542140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76a95-a260-49f8-a3f8-44ab48253c64 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:54.542654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76a95-a260-49f8-a3f8-44ab48253c64 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:54.542996 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76a95-a260-49f8-a3f8-44ab48253c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:54.544322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247e9db-89fd-4537-a02d-eb1e95c34bdb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:54.553314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:54.575423 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-dea76a95-a260-49f8-a3f8-44ab48253c64 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:54.585447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-dea76a95-a260-49f8-a3f8-44ab48253c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:54.595585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:54.645160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e1881-5638-4281-89e7-ef94998cc6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:54.646289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e1881-5638-4281-89e7-ef94998cc6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:54.646679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e1881-5638-4281-89e7-ef94998cc6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:54.647184 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e1881-5638-4281-89e7-ef94998cc6f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:54.647944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e1881-5638-4281-89e7-ef94998cc6f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:54.650694 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e1881-5638-4281-89e7-ef94998cc6f3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:54.684747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1050/2138] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:54.695676 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea76a95-a260-49f8-a3f8-44ab48253c64 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:54.697391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1089/2139] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:54 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:54.697695 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-dea76a95-a260-49f8-a3f8-44ab48253c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:54.698317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e1881-5638-4281-89e7-ef94998cc6f3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:54.786654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea76a95-a260-49f8-a3f8-44ab48253c64 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:54.806498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e1881-5638-4281-89e7-ef94998cc6f3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:54.817204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfeeb73-1e20-4fd9-9acc-d5d6088e03c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:54.818383 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfeeb73-1e20-4fd9-9acc-d5d6088e03c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:54.818811 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfeeb73-1e20-4fd9-9acc-d5d6088e03c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:54.819246 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfeeb73-1e20-4fd9-9acc-d5d6088e03c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:54.821064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfeeb73-1e20-4fd9-9acc-d5d6088e03c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:54.824139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfeeb73-1e20-4fd9-9acc-d5d6088e03c3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:54.862472 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1090/2140] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:54 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:54.868248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfeeb73-1e20-4fd9-9acc-d5d6088e03c3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:54.888640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfeeb73-1e20-4fd9-9acc-d5d6088e03c3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:54.901581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd72a4-2fb3-45ab-ba7d-46e3c7fdfc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:54.902456 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd72a4-2fb3-45ab-ba7d-46e3c7fdfc44 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:54.903820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd72a4-2fb3-45ab-ba7d-46e3c7fdfc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:54.904218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd72a4-2fb3-45ab-ba7d-46e3c7fdfc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:54.906616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd72a4-2fb3-45ab-ba7d-46e3c7fdfc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:54.908352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd72a4-2fb3-45ab-ba7d-46e3c7fdfc44 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:54.936273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37ce84-e8dc-4669-8090-9aad54336919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:54.937496 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ce84-e8dc-4669-8090-9aad54336919 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:54.937786 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ce84-e8dc-4669-8090-9aad54336919 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:54.938085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ce84-e8dc-4669-8090-9aad54336919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:54.940059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1091/2141] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:54.946174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd72a4-2fb3-45ab-ba7d-46e3c7fdfc44 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:54.950910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37ce84-e8dc-4669-8090-9aad54336919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:54.952889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37ce84-e8dc-4669-8090-9aad54336919 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:54.965649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd72a4-2fb3-45ab-ba7d-46e3c7fdfc44 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:54.966385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1051/2142] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:24:54.993175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aca25e-fc14-4bb9-923f-de52af54d0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:54.993670 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca25e-fc14-4bb9-923f-de52af54d0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:54.994301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca25e-fc14-4bb9-923f-de52af54d0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:54.998823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca25e-fc14-4bb9-923f-de52af54d0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:54.998823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aca25e-fc14-4bb9-923f-de52af54d0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:54.998823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aca25e-fc14-4bb9-923f-de52af54d0c1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:55.032739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1092/2143] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:55.038220 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37ce84-e8dc-4669-8090-9aad54336919 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:55.053590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37ce84-e8dc-4669-8090-9aad54336919 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:55.069836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df29ae1-2c7d-426c-9831-8b5439aace8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:55.071689 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df29ae1-2c7d-426c-9831-8b5439aace8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:55.072043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df29ae1-2c7d-426c-9831-8b5439aace8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:55.072472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df29ae1-2c7d-426c-9831-8b5439aace8e admin admin] PATH_INFO: `/v3/projects/f6ebdf421d43404f829f507e1b0d1faa/users/ba51eb2ef8b1445393c11c38201b7f0b/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:55.093715 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df29ae1-2c7d-426c-9831-8b5439aace8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ebdf421d43404f829f507e1b0d1faa, user_id=ba51eb2ef8b1445393c11c38201b7f0b, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:55.097143 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df29ae1-2c7d-426c-9831-8b5439aace8e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:55.136751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1052/2144] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:55 2022] PUT /identity/v3/projects/f6ebdf421d43404f829f507e1b0d1faa/users/ba51eb2ef8b1445393c11c38201b7f0b/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:24:55.144054 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad202d98-e99a-4b81-bea7-77dd5add8d43 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:55.144340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad202d98-e99a-4b81-bea7-77dd5add8d43 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:55.144618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad202d98-e99a-4b81-bea7-77dd5add8d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:55.196619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ad202d98-e99a-4b81-bea7-77dd5add8d43 None None] MFA Rules not processed for user `ba51eb2ef8b1445393c11c38201b7f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:55.219366 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ad202d98-e99a-4b81-bea7-77dd5add8d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:55.327229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1093/2145] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:55.339284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df29ae1-2c7d-426c-9831-8b5439aace8e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:55.343778 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4df29ae1-2c7d-426c-9831-8b5439aace8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:55.398752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:55.439646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df29ae1-2c7d-426c-9831-8b5439aace8e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:55.457150 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad202d98-e99a-4b81-bea7-77dd5add8d43 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:55.457342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19001e-4d17-47e3-a59b-45aa0618bb98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:55.458603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ad202d98-e99a-4b81-bea7-77dd5add8d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:55.459544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19001e-4d17-47e3-a59b-45aa0618bb98 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:55.460304 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19001e-4d17-47e3-a59b-45aa0618bb98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:55.462578 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19001e-4d17-47e3-a59b-45aa0618bb98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:55.490604 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:55.497503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19001e-4d17-47e3-a59b-45aa0618bb98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:55.502839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19001e-4d17-47e3-a59b-45aa0618bb98 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:55.529617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1053/2146] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:55.596525 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad202d98-e99a-4b81-bea7-77dd5add8d43 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:55.612789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:55.613449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:55.613730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:55.614009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] PATH_INFO: `/v3/projects/a18492f211f3499dbef958042517277b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:55.617476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18492f211f3499dbef958042517277b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:55.619442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:55.747384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18492f211f3499dbef958042517277b', 'request_id': 'req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:55.759682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18492f211f3499dbef958042517277b', 'request_id': 'req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:55.778164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18492f211f3499dbef958042517277b', 'request_id': 'req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:55.804064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] The token cache is being invalidate because project a18492f211f3499dbef958042517277b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:55.805647 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:55.807817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:55.811555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1094/2147] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:55 2022] DELETE /identity/v3/projects/a18492f211f3499dbef958042517277b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:55.815984 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19001e-4d17-47e3-a59b-45aa0618bb98 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:55.836213 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19001e-4d17-47e3-a59b-45aa0618bb98 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:55.975412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e785be2-c99b-4704-83ad-680751d7cddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:55.977681 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e785be2-c99b-4704-83ad-680751d7cddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:55.978073 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e785be2-c99b-4704-83ad-680751d7cddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:55.978455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e785be2-c99b-4704-83ad-680751d7cddf admin admin] PATH_INFO: `/v3/users/318fdea198c444549760be21ef26a179` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:55.982122 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e785be2-c99b-4704-83ad-680751d7cddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=318fdea198c444549760be21ef26a179)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:55.994099 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e785be2-c99b-4704-83ad-680751d7cddf admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:56.108889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6e785be2-c99b-4704-83ad-680751d7cddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '318fdea198c444549760be21ef26a179'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:56.113268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6e785be2-c99b-4704-83ad-680751d7cddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '318fdea198c444549760be21ef26a179'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:56.116255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6e785be2-c99b-4704-83ad-680751d7cddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '318fdea198c444549760be21ef26a179'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:56.133886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6e785be2-c99b-4704-83ad-680751d7cddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '318fdea198c444549760be21ef26a179'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:56.157741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6e785be2-c99b-4704-83ad-680751d7cddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '318fdea198c444549760be21ef26a179'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:56.189838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1054/2148] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:55 2022] DELETE /identity/v3/users/318fdea198c444549760be21ef26a179 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:24:56.294422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:56.296577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:56.312265 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78170d27-02fe-42d6-8ef0-d2b1a6a81ae0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:56.395116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3f634-9edd-4be6-80bc-6d2287486eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:56.395947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3f634-9edd-4be6-80bc-6d2287486eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:56.396153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3f634-9edd-4be6-80bc-6d2287486eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:56.396429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3f634-9edd-4be6-80bc-6d2287486eee admin admin] PATH_INFO: `/v3/users/52b6073b6be24f0d961aca49dbcfd172` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:56.399301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3f634-9edd-4be6-80bc-6d2287486eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b6073b6be24f0d961aca49dbcfd172)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:56.404472 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3f634-9edd-4be6-80bc-6d2287486eee admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:56.496624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:56.499924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-adc3f634-9edd-4be6-80bc-6d2287486eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b6073b6be24f0d961aca49dbcfd172'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:56.500930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-adc3f634-9edd-4be6-80bc-6d2287486eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b6073b6be24f0d961aca49dbcfd172'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:56.524972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-adc3f634-9edd-4be6-80bc-6d2287486eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b6073b6be24f0d961aca49dbcfd172'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:56.536380 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-adc3f634-9edd-4be6-80bc-6d2287486eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b6073b6be24f0d961aca49dbcfd172'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:56.537340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-adc3f634-9edd-4be6-80bc-6d2287486eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b6073b6be24f0d961aca49dbcfd172'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:56.565076 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1095/2149] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:56 2022] DELETE /identity/v3/users/52b6073b6be24f0d961aca49dbcfd172 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:56.569648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd70af1-c708-46f0-a513-0d4967ecbc68 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:56.570748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd70af1-c708-46f0-a513-0d4967ecbc68 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:56.571468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd70af1-c708-46f0-a513-0d4967ecbc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:56.604519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8bd70af1-c708-46f0-a513-0d4967ecbc68 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:56.606130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8bd70af1-c708-46f0-a513-0d4967ecbc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:56.693526 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:56.706703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1055/2150] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:56.725295 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3f634-9edd-4be6-80bc-6d2287486eee admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:56.728048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-adc3f634-9edd-4be6-80bc-6d2287486eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:56.810760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3f634-9edd-4be6-80bc-6d2287486eee admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:56.815357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000313d7-9ec7-4c80-bc36-e21bfff6dd85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:56.816145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000313d7-9ec7-4c80-bc36-e21bfff6dd85 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:56.816574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000313d7-9ec7-4c80-bc36-e21bfff6dd85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:56.816977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000313d7-9ec7-4c80-bc36-e21bfff6dd85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:56.831669 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000313d7-9ec7-4c80-bc36-e21bfff6dd85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:56.833490 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000313d7-9ec7-4c80-bc36-e21bfff6dd85 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:56.854118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1096/2151] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:57.006620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd70af1-c708-46f0-a513-0d4967ecbc68 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:57.011261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8bd70af1-c708-46f0-a513-0d4967ecbc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:57.040196 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd70af1-c708-46f0-a513-0d4967ecbc68 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:57.046918 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:57.049691 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:57.050064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:57.050455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] PATH_INFO: `/v3/projects/b042c8b3c7fc42b7b7815c552fe8fbbc` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:57.052862 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b042c8b3c7fc42b7b7815c552fe8fbbc)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:57.055118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:57.165839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b042c8b3c7fc42b7b7815c552fe8fbbc', 'request_id': 'req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:57.175546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b042c8b3c7fc42b7b7815c552fe8fbbc', 'request_id': 'req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:57.185813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b042c8b3c7fc42b7b7815c552fe8fbbc', 'request_id': 'req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:57.211128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] The token cache is being invalidate because project b042c8b3c7fc42b7b7815c552fe8fbbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:57.211635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:57.212478 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:57.223218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897629fb-5d25-4f19-afb8-fc9e896554ac None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:57.223923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897629fb-5d25-4f19-afb8-fc9e896554ac None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:57.224498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897629fb-5d25-4f19-afb8-fc9e896554ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:57.224969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1056/2152] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:57 2022] DELETE /identity/v3/projects/b042c8b3c7fc42b7b7815c552fe8fbbc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:57.292452 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-897629fb-5d25-4f19-afb8-fc9e896554ac None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:57.294482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-897629fb-5d25-4f19-afb8-fc9e896554ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:57.397647 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:57.399711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:57.516223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1097/2153] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:57.525648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be9c6-aa2c-4ea2-860e-67e311b39da7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:57.525941 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be9c6-aa2c-4ea2-860e-67e311b39da7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:57.526211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be9c6-aa2c-4ea2-860e-67e311b39da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:57.564057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ec9be9c6-aa2c-4ea2-860e-67e311b39da7 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:57.567322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ec9be9c6-aa2c-4ea2-860e-67e311b39da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:57.609583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1098/2154] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:57.616453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be9c6-aa2c-4ea2-860e-67e311b39da7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:57.641905 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9a46b-94f1-4ac4-8d01-735ef8c2b308 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:57.649440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be9c6-aa2c-4ea2-860e-67e311b39da7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:57.653262 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:57.654796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:57.655511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:57.656194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] PATH_INFO: `/v3/projects/1eea05d75a4f46bea3a086c8da9a6992` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:57.659694 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eea05d75a4f46bea3a086c8da9a6992)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:57.665442 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:57.665856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5728cb1-ba0a-413d-a66f-4e7621947732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:57.666507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5728cb1-ba0a-413d-a66f-4e7621947732 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:57.666780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5728cb1-ba0a-413d-a66f-4e7621947732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:57.667046 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5728cb1-ba0a-413d-a66f-4e7621947732 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:57.668525 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5728cb1-ba0a-413d-a66f-4e7621947732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:24:57.668786 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5728cb1-ba0a-413d-a66f-4e7621947732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:57.670743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5728cb1-ba0a-413d-a66f-4e7621947732 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:57.700504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1099/2155] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:24:57.704898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5728cb1-ba0a-413d-a66f-4e7621947732 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:57.718678 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5728cb1-ba0a-413d-a66f-4e7621947732 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:57.726603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdd0ac-da66-43f6-8440-4057991be225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:57.727449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdd0ac-da66-43f6-8440-4057991be225 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:57.727873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdd0ac-da66-43f6-8440-4057991be225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:57.728254 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdd0ac-da66-43f6-8440-4057991be225 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:57.729725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecdd0ac-da66-43f6-8440-4057991be225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:57.733259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecdd0ac-da66-43f6-8440-4057991be225 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:57.762959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eea05d75a4f46bea3a086c8da9a6992', 'request_id': 'req-63474f19-3b0a-482c-bed0-9d3da4591d8a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:57.771153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eea05d75a4f46bea3a086c8da9a6992', 'request_id': 'req-63474f19-3b0a-482c-bed0-9d3da4591d8a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:57.773845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1100/2156] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:24:57 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:24:57.777880 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdd0ac-da66-43f6-8440-4057991be225 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:57.782285 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eea05d75a4f46bea3a086c8da9a6992', 'request_id': 'req-63474f19-3b0a-482c-bed0-9d3da4591d8a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:57.801329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] The token cache is being invalidate because project 1eea05d75a4f46bea3a086c8da9a6992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:57.801630 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:57.802990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:57.808440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1057/2157] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:57 2022] DELETE /identity/v3/projects/1eea05d75a4f46bea3a086c8da9a6992 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:57.809722 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:57.811409 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:57.824583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:57.833977 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:57.884344 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdd0ac-da66-43f6-8440-4057991be225 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:57.894175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504347e-7740-44a2-8ad2-8e803401c973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:57.895867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504347e-7740-44a2-8ad2-8e803401c973 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:57.896260 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504347e-7740-44a2-8ad2-8e803401c973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:57.896651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504347e-7740-44a2-8ad2-8e803401c973 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:57.897433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504347e-7740-44a2-8ad2-8e803401c973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:57.900440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504347e-7740-44a2-8ad2-8e803401c973 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:57.923854 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63474f19-3b0a-482c-bed0-9d3da4591d8a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:57.942507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32d501-03c1-4661-9d4e-680903433614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:57.942507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32d501-03c1-4661-9d4e-680903433614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:57.942507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32d501-03c1-4661-9d4e-680903433614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:57.942507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32d501-03c1-4661-9d4e-680903433614 admin admin] PATH_INFO: `/v3/users/8e164d40c28e449f81e97b2b35221ed8` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:57.943831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1101/2158] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:24:57 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:24:57.945210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504347e-7740-44a2-8ad2-8e803401c973 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:57.946081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32d501-03c1-4661-9d4e-680903433614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e164d40c28e449f81e97b2b35221ed8)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:57.947751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e504347e-7740-44a2-8ad2-8e803401c973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:57.950675 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32d501-03c1-4661-9d4e-680903433614 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:57.965036 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504347e-7740-44a2-8ad2-8e803401c973 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:57.971460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faad8c-9a79-4d4b-956d-dac64ad5ca48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:57.973032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faad8c-9a79-4d4b-956d-dac64ad5ca48 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:57.973573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faad8c-9a79-4d4b-956d-dac64ad5ca48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:57.974168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faad8c-9a79-4d4b-956d-dac64ad5ca48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:57.981172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faad8c-9a79-4d4b-956d-dac64ad5ca48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:57.983386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faad8c-9a79-4d4b-956d-dac64ad5ca48 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:58.015823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1102/2159] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:58.017285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faad8c-9a79-4d4b-956d-dac64ad5ca48 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:58.030267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faad8c-9a79-4d4b-956d-dac64ad5ca48 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:58.039572 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf4532-c943-445d-8157-82a9503d852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:58.040157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf4532-c943-445d-8157-82a9503d852f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:58.040639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf4532-c943-445d-8157-82a9503d852f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:58.041120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf4532-c943-445d-8157-82a9503d852f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:58.041899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf4532-c943-445d-8157-82a9503d852f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:58.043710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf4532-c943-445d-8157-82a9503d852f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:58.059850 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1103/2160] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:24:58.064144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf4532-c943-445d-8157-82a9503d852f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:58.073090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3a32d501-03c1-4661-9d4e-680903433614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e164d40c28e449f81e97b2b35221ed8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:58.074068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3a32d501-03c1-4661-9d4e-680903433614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e164d40c28e449f81e97b2b35221ed8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:58.074868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3a32d501-03c1-4661-9d4e-680903433614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e164d40c28e449f81e97b2b35221ed8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:58.079906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf4532-c943-445d-8157-82a9503d852f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:58.089319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9ccf2-f54d-413c-8207-6e28242d857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:58.090549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9ccf2-f54d-413c-8207-6e28242d857e admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:58.090762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9ccf2-f54d-413c-8207-6e28242d857e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:58.091222 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9ccf2-f54d-413c-8207-6e28242d857e admin admin] PATH_INFO: `/v3/projects/9cb67eec245145b9999d1cfc2e472ada/users/01f5cc480b164f6db77f52ac31247da6/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:58.092859 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3a32d501-03c1-4661-9d4e-680903433614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e164d40c28e449f81e97b2b35221ed8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:58.114077 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9ccf2-f54d-413c-8207-6e28242d857e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb67eec245145b9999d1cfc2e472ada, user_id=01f5cc480b164f6db77f52ac31247da6, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:58.116247 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3a32d501-03c1-4661-9d4e-680903433614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e164d40c28e449f81e97b2b35221ed8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:58.117559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9ccf2-f54d-413c-8207-6e28242d857e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:58.134263 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1058/2161] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:57 2022] DELETE /identity/v3/users/8e164d40c28e449f81e97b2b35221ed8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:58.150722 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f207f68-3e15-4930-97dd-56fce94fe621 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:58.151030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f207f68-3e15-4930-97dd-56fce94fe621 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:58.151307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f207f68-3e15-4930-97dd-56fce94fe621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:58.152366 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1104/2162] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:24:58 2022] PUT /identity/v3/projects/9cb67eec245145b9999d1cfc2e472ada/users/01f5cc480b164f6db77f52ac31247da6/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:58.192236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8f207f68-3e15-4930-97dd-56fce94fe621 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:58.193519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8f207f68-3e15-4930-97dd-56fce94fe621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:58.340372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1059/2163] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:24:58.352930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9ccf2-f54d-413c-8207-6e28242d857e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:58.355845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1fd9ccf2-f54d-413c-8207-6e28242d857e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:58.458663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9ccf2-f54d-413c-8207-6e28242d857e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:58.566805 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79752bc3-0501-4791-bcd4-6dd231639114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:58.567818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79752bc3-0501-4791-bcd4-6dd231639114 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:58.568264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79752bc3-0501-4791-bcd4-6dd231639114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:58.568548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79752bc3-0501-4791-bcd4-6dd231639114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:58.599247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79752bc3-0501-4791-bcd4-6dd231639114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:58.600980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79752bc3-0501-4791-bcd4-6dd231639114 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:58.617862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1105/2164] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:24:58.911655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f207f68-3e15-4930-97dd-56fce94fe621 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:58.913469 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8f207f68-3e15-4930-97dd-56fce94fe621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:58.930482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f207f68-3e15-4930-97dd-56fce94fe621 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:58.982681 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:58.984209 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:58.984861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:58.985388 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] PATH_INFO: `/v3/projects/de05f9f70b2c41898b7c07a2f7a02441` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:58.987883 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de05f9f70b2c41898b7c07a2f7a02441)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:58.993788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:59.058890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:59.078545 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736a48e-f410-40cd-9f7f-4ee36c3119f8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:59.078545 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736a48e-f410-40cd-9f7f-4ee36c3119f8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:59.079202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736a48e-f410-40cd-9f7f-4ee36c3119f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:59.131994 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de05f9f70b2c41898b7c07a2f7a02441', 'request_id': 'req-4026af10-10f2-451d-95ed-3347c9c885f3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:59.145573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de05f9f70b2c41898b7c07a2f7a02441', 'request_id': 'req-4026af10-10f2-451d-95ed-3347c9c885f3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:59.158676 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de05f9f70b2c41898b7c07a2f7a02441', 'request_id': 'req-4026af10-10f2-451d-95ed-3347c9c885f3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:59.181668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d736a48e-f410-40cd-9f7f-4ee36c3119f8 None None] MFA Rules not processed for user `cce8cd0756024404815ebf4e0ffa0209`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:59.182947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d736a48e-f410-40cd-9f7f-4ee36c3119f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:59.188812 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] The token cache is being invalidate because project de05f9f70b2c41898b7c07a2f7a02441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:24:59.189492 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:59.190729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:59.193617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1060/2165] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:24:58 2022] DELETE /identity/v3/projects/de05f9f70b2c41898b7c07a2f7a02441 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:24:59.199837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:59.201599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:59.211345 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:59.308760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1106/2166] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:59.320854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60542b-70e6-4b8f-aabc-7428769b5a4f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:59.321341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60542b-70e6-4b8f-aabc-7428769b5a4f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:59.321786 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60542b-70e6-4b8f-aabc-7428769b5a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:59.344469 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ca60542b-70e6-4b8f-aabc-7428769b5a4f None None] MFA Rules not processed for user `cce8cd0756024404815ebf4e0ffa0209`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:24:59.346451 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ca60542b-70e6-4b8f-aabc-7428769b5a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:59.354112 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026af10-10f2-451d-95ed-3347c9c885f3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:59.355960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1107/2167] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:24:59.367936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109758c-20a2-46f9-8af4-c2ba3248953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:59.368212 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60542b-70e6-4b8f-aabc-7428769b5a4f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:24:59.369470 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109758c-20a2-46f9-8af4-c2ba3248953c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:59.369682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ca60542b-70e6-4b8f-aabc-7428769b5a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:59.369938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109758c-20a2-46f9-8af4-c2ba3248953c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:59.370419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109758c-20a2-46f9-8af4-c2ba3248953c admin admin] PATH_INFO: `/v3/users/077ac83f06a34c808945d234db30354a` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:59.374201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109758c-20a2-46f9-8af4-c2ba3248953c admin admin] RBAC: Authorizing `identity:delete_user(user_id=077ac83f06a34c808945d234db30354a)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:59.380081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109758c-20a2-46f9-8af4-c2ba3248953c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:59.497492 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2109758c-20a2-46f9-8af4-c2ba3248953c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '077ac83f06a34c808945d234db30354a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:59.501751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2109758c-20a2-46f9-8af4-c2ba3248953c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '077ac83f06a34c808945d234db30354a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:59.502646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2109758c-20a2-46f9-8af4-c2ba3248953c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '077ac83f06a34c808945d234db30354a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:59.517701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2109758c-20a2-46f9-8af4-c2ba3248953c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '077ac83f06a34c808945d234db30354a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:59.531570 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60542b-70e6-4b8f-aabc-7428769b5a4f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:24:59.542926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9631dbc-5502-482b-a91e-e0cd62d80d8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:24:59.543569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9631dbc-5502-482b-a91e-e0cd62d80d8a service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:24:59.544089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9631dbc-5502-482b-a91e-e0cd62d80d8a service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:24:59.544380 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9631dbc-5502-482b-a91e-e0cd62d80d8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:24:59.547046 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e9631dbc-5502-482b-a91e-e0cd62d80d8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:24:59.560833 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9631dbc-5502-482b-a91e-e0cd62d80d8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:24:59.562781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9631dbc-5502-482b-a91e-e0cd62d80d8a service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:24:59.575019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1108/2168] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:24:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:24:59.576183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2109758c-20a2-46f9-8af4-c2ba3248953c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '077ac83f06a34c808945d234db30354a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:24:59.613249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1061/2169] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:24:59 2022] DELETE /identity/v3/users/077ac83f06a34c808945d234db30354a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:00.453648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2faf7d-60a9-4659-8580-f5a50ef3705c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:00.454236 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2faf7d-60a9-4659-8580-f5a50ef3705c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:00.454669 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2faf7d-60a9-4659-8580-f5a50ef3705c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:00.516176 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-da2faf7d-60a9-4659-8580-f5a50ef3705c None None] MFA Rules not processed for user `01f5cc480b164f6db77f52ac31247da6`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:00.518671 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-da2faf7d-60a9-4659-8580-f5a50ef3705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:00.530500 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109758c-20a2-46f9-8af4-c2ba3248953c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:00.534078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2109758c-20a2-46f9-8af4-c2ba3248953c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:00.667765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:00.691481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1109/2170] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:25:00.693354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2faf7d-60a9-4659-8580-f5a50ef3705c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:00.695857 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-da2faf7d-60a9-4659-8580-f5a50ef3705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:00.718534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109758c-20a2-46f9-8af4-c2ba3248953c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:00.729022 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710db8e6-a8c6-4338-af6b-c2a6a4eef546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:00.729943 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710db8e6-a8c6-4338-af6b-c2a6a4eef546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:00.730380 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710db8e6-a8c6-4338-af6b-c2a6a4eef546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:00.730799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710db8e6-a8c6-4338-af6b-c2a6a4eef546 admin admin] PATH_INFO: `/v3/projects/4a04f83533f14d18bdb2ccc00a54b576` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:00.732595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710db8e6-a8c6-4338-af6b-c2a6a4eef546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a04f83533f14d18bdb2ccc00a54b576)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:00.736447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710db8e6-a8c6-4338-af6b-c2a6a4eef546 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:00.812537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:00.842741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-710db8e6-a8c6-4338-af6b-c2a6a4eef546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a04f83533f14d18bdb2ccc00a54b576', 'request_id': 'req-710db8e6-a8c6-4338-af6b-c2a6a4eef546'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:00.861751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-710db8e6-a8c6-4338-af6b-c2a6a4eef546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a04f83533f14d18bdb2ccc00a54b576', 'request_id': 'req-710db8e6-a8c6-4338-af6b-c2a6a4eef546'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:00.873706 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-710db8e6-a8c6-4338-af6b-c2a6a4eef546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a04f83533f14d18bdb2ccc00a54b576', 'request_id': 'req-710db8e6-a8c6-4338-af6b-c2a6a4eef546'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:00.924071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-710db8e6-a8c6-4338-af6b-c2a6a4eef546 admin admin] The token cache is being invalidate because project 4a04f83533f14d18bdb2ccc00a54b576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:25:00.924836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-710db8e6-a8c6-4338-af6b-c2a6a4eef546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:00.927603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-710db8e6-a8c6-4338-af6b-c2a6a4eef546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:00.936171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1062/2171] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:25:00 2022] DELETE /identity/v3/projects/4a04f83533f14d18bdb2ccc00a54b576 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:00.938894 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ee0f0-913b-4670-b659-a04a412b30c1 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:00.939679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ee0f0-913b-4670-b659-a04a412b30c1 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:00.940053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ee0f0-913b-4670-b659-a04a412b30c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:00.972367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2faf7d-60a9-4659-8580-f5a50ef3705c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:01.012579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-070ee0f0-913b-4670-b659-a04a412b30c1 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:01.014653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-070ee0f0-913b-4670-b659-a04a412b30c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:01.107155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f57c54-313f-489b-b82c-33562e101aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:01.108520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f57c54-313f-489b-b82c-33562e101aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:01.109189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f57c54-313f-489b-b82c-33562e101aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:01.109592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f57c54-313f-489b-b82c-33562e101aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:01.110763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f57c54-313f-489b-b82c-33562e101aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:01.114809 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f57c54-313f-489b-b82c-33562e101aa0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:01.199503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1110/2172] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:25:00 2022] POST /identity/v3/projects => generated 373 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:25:01.201704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a79d2f-9323-4ee2-a560-fd34fe3a98e6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:01.202157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a79d2f-9323-4ee2-a560-fd34fe3a98e6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:01.203002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a79d2f-9323-4ee2-a560-fd34fe3a98e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:01.238147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-78a79d2f-9323-4ee2-a560-fd34fe3a98e6 None None] MFA Rules not processed for user `cce8cd0756024404815ebf4e0ffa0209`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:01.239285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78a79d2f-9323-4ee2-a560-fd34fe3a98e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:01.251164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1063/2173] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:25:01.252884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ee0f0-913b-4670-b659-a04a412b30c1 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:01.255269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-070ee0f0-913b-4670-b659-a04a412b30c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:01.284416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ee0f0-913b-4670-b659-a04a412b30c1 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:01.372203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1111/2174] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:01.373955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361f656-810d-48f9-a9ef-b88ec4b94c06 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:01.374300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361f656-810d-48f9-a9ef-b88ec4b94c06 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:01.374647 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361f656-810d-48f9-a9ef-b88ec4b94c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:01.412953 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5361f656-810d-48f9-a9ef-b88ec4b94c06 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:01.415078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5361f656-810d-48f9-a9ef-b88ec4b94c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:01.421067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193bfa0-9b7c-40b9-94bc-c27f2009f272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:01.422914 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193bfa0-9b7c-40b9-94bc-c27f2009f272 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:01.424609 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193bfa0-9b7c-40b9-94bc-c27f2009f272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:01.424926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193bfa0-9b7c-40b9-94bc-c27f2009f272 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:01.425620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193bfa0-9b7c-40b9-94bc-c27f2009f272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:01.430519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193bfa0-9b7c-40b9-94bc-c27f2009f272 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:01.435970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1112/2175] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:01.443104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361f656-810d-48f9-a9ef-b88ec4b94c06 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:01.480716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361f656-810d-48f9-a9ef-b88ec4b94c06 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:01.482871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:01.490308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505a2c8-bc2c-4b17-93a1-510576d61ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:01.493663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505a2c8-bc2c-4b17-93a1-510576d61ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:01.494999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505a2c8-bc2c-4b17-93a1-510576d61ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:01.496037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505a2c8-bc2c-4b17-93a1-510576d61ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:01.498952 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505a2c8-bc2c-4b17-93a1-510576d61ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:25:01.500178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505a2c8-bc2c-4b17-93a1-510576d61ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:01.505257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1064/2176] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:25:01 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:25:01.510268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193bfa0-9b7c-40b9-94bc-c27f2009f272 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:01.511977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505a2c8-bc2c-4b17-93a1-510576d61ce6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:01.532046 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193bfa0-9b7c-40b9-94bc-c27f2009f272 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:01.558150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9da7a7-b12c-437c-a377-54cbe033520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:01.559445 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9da7a7-b12c-437c-a377-54cbe033520b admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:01.561601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9da7a7-b12c-437c-a377-54cbe033520b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:01.563236 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9da7a7-b12c-437c-a377-54cbe033520b admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:01.575463 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9da7a7-b12c-437c-a377-54cbe033520b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:01.585017 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1113/2177] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:25:01.590385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505a2c8-bc2c-4b17-93a1-510576d61ce6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:01.597775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9da7a7-b12c-437c-a377-54cbe033520b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:01.615886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505a2c8-bc2c-4b17-93a1-510576d61ce6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:01.633471 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a143c0a-fe44-4d81-bb50-31e7fd6f684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:01.635654 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143c0a-fe44-4d81-bb50-31e7fd6f684f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:01.636072 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143c0a-fe44-4d81-bb50-31e7fd6f684f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:01.636900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143c0a-fe44-4d81-bb50-31e7fd6f684f admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:01.639091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a143c0a-fe44-4d81-bb50-31e7fd6f684f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:01.644970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a143c0a-fe44-4d81-bb50-31e7fd6f684f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:01.699250 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1065/2178] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:25:01.706372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9da7a7-b12c-437c-a377-54cbe033520b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:01.751098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1114/2179] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:25:01 2022] POST /identity/v3/projects => generated 393 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:25:01.758773 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9da7a7-b12c-437c-a377-54cbe033520b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:01.759177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a143c0a-fe44-4d81-bb50-31e7fd6f684f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:01.821902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:01.968935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cf75e-1363-4dba-918a-30fec2bbb97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:01.969590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cf75e-1363-4dba-918a-30fec2bbb97c admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:01.970035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cf75e-1363-4dba-918a-30fec2bbb97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:01.970538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cf75e-1363-4dba-918a-30fec2bbb97c admin admin] PATH_INFO: `/v3/projects/11f746acfec04d7790b026e71cde6e21/users/db71245d19ee41909aed8998275665a2/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:02.000768 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cf75e-1363-4dba-918a-30fec2bbb97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f746acfec04d7790b026e71cde6e21, user_id=db71245d19ee41909aed8998275665a2, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:02.004156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cf75e-1363-4dba-918a-30fec2bbb97c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:02.025406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a143c0a-fe44-4d81-bb50-31e7fd6f684f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:02.045261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1066/2180] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:25:01 2022] PUT /identity/v3/projects/11f746acfec04d7790b026e71cde6e21/users/db71245d19ee41909aed8998275665a2/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:02.046817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cf75e-1363-4dba-918a-30fec2bbb97c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:02.197349 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cf75e-1363-4dba-918a-30fec2bbb97c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:02.210869 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bc6d0-cd8e-486d-ba80-38054783dd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:02.211456 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bc6d0-cd8e-486d-ba80-38054783dd54 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:02.211739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bc6d0-cd8e-486d-ba80-38054783dd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:02.212011 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bc6d0-cd8e-486d-ba80-38054783dd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:02.214341 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bc6d0-cd8e-486d-ba80-38054783dd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:02.216100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bc6d0-cd8e-486d-ba80-38054783dd54 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:02.247113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1067/2181] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:25:02.252353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bc6d0-cd8e-486d-ba80-38054783dd54 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:02.273412 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef7d6-eb2e-4cea-9950-b503126712b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:02.275257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef7d6-eb2e-4cea-9950-b503126712b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:02.276553 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef7d6-eb2e-4cea-9950-b503126712b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:02.277531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef7d6-eb2e-4cea-9950-b503126712b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:02.278239 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef7d6-eb2e-4cea-9950-b503126712b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:02.280563 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef7d6-eb2e-4cea-9950-b503126712b3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:02.299959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bc6d0-cd8e-486d-ba80-38054783dd54 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:02.326302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02946fc0-92c2-4a21-a3da-ddf30150fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:02.326538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946fc0-92c2-4a21-a3da-ddf30150fcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:02.326941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946fc0-92c2-4a21-a3da-ddf30150fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:02.327410 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946fc0-92c2-4a21-a3da-ddf30150fcdb admin admin] PATH_INFO: `/v3/projects/11f746acfec04d7790b026e71cde6e21/users/db71245d19ee41909aed8998275665a2/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:02.342833 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1115/2182] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:25:01 2022] POST /identity/v3/users => generated 297 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:25:02.349602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02946fc0-92c2-4a21-a3da-ddf30150fcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f746acfec04d7790b026e71cde6e21, user_id=db71245d19ee41909aed8998275665a2, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:02.350505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef7d6-eb2e-4cea-9950-b503126712b3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:02.355861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02946fc0-92c2-4a21-a3da-ddf30150fcdb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:02.395295 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef7d6-eb2e-4cea-9950-b503126712b3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:02.473429 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1068/2183] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:25:02 2022] PUT /identity/v3/projects/11f746acfec04d7790b026e71cde6e21/users/db71245d19ee41909aed8998275665a2/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:02.572129 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3e20e-0ede-4385-b1ab-c072bca9ea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:02.573295 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e20e-0ede-4385-b1ab-c072bca9ea1c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:02.573766 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e20e-0ede-4385-b1ab-c072bca9ea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:02.574145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e20e-0ede-4385-b1ab-c072bca9ea1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:02.575755 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3e20e-0ede-4385-b1ab-c072bca9ea1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:02.595443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3e20e-0ede-4385-b1ab-c072bca9ea1c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:02.643399 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1116/2184] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:25:02.644148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02946fc0-92c2-4a21-a3da-ddf30150fcdb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:02.661955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02946fc0-92c2-4a21-a3da-ddf30150fcdb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:02.675147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f00ea-5a76-4a7e-9f9b-0aac6cb14116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:02.675965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f00ea-5a76-4a7e-9f9b-0aac6cb14116 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:02.676394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f00ea-5a76-4a7e-9f9b-0aac6cb14116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:02.676951 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f00ea-5a76-4a7e-9f9b-0aac6cb14116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:02.677774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f00ea-5a76-4a7e-9f9b-0aac6cb14116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:02.680600 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f00ea-5a76-4a7e-9f9b-0aac6cb14116 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:02.708624 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1069/2185] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:25:02.714323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3e20e-0ede-4385-b1ab-c072bca9ea1c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:02.742005 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3e20e-0ede-4385-b1ab-c072bca9ea1c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:02.757017 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09bd24-e351-4071-8d1c-d23bdcaab132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:02.758915 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09bd24-e351-4071-8d1c-d23bdcaab132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:02.759761 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09bd24-e351-4071-8d1c-d23bdcaab132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:02.760394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09bd24-e351-4071-8d1c-d23bdcaab132 admin admin] PATH_INFO: `/v3/projects/84c1a982280f4431ba1928a0e322a885/users/a541332d2bdf4b27bb74d6a0b1cf84a9/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:02.824873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09bd24-e351-4071-8d1c-d23bdcaab132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c1a982280f4431ba1928a0e322a885, user_id=a541332d2bdf4b27bb74d6a0b1cf84a9, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:02.837975 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09bd24-e351-4071-8d1c-d23bdcaab132 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:02.882535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1117/2186] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:25:02 2022] PUT /identity/v3/projects/84c1a982280f4431ba1928a0e322a885/users/a541332d2bdf4b27bb74d6a0b1cf84a9/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:02.908023 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7f7d8-ac79-493c-a7f3-6b59478d1d84 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:02.908911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7f7d8-ac79-493c-a7f3-6b59478d1d84 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:02.909423 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7f7d8-ac79-493c-a7f3-6b59478d1d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:02.984274 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b4a7f7d8-ac79-493c-a7f3-6b59478d1d84 None None] MFA Rules not processed for user `a541332d2bdf4b27bb74d6a0b1cf84a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:02.990001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b4a7f7d8-ac79-493c-a7f3-6b59478d1d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:03.091283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:03.224503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1070/2187] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:03.233770 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09bd24-e351-4071-8d1c-d23bdcaab132 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:03.235767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aa09bd24-e351-4071-8d1c-d23bdcaab132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:03.296028 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:03.384330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09bd24-e351-4071-8d1c-d23bdcaab132 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:03.407725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f11536-ab94-4868-9048-281de8893cf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:03.415762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f11536-ab94-4868-9048-281de8893cf1 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:03.417760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f11536-ab94-4868-9048-281de8893cf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:03.418181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f11536-ab94-4868-9048-281de8893cf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:03.465054 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f11536-ab94-4868-9048-281de8893cf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:03.475844 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f11536-ab94-4868-9048-281de8893cf1 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:03.494162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1118/2188] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:25:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:25:04.202992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7f7d8-ac79-493c-a7f3-6b59478d1d84 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:04.208205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b4a7f7d8-ac79-493c-a7f3-6b59478d1d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:04.621017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7f7d8-ac79-493c-a7f3-6b59478d1d84 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:04.632912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a615ab4-1020-40f9-a79b-34588f0ff79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:04.634981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a615ab4-1020-40f9-a79b-34588f0ff79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:04.637603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a615ab4-1020-40f9-a79b-34588f0ff79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:04.638467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a615ab4-1020-40f9-a79b-34588f0ff79c admin admin] PATH_INFO: `/v3/users/9f3a2d2138ad4280897c7bd5b8d56b58` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:04.643734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a615ab4-1020-40f9-a79b-34588f0ff79c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3a2d2138ad4280897c7bd5b8d56b58)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:04.653511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a615ab4-1020-40f9-a79b-34588f0ff79c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:04.823327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a615ab4-1020-40f9-a79b-34588f0ff79c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3a2d2138ad4280897c7bd5b8d56b58'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:04.824564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a615ab4-1020-40f9-a79b-34588f0ff79c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3a2d2138ad4280897c7bd5b8d56b58'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:04.825665 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a615ab4-1020-40f9-a79b-34588f0ff79c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3a2d2138ad4280897c7bd5b8d56b58'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:04.876724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a615ab4-1020-40f9-a79b-34588f0ff79c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3a2d2138ad4280897c7bd5b8d56b58'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:04.887564 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459603c2-c5a2-42d1-944d-aaa93ccadaf0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:04.889616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459603c2-c5a2-42d1-944d-aaa93ccadaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:04.890340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459603c2-c5a2-42d1-944d-aaa93ccadaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:04.903348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7a615ab4-1020-40f9-a79b-34588f0ff79c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3a2d2138ad4280897c7bd5b8d56b58'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:04.937395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1071/2189] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:25:04 2022] DELETE /identity/v3/users/9f3a2d2138ad4280897c7bd5b8d56b58 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:25:04.943934 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cd66a-12da-4ff4-b2b1-fb9885117260 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:04.945294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cd66a-12da-4ff4-b2b1-fb9885117260 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:04.945294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cd66a-12da-4ff4-b2b1-fb9885117260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:04.982789 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d20cd66a-12da-4ff4-b2b1-fb9885117260 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:04.985746 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d20cd66a-12da-4ff4-b2b1-fb9885117260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:05.051141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-459603c2-c5a2-42d1-944d-aaa93ccadaf0 None None] MFA Rules not processed for user `db71245d19ee41909aed8998275665a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:05.055825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-459603c2-c5a2-42d1-944d-aaa93ccadaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:05.080108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:05.159575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1072/2190] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:05.277778 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cd66a-12da-4ff4-b2b1-fb9885117260 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:05.280629 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d20cd66a-12da-4ff4-b2b1-fb9885117260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:05.537769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1119/2191] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 652 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:25:05.550944 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cd66a-12da-4ff4-b2b1-fb9885117260 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:05.556582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab20c71-1119-4813-a26f-610a4d05415e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:05.557767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab20c71-1119-4813-a26f-610a4d05415e service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:05.558193 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab20c71-1119-4813-a26f-610a4d05415e service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:05.559801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbd320-0f8c-45ce-9179-23427bfdd9f2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:05.560251 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab20c71-1119-4813-a26f-610a4d05415e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:05.560976 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbd320-0f8c-45ce-9179-23427bfdd9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:05.561661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbd320-0f8c-45ce-9179-23427bfdd9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:05.573137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab20c71-1119-4813-a26f-610a4d05415e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:05.574871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab20c71-1119-4813-a26f-610a4d05415e service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:05.612981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1073/2192] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:25:05.674925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-35dbd320-0f8c-45ce-9179-23427bfdd9f2 None None] MFA Rules not processed for user `01f5cc480b164f6db77f52ac31247da6`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:05.680666 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-35dbd320-0f8c-45ce-9179-23427bfdd9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:05.923097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1120/2193] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:05.934861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab20c71-1119-4813-a26f-610a4d05415e service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:05.936382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-eab20c71-1119-4813-a26f-610a4d05415e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:06.086826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab20c71-1119-4813-a26f-610a4d05415e service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:06.113828 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833227c-c918-4840-9854-e49d68621d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:06.118487 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833227c-c918-4840-9854-e49d68621d6b service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:06.119472 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbd320-0f8c-45ce-9179-23427bfdd9f2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:06.119941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833227c-c918-4840-9854-e49d68621d6b service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:06.121063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833227c-c918-4840-9854-e49d68621d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:06.122522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-35dbd320-0f8c-45ce-9179-23427bfdd9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:06.158347 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8833227c-c918-4840-9854-e49d68621d6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:06.186872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbd320-0f8c-45ce-9179-23427bfdd9f2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:06.202485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833227c-c918-4840-9854-e49d68621d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:06.203915 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833227c-c918-4840-9854-e49d68621d6b service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:06.220622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46780836-49a1-4f58-8d96-8c8271c107d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:06.221359 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46780836-49a1-4f58-8d96-8c8271c107d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:06.221651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46780836-49a1-4f58-8d96-8c8271c107d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:06.221947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46780836-49a1-4f58-8d96-8c8271c107d6 admin admin] PATH_INFO: `/v3/projects/bb892adc892947308ee023a04f5edcb3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:06.226120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46780836-49a1-4f58-8d96-8c8271c107d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb892adc892947308ee023a04f5edcb3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:06.235020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46780836-49a1-4f58-8d96-8c8271c107d6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:06.252376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1074/2194] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:25:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:25:06.466608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-46780836-49a1-4f58-8d96-8c8271c107d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb892adc892947308ee023a04f5edcb3', 'request_id': 'req-46780836-49a1-4f58-8d96-8c8271c107d6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:06.479946 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:06.491123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-46780836-49a1-4f58-8d96-8c8271c107d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb892adc892947308ee023a04f5edcb3', 'request_id': 'req-46780836-49a1-4f58-8d96-8c8271c107d6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:06.524831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-46780836-49a1-4f58-8d96-8c8271c107d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb892adc892947308ee023a04f5edcb3', 'request_id': 'req-46780836-49a1-4f58-8d96-8c8271c107d6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:06.571651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-46780836-49a1-4f58-8d96-8c8271c107d6 admin admin] The token cache is being invalidate because project bb892adc892947308ee023a04f5edcb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:25:06.571651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-46780836-49a1-4f58-8d96-8c8271c107d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:06.573565 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-46780836-49a1-4f58-8d96-8c8271c107d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:06.584342 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1121/2195] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:25:06 2022] DELETE /identity/v3/projects/bb892adc892947308ee023a04f5edcb3 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:06.591902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03b2c9-c199-4957-b2e1-c601e15aee64 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:06.592483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03b2c9-c199-4957-b2e1-c601e15aee64 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:06.592801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03b2c9-c199-4957-b2e1-c601e15aee64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:06.656964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3f03b2c9-c199-4957-b2e1-c601e15aee64 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:06.660188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3f03b2c9-c199-4957-b2e1-c601e15aee64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:06.879887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1075/2196] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:06.884707 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d3eef-5bcc-4d8f-875d-3ce3c9d12bd8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:06.885182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d3eef-5bcc-4d8f-875d-3ce3c9d12bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:06.885282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d3eef-5bcc-4d8f-875d-3ce3c9d12bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:06.913181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4d6d3eef-5bcc-4d8f-875d-3ce3c9d12bd8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:06.914756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4d6d3eef-5bcc-4d8f-875d-3ce3c9d12bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:06.929603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1122/2197] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:25:06.930344 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03b2c9-c199-4957-b2e1-c601e15aee64 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:06.949496 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03b2c9-c199-4957-b2e1-c601e15aee64 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:06.985309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ad949-06e8-4c36-9492-bc8e3b640d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:06.986516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ad949-06e8-4c36-9492-bc8e3b640d70 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:06.987042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ad949-06e8-4c36-9492-bc8e3b640d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:06.987672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ad949-06e8-4c36-9492-bc8e3b640d70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:06.989011 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ad949-06e8-4c36-9492-bc8e3b640d70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:25:06.989931 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ad949-06e8-4c36-9492-bc8e3b640d70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:06.994691 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ad949-06e8-4c36-9492-bc8e3b640d70 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:07.024090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1076/2198] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:25:07.029920 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d3eef-5bcc-4d8f-875d-3ce3c9d12bd8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:07.059348 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d3eef-5bcc-4d8f-875d-3ce3c9d12bd8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:07.069043 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfdce9-4d1f-46fb-92a0-92b15bba58d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:07.070848 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfdce9-4d1f-46fb-92a0-92b15bba58d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:07.071443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfdce9-4d1f-46fb-92a0-92b15bba58d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:07.071989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfdce9-4d1f-46fb-92a0-92b15bba58d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:07.073219 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfdce9-4d1f-46fb-92a0-92b15bba58d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:07.086219 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfdce9-4d1f-46fb-92a0-92b15bba58d9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:07.199220 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1123/2199] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:25:07 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:25:07.205754 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ad949-06e8-4c36-9492-bc8e3b640d70 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:07.220336 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:07.226881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ad949-06e8-4c36-9492-bc8e3b640d70 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:07.410318 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c38628-fff1-45ae-bc25-ff1fd4afecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:07.411582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c38628-fff1-45ae-bc25-ff1fd4afecc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:07.412259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c38628-fff1-45ae-bc25-ff1fd4afecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:07.412782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c38628-fff1-45ae-bc25-ff1fd4afecc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:07.415315 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c38628-fff1-45ae-bc25-ff1fd4afecc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:07.417719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c38628-fff1-45ae-bc25-ff1fd4afecc8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:07.459582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1077/2200] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:25:07 2022] POST /identity/v3/users => generated 288 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:25:07.481184 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfdce9-4d1f-46fb-92a0-92b15bba58d9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:07.503110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfdce9-4d1f-46fb-92a0-92b15bba58d9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:07.523579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2ac40-ede5-4f86-a3dc-043d2b318e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:07.525320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2ac40-ede5-4f86-a3dc-043d2b318e6c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:07.525846 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2ac40-ede5-4f86-a3dc-043d2b318e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:07.526324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2ac40-ede5-4f86-a3dc-043d2b318e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:07.527196 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2ac40-ede5-4f86-a3dc-043d2b318e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:07.529202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2ac40-ede5-4f86-a3dc-043d2b318e6c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:07.561330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1124/2201] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:25:07.567558 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c38628-fff1-45ae-bc25-ff1fd4afecc8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:07.580804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c38628-fff1-45ae-bc25-ff1fd4afecc8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:07.594957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c1162-35a1-4f8e-832e-fe4d185e12f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:07.595754 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c1162-35a1-4f8e-832e-fe4d185e12f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:07.596138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c1162-35a1-4f8e-832e-fe4d185e12f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:07.597027 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c1162-35a1-4f8e-832e-fe4d185e12f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:07.597911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c1162-35a1-4f8e-832e-fe4d185e12f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:07.607504 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c1162-35a1-4f8e-832e-fe4d185e12f3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:07.633485 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2ac40-ede5-4f86-a3dc-043d2b318e6c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:07.639902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1078/2202] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:25:07.658249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2ac40-ede5-4f86-a3dc-043d2b318e6c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:07.675156 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696afe1-1177-4d5f-ae93-866a0d001aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:07.676743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696afe1-1177-4d5f-ae93-866a0d001aee admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:07.677437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696afe1-1177-4d5f-ae93-866a0d001aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:07.678157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696afe1-1177-4d5f-ae93-866a0d001aee admin admin] PATH_INFO: `/v3/projects/201e1a32d8104de7bdbba47f15a0e699/users/a5c15c8eed06459c9c9d1b20538520fd/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:07.740503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696afe1-1177-4d5f-ae93-866a0d001aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=201e1a32d8104de7bdbba47f15a0e699, user_id=a5c15c8eed06459c9c9d1b20538520fd, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:07.749241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696afe1-1177-4d5f-ae93-866a0d001aee admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:07.784256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1125/2203] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:25:07 2022] PUT /identity/v3/projects/201e1a32d8104de7bdbba47f15a0e699/users/a5c15c8eed06459c9c9d1b20538520fd/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:07.801164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52591efc-9e56-4ae7-97c9-03530cca7f78 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:07.801431 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52591efc-9e56-4ae7-97c9-03530cca7f78 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:07.801712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52591efc-9e56-4ae7-97c9-03530cca7f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:07.918751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-52591efc-9e56-4ae7-97c9-03530cca7f78 None None] MFA Rules not processed for user `a5c15c8eed06459c9c9d1b20538520fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:07.920056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-52591efc-9e56-4ae7-97c9-03530cca7f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:08.096887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1079/2204] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:08.156537 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696afe1-1177-4d5f-ae93-866a0d001aee admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:08.170270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7696afe1-1177-4d5f-ae93-866a0d001aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:08.384189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696afe1-1177-4d5f-ae93-866a0d001aee admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:08.395523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff678b9b-52d6-449c-8c27-8bd65ca9f7c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:08.396269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678b9b-52d6-449c-8c27-8bd65ca9f7c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:08.396958 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678b9b-52d6-449c-8c27-8bd65ca9f7c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:08.398717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678b9b-52d6-449c-8c27-8bd65ca9f7c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:08.428149 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff678b9b-52d6-449c-8c27-8bd65ca9f7c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:08.433335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff678b9b-52d6-449c-8c27-8bd65ca9f7c1 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:08.458931 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1126/2205] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:25:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:25:11.176281 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52591efc-9e56-4ae7-97c9-03530cca7f78 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:11.179360 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-52591efc-9e56-4ae7-97c9-03530cca7f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:11.343132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52591efc-9e56-4ae7-97c9-03530cca7f78 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:11.350159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08406020-1de1-4ce6-b271-bc2582da8020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:11.351857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08406020-1de1-4ce6-b271-bc2582da8020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:11.352348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08406020-1de1-4ce6-b271-bc2582da8020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:11.352886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08406020-1de1-4ce6-b271-bc2582da8020 admin admin] PATH_INFO: `/v3/users/a541332d2bdf4b27bb74d6a0b1cf84a9` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:11.358017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08406020-1de1-4ce6-b271-bc2582da8020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a541332d2bdf4b27bb74d6a0b1cf84a9)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:11.360511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08406020-1de1-4ce6-b271-bc2582da8020 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:11.390762 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:11.467032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-08406020-1de1-4ce6-b271-bc2582da8020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a541332d2bdf4b27bb74d6a0b1cf84a9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:11.470797 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-08406020-1de1-4ce6-b271-bc2582da8020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a541332d2bdf4b27bb74d6a0b1cf84a9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:11.474260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-08406020-1de1-4ce6-b271-bc2582da8020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a541332d2bdf4b27bb74d6a0b1cf84a9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:11.487259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-08406020-1de1-4ce6-b271-bc2582da8020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a541332d2bdf4b27bb74d6a0b1cf84a9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:11.506389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-08406020-1de1-4ce6-b271-bc2582da8020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a541332d2bdf4b27bb74d6a0b1cf84a9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:11.531969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1080/2206] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:25:11 2022] DELETE /identity/v3/users/a541332d2bdf4b27bb74d6a0b1cf84a9 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:11.538238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7af8f-f8f0-48a2-8b1d-21ba6197e7bc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:11.539025 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7af8f-f8f0-48a2-8b1d-21ba6197e7bc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:11.539025 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7af8f-f8f0-48a2-8b1d-21ba6197e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:11.576785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b4a7af8f-f8f0-48a2-8b1d-21ba6197e7bc None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:11.578873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b4a7af8f-f8f0-48a2-8b1d-21ba6197e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:11.670316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1127/2207] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:11.685282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08406020-1de1-4ce6-b271-bc2582da8020 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:11.687478 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-08406020-1de1-4ce6-b271-bc2582da8020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:11.763863 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08406020-1de1-4ce6-b271-bc2582da8020 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:11.768718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef37ad2-0664-49de-b15b-6e864a22d1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:11.769447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef37ad2-0664-49de-b15b-6e864a22d1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:11.769782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef37ad2-0664-49de-b15b-6e864a22d1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:11.770070 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef37ad2-0664-49de-b15b-6e864a22d1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:11.782088 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef37ad2-0664-49de-b15b-6e864a22d1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:11.784300 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef37ad2-0664-49de-b15b-6e864a22d1a9 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:11.803090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1081/2208] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:25:12.190510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7af8f-f8f0-48a2-8b1d-21ba6197e7bc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:12.192070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b4a7af8f-f8f0-48a2-8b1d-21ba6197e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:12.204981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7af8f-f8f0-48a2-8b1d-21ba6197e7bc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:12.212118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a1870-2c9e-46be-938d-07b5ec2b0691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:12.212801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a1870-2c9e-46be-938d-07b5ec2b0691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:12.213078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a1870-2c9e-46be-938d-07b5ec2b0691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:12.213504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a1870-2c9e-46be-938d-07b5ec2b0691 admin admin] PATH_INFO: `/v3/projects/84c1a982280f4431ba1928a0e322a885` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:12.214760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a1870-2c9e-46be-938d-07b5ec2b0691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c1a982280f4431ba1928a0e322a885)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:12.216757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a1870-2c9e-46be-938d-07b5ec2b0691 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:12.237667 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:12.277681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee7a1870-2c9e-46be-938d-07b5ec2b0691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c1a982280f4431ba1928a0e322a885', 'request_id': 'req-ee7a1870-2c9e-46be-938d-07b5ec2b0691'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:12.283496 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee7a1870-2c9e-46be-938d-07b5ec2b0691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c1a982280f4431ba1928a0e322a885', 'request_id': 'req-ee7a1870-2c9e-46be-938d-07b5ec2b0691'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:12.293292 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee7a1870-2c9e-46be-938d-07b5ec2b0691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c1a982280f4431ba1928a0e322a885', 'request_id': 'req-ee7a1870-2c9e-46be-938d-07b5ec2b0691'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:12.305826 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee7a1870-2c9e-46be-938d-07b5ec2b0691 admin admin] The token cache is being invalidate because project 84c1a982280f4431ba1928a0e322a885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:25:12.306138 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee7a1870-2c9e-46be-938d-07b5ec2b0691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:12.306900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee7a1870-2c9e-46be-938d-07b5ec2b0691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:12.308608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1128/2209] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:25:12 2022] DELETE /identity/v3/projects/84c1a982280f4431ba1928a0e322a885 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:12.625826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef37ad2-0664-49de-b15b-6e864a22d1a9 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:12.627720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7ef37ad2-0664-49de-b15b-6e864a22d1a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:12.646920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef37ad2-0664-49de-b15b-6e864a22d1a9 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:12.749380 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a77c7-5d57-4951-95a9-7e1d4fa30127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:12.750250 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a77c7-5d57-4951-95a9-7e1d4fa30127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:12.750595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a77c7-5d57-4951-95a9-7e1d4fa30127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:12.750932 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a77c7-5d57-4951-95a9-7e1d4fa30127 admin admin] PATH_INFO: `/v3/users/a5c15c8eed06459c9c9d1b20538520fd` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:12.752448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a77c7-5d57-4951-95a9-7e1d4fa30127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5c15c8eed06459c9c9d1b20538520fd)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:12.755873 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a77c7-5d57-4951-95a9-7e1d4fa30127 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:12.860045 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:12.883575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ad5a77c7-5d57-4951-95a9-7e1d4fa30127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c15c8eed06459c9c9d1b20538520fd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:12.884652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ad5a77c7-5d57-4951-95a9-7e1d4fa30127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c15c8eed06459c9c9d1b20538520fd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:12.885702 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ad5a77c7-5d57-4951-95a9-7e1d4fa30127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c15c8eed06459c9c9d1b20538520fd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:12.901862 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ad5a77c7-5d57-4951-95a9-7e1d4fa30127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c15c8eed06459c9c9d1b20538520fd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:12.930393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ad5a77c7-5d57-4951-95a9-7e1d4fa30127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c15c8eed06459c9c9d1b20538520fd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:12.959287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1082/2210] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:25:12 2022] DELETE /identity/v3/users/a5c15c8eed06459c9c9d1b20538520fd => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:12.968632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc3cb1-645b-46ac-aa5a-c2c2ad1b5adc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:12.970095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc3cb1-645b-46ac-aa5a-c2c2ad1b5adc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:12.970587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc3cb1-645b-46ac-aa5a-c2c2ad1b5adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:13.004544 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d5fc3cb1-645b-46ac-aa5a-c2c2ad1b5adc None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:13.007316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d5fc3cb1-645b-46ac-aa5a-c2c2ad1b5adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:13.101322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1129/2211] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:13.114286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a77c7-5d57-4951-95a9-7e1d4fa30127 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:13.117357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ad5a77c7-5d57-4951-95a9-7e1d4fa30127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:13.196765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a77c7-5d57-4951-95a9-7e1d4fa30127 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:13.201938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797362d7-c853-4e8e-8881-a2dfae0aaca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:13.203224 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797362d7-c853-4e8e-8881-a2dfae0aaca0 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:13.203224 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797362d7-c853-4e8e-8881-a2dfae0aaca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:13.203224 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797362d7-c853-4e8e-8881-a2dfae0aaca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:13.215479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797362d7-c853-4e8e-8881-a2dfae0aaca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:13.217277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797362d7-c853-4e8e-8881-a2dfae0aaca0 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:13.229617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1083/2212] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:25:13.558659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc3cb1-645b-46ac-aa5a-c2c2ad1b5adc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:13.561040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d5fc3cb1-645b-46ac-aa5a-c2c2ad1b5adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:13.575491 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc3cb1-645b-46ac-aa5a-c2c2ad1b5adc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:13.581446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdda10-69e7-4f32-9919-07e8a487a27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:13.582090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdda10-69e7-4f32-9919-07e8a487a27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:13.582561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdda10-69e7-4f32-9919-07e8a487a27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:13.583008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdda10-69e7-4f32-9919-07e8a487a27c admin admin] PATH_INFO: `/v3/users/ba51eb2ef8b1445393c11c38201b7f0b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:13.585818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdda10-69e7-4f32-9919-07e8a487a27c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba51eb2ef8b1445393c11c38201b7f0b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:13.589406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdda10-69e7-4f32-9919-07e8a487a27c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:13.671161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9cbdda10-69e7-4f32-9919-07e8a487a27c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba51eb2ef8b1445393c11c38201b7f0b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:13.671873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9cbdda10-69e7-4f32-9919-07e8a487a27c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba51eb2ef8b1445393c11c38201b7f0b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:13.700424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9cbdda10-69e7-4f32-9919-07e8a487a27c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba51eb2ef8b1445393c11c38201b7f0b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:13.710834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9cbdda10-69e7-4f32-9919-07e8a487a27c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba51eb2ef8b1445393c11c38201b7f0b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:13.711713 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9cbdda10-69e7-4f32-9919-07e8a487a27c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba51eb2ef8b1445393c11c38201b7f0b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:13.731125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1130/2213] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:25:13 2022] DELETE /identity/v3/users/ba51eb2ef8b1445393c11c38201b7f0b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:13.736172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc14646-cc8a-4931-aa69-244710de508d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:13.736843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc14646-cc8a-4931-aa69-244710de508d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:13.736843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc14646-cc8a-4931-aa69-244710de508d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:13.765165 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5cc14646-cc8a-4931-aa69-244710de508d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:13.767741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5cc14646-cc8a-4931-aa69-244710de508d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:13.914765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1084/2214] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:14.012775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdda10-69e7-4f32-9919-07e8a487a27c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:14.015309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9cbdda10-69e7-4f32-9919-07e8a487a27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:14.056544 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:14.122730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdda10-69e7-4f32-9919-07e8a487a27c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:14.128888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69d4bb-3277-46ea-adba-95198decb05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:14.130500 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d4bb-3277-46ea-adba-95198decb05e service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:14.131117 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d4bb-3277-46ea-adba-95198decb05e service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:14.133505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d4bb-3277-46ea-adba-95198decb05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:14.151538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69d4bb-3277-46ea-adba-95198decb05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:14.155449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69d4bb-3277-46ea-adba-95198decb05e service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:14.173141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1131/2215] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:25:14.380511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc14646-cc8a-4931-aa69-244710de508d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:14.382392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5cc14646-cc8a-4931-aa69-244710de508d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:14.401918 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc14646-cc8a-4931-aa69-244710de508d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:14.411436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:14.413759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:14.414043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:14.414772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547 admin admin] PATH_INFO: `/v3/projects/201e1a32d8104de7bdbba47f15a0e699` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:14.415826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=201e1a32d8104de7bdbba47f15a0e699)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:14.417969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:14.520837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201e1a32d8104de7bdbba47f15a0e699', 'request_id': 'req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:14.524321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:14.532840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201e1a32d8104de7bdbba47f15a0e699', 'request_id': 'req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:14.542619 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201e1a32d8104de7bdbba47f15a0e699', 'request_id': 'req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:14.562997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547 admin admin] The token cache is being invalidate because project 201e1a32d8104de7bdbba47f15a0e699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:25:14.563543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:14.564262 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b6a8a4f-4b2d-44bf-b5aa-b99b6f79f547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:14.565990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1085/2216] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:25:14 2022] DELETE /identity/v3/projects/201e1a32d8104de7bdbba47f15a0e699 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:25:14.571778 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582f632-d68f-4f50-a655-4d1e15a2d28b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:14.572290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582f632-d68f-4f50-a655-4d1e15a2d28b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:14.588599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582f632-d68f-4f50-a655-4d1e15a2d28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:14.595103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f582f632-d68f-4f50-a655-4d1e15a2d28b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:14.596600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f582f632-d68f-4f50-a655-4d1e15a2d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:14.690515 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1132/2217] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:14.699942 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530facf3-7b22-45ff-88d9-89b8debdaa2e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:14.700198 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530facf3-7b22-45ff-88d9-89b8debdaa2e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:14.700431 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530facf3-7b22-45ff-88d9-89b8debdaa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:14.728163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-530facf3-7b22-45ff-88d9-89b8debdaa2e None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:14.729524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-530facf3-7b22-45ff-88d9-89b8debdaa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:14.741358 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1086/2218] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:14.745629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582f632-d68f-4f50-a655-4d1e15a2d28b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:14.757781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582f632-d68f-4f50-a655-4d1e15a2d28b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:14.764618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bcceb-4bf0-4bcf-b530-87be5b184180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:14.766865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bcceb-4bf0-4bcf-b530-87be5b184180 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:14.767598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bcceb-4bf0-4bcf-b530-87be5b184180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:14.768040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bcceb-4bf0-4bcf-b530-87be5b184180 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:14.769018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bcceb-4bf0-4bcf-b530-87be5b184180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:25:14.769561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bcceb-4bf0-4bcf-b530-87be5b184180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:14.774557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bcceb-4bf0-4bcf-b530-87be5b184180 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:14.800808 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530facf3-7b22-45ff-88d9-89b8debdaa2e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:14.807488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1133/2219] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:25:14.813650 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530facf3-7b22-45ff-88d9-89b8debdaa2e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:14.828310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2065a-192a-4ca5-958c-b59491efa861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:14.828310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2065a-192a-4ca5-958c-b59491efa861 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:14.828774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2065a-192a-4ca5-958c-b59491efa861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:14.829170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2065a-192a-4ca5-958c-b59491efa861 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:14.830142 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2065a-192a-4ca5-958c-b59491efa861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:14.832453 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2065a-192a-4ca5-958c-b59491efa861 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:14.875556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1087/2220] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:25:14 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:25:14.879698 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bcceb-4bf0-4bcf-b530-87be5b184180 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:14.892201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bcceb-4bf0-4bcf-b530-87be5b184180 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:14.977614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc07696-8089-4215-8ff3-cca43933099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:14.978692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc07696-8089-4215-8ff3-cca43933099f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:14.979192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc07696-8089-4215-8ff3-cca43933099f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:14.979674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc07696-8089-4215-8ff3-cca43933099f admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:14.980516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc07696-8089-4215-8ff3-cca43933099f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:14.983777 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc07696-8089-4215-8ff3-cca43933099f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:15.009214 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1134/2221] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:25:14 2022] POST /identity/v3/users => generated 285 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:25:15.014808 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2065a-192a-4ca5-958c-b59491efa861 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:15.029302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2065a-192a-4ca5-958c-b59491efa861 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:15.038157 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99687631-1fa2-4818-a728-5cd8870c5a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:15.038984 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99687631-1fa2-4818-a728-5cd8870c5a61 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.039337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99687631-1fa2-4818-a728-5cd8870c5a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.039681 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99687631-1fa2-4818-a728-5cd8870c5a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.040949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99687631-1fa2-4818-a728-5cd8870c5a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:15.042803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99687631-1fa2-4818-a728-5cd8870c5a61 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:15.059899 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1088/2222] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:25:15.064121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc07696-8089-4215-8ff3-cca43933099f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:15.064657 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99687631-1fa2-4818-a728-5cd8870c5a61 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:15.070160 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-99687631-1fa2-4818-a728-5cd8870c5a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:15.079702 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc07696-8089-4215-8ff3-cca43933099f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:15.093094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99687631-1fa2-4818-a728-5cd8870c5a61 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:15.101402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e91c3-4514-45d5-a317-67ea0623b59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:15.103004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e91c3-4514-45d5-a317-67ea0623b59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.103004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e91c3-4514-45d5-a317-67ea0623b59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.103004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e91c3-4514-45d5-a317-67ea0623b59f admin admin] PATH_INFO: `/v3/projects/f6ebdf421d43404f829f507e1b0d1faa` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.103971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982cd7b-6561-4e3b-a0ef-4a89b3267586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:15.104348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e91c3-4514-45d5-a317-67ea0623b59f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ebdf421d43404f829f507e1b0d1faa)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:15.104995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982cd7b-6561-4e3b-a0ef-4a89b3267586 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.105333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982cd7b-6561-4e3b-a0ef-4a89b3267586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.105697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982cd7b-6561-4e3b-a0ef-4a89b3267586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.106396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e91c3-4514-45d5-a317-67ea0623b59f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:15.106607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982cd7b-6561-4e3b-a0ef-4a89b3267586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:15.109388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982cd7b-6561-4e3b-a0ef-4a89b3267586 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:15.125606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1135/2223] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:25:15.128334 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982cd7b-6561-4e3b-a0ef-4a89b3267586 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:15.141480 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982cd7b-6561-4e3b-a0ef-4a89b3267586 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:15.151206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c308da-6b50-4eb6-b08c-ffbe1b4e8f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:15.151900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c308da-6b50-4eb6-b08c-ffbe1b4e8f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.152175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c308da-6b50-4eb6-b08c-ffbe1b4e8f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.152599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c308da-6b50-4eb6-b08c-ffbe1b4e8f1b admin admin] PATH_INFO: `/v3/projects/1e6cff8d577b44c4a3fad7319da58b40/users/123606454d414b62b58dc2980a70f402/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.171108 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c308da-6b50-4eb6-b08c-ffbe1b4e8f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6cff8d577b44c4a3fad7319da58b40, user_id=123606454d414b62b58dc2980a70f402, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:15.174126 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c308da-6b50-4eb6-b08c-ffbe1b4e8f1b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:15.175647 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ea9e91c3-4514-45d5-a317-67ea0623b59f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ebdf421d43404f829f507e1b0d1faa', 'request_id': 'req-ea9e91c3-4514-45d5-a317-67ea0623b59f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:15.189242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ea9e91c3-4514-45d5-a317-67ea0623b59f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ebdf421d43404f829f507e1b0d1faa', 'request_id': 'req-ea9e91c3-4514-45d5-a317-67ea0623b59f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:15.191689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1136/2224] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:25:15 2022] PUT /identity/v3/projects/1e6cff8d577b44c4a3fad7319da58b40/users/123606454d414b62b58dc2980a70f402/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:15.198255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ea9e91c3-4514-45d5-a317-67ea0623b59f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ebdf421d43404f829f507e1b0d1faa', 'request_id': 'req-ea9e91c3-4514-45d5-a317-67ea0623b59f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:15.204350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad1cf8-aad0-41ad-b7ad-03b869f73ccd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.204614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad1cf8-aad0-41ad-b7ad-03b869f73ccd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.205106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad1cf8-aad0-41ad-b7ad-03b869f73ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.213559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:15.219327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ea9e91c3-4514-45d5-a317-67ea0623b59f admin admin] The token cache is being invalidate because project f6ebdf421d43404f829f507e1b0d1faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:25:15.219865 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ea9e91c3-4514-45d5-a317-67ea0623b59f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:15.220989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ea9e91c3-4514-45d5-a317-67ea0623b59f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:15.222924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1089/2225] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:25:15 2022] DELETE /identity/v3/projects/f6ebdf421d43404f829f507e1b0d1faa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:15.229010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebe5f2-0f2b-4259-bd2c-02cdf778de6f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.229540 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebe5f2-0f2b-4259-bd2c-02cdf778de6f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.230264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebe5f2-0f2b-4259-bd2c-02cdf778de6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.245957 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-74ad1cf8-aad0-41ad-b7ad-03b869f73ccd None None] MFA Rules not processed for user `123606454d414b62b58dc2980a70f402`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:15.247310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-74ad1cf8-aad0-41ad-b7ad-03b869f73ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:15.260038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b9ebe5f2-0f2b-4259-bd2c-02cdf778de6f None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:15.261339 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b9ebe5f2-0f2b-4259-bd2c-02cdf778de6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:15.342190 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1137/2226] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:15.354741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad1cf8-aad0-41ad-b7ad-03b869f73ccd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:15.356457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-74ad1cf8-aad0-41ad-b7ad-03b869f73ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:15.387440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1090/2227] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:15.396564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934be02-d496-4508-ac1c-9c2066169cf8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.396947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934be02-d496-4508-ac1c-9c2066169cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.397211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934be02-d496-4508-ac1c-9c2066169cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.419301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0934be02-d496-4508-ac1c-9c2066169cf8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:15.420543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0934be02-d496-4508-ac1c-9c2066169cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:15.434027 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1091/2228] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:25:15.436228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934be02-d496-4508-ac1c-9c2066169cf8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:15.438551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad1cf8-aad0-41ad-b7ad-03b869f73ccd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:15.442657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a2a0f-f01a-4102-be90-19b71cbbdac9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2974669e9d1a417892b1d59dbc9e87ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:15.443465 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2a0f-f01a-4102-be90-19b71cbbdac9 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.444483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2a0f-f01a-4102-be90-19b71cbbdac9 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.445021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2a0f-f01a-4102-be90-19b71cbbdac9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.455169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a2a0f-f01a-4102-be90-19b71cbbdac9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:15.457178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a2a0f-f01a-4102-be90-19b71cbbdac9 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:15.457717 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934be02-d496-4508-ac1c-9c2066169cf8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:15.465112 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83bb82-1a95-43da-9223-7aa171b419b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:15.465684 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83bb82-1a95-43da-9223-7aa171b419b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.466017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83bb82-1a95-43da-9223-7aa171b419b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.466248 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83bb82-1a95-43da-9223-7aa171b419b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.466910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83bb82-1a95-43da-9223-7aa171b419b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:25:15.467209 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83bb82-1a95-43da-9223-7aa171b419b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:15.469001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83bb82-1a95-43da-9223-7aa171b419b4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:15.473611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1138/2229] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:25:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:25:15.482167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1092/2230] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:25:15.487715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a2a0f-f01a-4102-be90-19b71cbbdac9 service glance] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:15.505957 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a2a0f-f01a-4102-be90-19b71cbbdac9 service glance] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:15.521649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b032e3f-e5cb-46a0-9341-687ea4b0ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:15.522443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b032e3f-e5cb-46a0-9341-687ea4b0ede3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.522724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b032e3f-e5cb-46a0-9341-687ea4b0ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.522998 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b032e3f-e5cb-46a0-9341-687ea4b0ede3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.523636 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b032e3f-e5cb-46a0-9341-687ea4b0ede3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:15.525805 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b032e3f-e5cb-46a0-9341-687ea4b0ede3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:15.566743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1139/2231] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:25:15 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:25:15.566944 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83bb82-1a95-43da-9223-7aa171b419b4 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:15.574562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:15.579238 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83bb82-1a95-43da-9223-7aa171b419b4 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:15.655674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa93f6e-7ec5-4afe-b797-8660f4360ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:15.656756 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa93f6e-7ec5-4afe-b797-8660f4360ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.656756 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa93f6e-7ec5-4afe-b797-8660f4360ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.656979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa93f6e-7ec5-4afe-b797-8660f4360ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.657572 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa93f6e-7ec5-4afe-b797-8660f4360ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:15.661514 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa93f6e-7ec5-4afe-b797-8660f4360ce7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:15.690030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1093/2232] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:25:15 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:25:15.694102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b032e3f-e5cb-46a0-9341-687ea4b0ede3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:15.712448 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b032e3f-e5cb-46a0-9341-687ea4b0ede3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:15.719769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8005aa6-7656-4143-9b5c-7346fc650cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:15.721582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8005aa6-7656-4143-9b5c-7346fc650cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.722124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8005aa6-7656-4143-9b5c-7346fc650cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.723249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8005aa6-7656-4143-9b5c-7346fc650cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.724444 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8005aa6-7656-4143-9b5c-7346fc650cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:15.727711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8005aa6-7656-4143-9b5c-7346fc650cdc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:15.742733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1140/2233] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:25:15.747670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa93f6e-7ec5-4afe-b797-8660f4360ce7 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:15.758792 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa93f6e-7ec5-4afe-b797-8660f4360ce7 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:15.765480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2ad03-290d-45e6-a23d-880baff10a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:15.766100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2ad03-290d-45e6-a23d-880baff10a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.766383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2ad03-290d-45e6-a23d-880baff10a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.766655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2ad03-290d-45e6-a23d-880baff10a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.767303 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2ad03-290d-45e6-a23d-880baff10a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:15.768948 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2ad03-290d-45e6-a23d-880baff10a5d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:15.782002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1094/2234] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:25:15.785939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8005aa6-7656-4143-9b5c-7346fc650cdc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:15.804919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8005aa6-7656-4143-9b5c-7346fc650cdc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:15.810096 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57fba2-dfeb-4f9d-a9cf-1c7d98ee3601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:15.810763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57fba2-dfeb-4f9d-a9cf-1c7d98ee3601 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.811036 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57fba2-dfeb-4f9d-a9cf-1c7d98ee3601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.811307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57fba2-dfeb-4f9d-a9cf-1c7d98ee3601 admin admin] PATH_INFO: `/v3/projects/edb8c48f60b64c9d9550d5c8fdf9043d/users/f0016eb572294fd6835c730b8c2b26c2/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.829058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57fba2-dfeb-4f9d-a9cf-1c7d98ee3601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb8c48f60b64c9d9550d5c8fdf9043d, user_id=f0016eb572294fd6835c730b8c2b26c2, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:15.832605 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57fba2-dfeb-4f9d-a9cf-1c7d98ee3601 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:15.848305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1141/2235] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:25:15 2022] PUT /identity/v3/projects/edb8c48f60b64c9d9550d5c8fdf9043d/users/f0016eb572294fd6835c730b8c2b26c2/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:25:15.854433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4df5e1-1481-4c16-999a-48cf6fdda1f2 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:15.854719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4df5e1-1481-4c16-999a-48cf6fdda1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:15.855012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4df5e1-1481-4c16-999a-48cf6fdda1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:15.878576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5f4df5e1-1481-4c16-999a-48cf6fdda1f2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:15.880239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5f4df5e1-1481-4c16-999a-48cf6fdda1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:15.952269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1095/2236] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:15.963305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57fba2-dfeb-4f9d-a9cf-1c7d98ee3601 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:15.965565 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ae57fba2-dfeb-4f9d-a9cf-1c7d98ee3601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:16.019032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:16.037145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57fba2-dfeb-4f9d-a9cf-1c7d98ee3601 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:16.041430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4ea6a-38cf-40ce-ae87-9995ef83b76f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:16.042042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4ea6a-38cf-40ce-ae87-9995ef83b76f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:16.042349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4ea6a-38cf-40ce-ae87-9995ef83b76f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:16.042620 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4ea6a-38cf-40ce-ae87-9995ef83b76f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:16.052345 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4ea6a-38cf-40ce-ae87-9995ef83b76f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:16.054464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4ea6a-38cf-40ce-ae87-9995ef83b76f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:16.063788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1142/2237] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:25:23.068997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999a8fa-46d4-44fb-8851-599de2367047 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:23.069572 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999a8fa-46d4-44fb-8851-599de2367047 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:23.069572 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999a8fa-46d4-44fb-8851-599de2367047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:23.117737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a999a8fa-46d4-44fb-8851-599de2367047 None None] MFA Rules not processed for user `f0016eb572294fd6835c730b8c2b26c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:23.119206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a999a8fa-46d4-44fb-8851-599de2367047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:23.237788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1096/2238] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:23.239786 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4ea6a-38cf-40ce-ae87-9995ef83b76f service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:23.254844 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4ea6a-38cf-40ce-ae87-9995ef83b76f service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:23.265688 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5834f-cf02-4ec6-8c84-7f136104a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:23.266874 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5834f-cf02-4ec6-8c84-7f136104a3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:23.267463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5834f-cf02-4ec6-8c84-7f136104a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:23.268042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5834f-cf02-4ec6-8c84-7f136104a3f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:23.269421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5834f-cf02-4ec6-8c84-7f136104a3f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:23.274193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5834f-cf02-4ec6-8c84-7f136104a3f6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:23.324909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1143/2239] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:25:23 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:25:23.330455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999a8fa-46d4-44fb-8851-599de2367047 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:23.344140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999a8fa-46d4-44fb-8851-599de2367047 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:23.355821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:23.420259 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b8142-75a6-4866-b5b4-a33bd88ac13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:23.420912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8142-75a6-4866-b5b4-a33bd88ac13c admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:23.421195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8142-75a6-4866-b5b4-a33bd88ac13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:23.421470 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8142-75a6-4866-b5b4-a33bd88ac13c admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:23.422128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b8142-75a6-4866-b5b4-a33bd88ac13c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:23.424118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b8142-75a6-4866-b5b4-a33bd88ac13c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:23.476330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5834f-cf02-4ec6-8c84-7f136104a3f6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:23.477131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1097/2240] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:25:23 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:25:23.491690 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5834f-cf02-4ec6-8c84-7f136104a3f6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:23.498282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d42f7f-615a-4b23-ad1b-faf08615636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:23.499215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d42f7f-615a-4b23-ad1b-faf08615636f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:23.500153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d42f7f-615a-4b23-ad1b-faf08615636f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:23.500153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d42f7f-615a-4b23-ad1b-faf08615636f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:23.500558 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d42f7f-615a-4b23-ad1b-faf08615636f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:23.502503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d42f7f-615a-4b23-ad1b-faf08615636f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:23.520674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1144/2241] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:25:23.526061 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b8142-75a6-4866-b5b4-a33bd88ac13c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:23.561872 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b8142-75a6-4866-b5b4-a33bd88ac13c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:23.578433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8cc2b-7b93-42e9-a3ec-a7286e73c0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:23.582191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8cc2b-7b93-42e9-a3ec-a7286e73c0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:23.582191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8cc2b-7b93-42e9-a3ec-a7286e73c0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:23.582191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8cc2b-7b93-42e9-a3ec-a7286e73c0cc admin admin] PATH_INFO: `/v3/projects/a00966f3838b4cd1a1d37d16eea32830/users/06e7743eeeb24c499368571b350c5e27/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:23.647507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8cc2b-7b93-42e9-a3ec-a7286e73c0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00966f3838b4cd1a1d37d16eea32830, user_id=06e7743eeeb24c499368571b350c5e27, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:23.652862 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8cc2b-7b93-42e9-a3ec-a7286e73c0cc admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:23.695504 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1098/2242] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:25:23 2022] PUT /identity/v3/projects/a00966f3838b4cd1a1d37d16eea32830/users/06e7743eeeb24c499368571b350c5e27/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:23.701120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d42f7f-615a-4b23-ad1b-faf08615636f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:23.727998 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d42f7f-615a-4b23-ad1b-faf08615636f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:23.830129 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41d046-202c-4216-9491-2956653e824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:23.831191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41d046-202c-4216-9491-2956653e824d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:23.831576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41d046-202c-4216-9491-2956653e824d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:23.831943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41d046-202c-4216-9491-2956653e824d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:23.832745 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41d046-202c-4216-9491-2956653e824d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:23.835778 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41d046-202c-4216-9491-2956653e824d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:23.849524 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1145/2243] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:25:23.854814 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8cc2b-7b93-42e9-a3ec-a7286e73c0cc admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:23.877945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8cc2b-7b93-42e9-a3ec-a7286e73c0cc admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:23.894088 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e84289-4998-4332-a1af-7a1f3849c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:23.895689 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e84289-4998-4332-a1af-7a1f3849c509 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:23.896300 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e84289-4998-4332-a1af-7a1f3849c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:23.897449 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e84289-4998-4332-a1af-7a1f3849c509 admin admin] PATH_INFO: `/v3/projects/a00966f3838b4cd1a1d37d16eea32830/users/06e7743eeeb24c499368571b350c5e27/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:23.901194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e84289-4998-4332-a1af-7a1f3849c509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00966f3838b4cd1a1d37d16eea32830, user_id=06e7743eeeb24c499368571b350c5e27, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:23.906205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e84289-4998-4332-a1af-7a1f3849c509 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:23.924524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1099/2244] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:25:23 2022] PUT /identity/v3/projects/a00966f3838b4cd1a1d37d16eea32830/users/06e7743eeeb24c499368571b350c5e27/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:31.541140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2f204-79c2-4bc5-ba13-8b072c4b0595 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:31.541622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2f204-79c2-4bc5-ba13-8b072c4b0595 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:31.541622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2f204-79c2-4bc5-ba13-8b072c4b0595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:31.574372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-83b2f204-79c2-4bc5-ba13-8b072c4b0595 None None] MFA Rules not processed for user `06e7743eeeb24c499368571b350c5e27`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:31.575607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-83b2f204-79c2-4bc5-ba13-8b072c4b0595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:31.671605 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1146/2245] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:31.686623 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e84289-4998-4332-a1af-7a1f3849c509 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:31.762364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e84289-4998-4332-a1af-7a1f3849c509 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:31.766038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6b444-7aae-43df-9810-45a347f07260 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2974669e9d1a417892b1d59dbc9e87ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:31.766675 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6b444-7aae-43df-9810-45a347f07260 service glance] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:31.766953 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6b444-7aae-43df-9810-45a347f07260 service glance] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:31.767219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6b444-7aae-43df-9810-45a347f07260 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:31.837597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6b444-7aae-43df-9810-45a347f07260 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:31.839119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6b444-7aae-43df-9810-45a347f07260 service glance] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:31.850599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1100/2246] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:25:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:25:32.133551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d517-ad8a-4c53-aa95-7af0a0372087 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:32.133834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d517-ad8a-4c53-aa95-7af0a0372087 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:32.134609 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d517-ad8a-4c53-aa95-7af0a0372087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:32.169865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2ef1d517-ad8a-4c53-aa95-7af0a0372087 None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:32.171391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2ef1d517-ad8a-4c53-aa95-7af0a0372087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:32.225392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:32.274525 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1147/2247] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:25:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:25:32.339971 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6b444-7aae-43df-9810-45a347f07260 service glance] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:32.341680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-98f6b444-7aae-43df-9810-45a347f07260 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:32.368312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:32.446257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6b444-7aae-43df-9810-45a347f07260 service glance] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:32.453816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9e474-7e50-45bb-bb26-7181a007c21d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:32.454820 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9e474-7e50-45bb-bb26-7181a007c21d service swift] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:32.455277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9e474-7e50-45bb-bb26-7181a007c21d service swift] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:32.455988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9e474-7e50-45bb-bb26-7181a007c21d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:32.477503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9e474-7e50-45bb-bb26-7181a007c21d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:32.480655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9e474-7e50-45bb-bb26-7181a007c21d service swift] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:32.495659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1101/2248] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:25:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:25:39.184858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1d517-ad8a-4c53-aa95-7af0a0372087 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:39.188929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2ef1d517-ad8a-4c53-aa95-7af0a0372087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:39.308495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1d517-ad8a-4c53-aa95-7af0a0372087 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:39.317602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ab101-dcc8-4c31-ad8a-47d3fc04fb1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:39.318669 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab101-dcc8-4c31-ad8a-47d3fc04fb1e service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:39.319131 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab101-dcc8-4c31-ad8a-47d3fc04fb1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:39.319530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab101-dcc8-4c31-ad8a-47d3fc04fb1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:39.323656 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d53ab101-dcc8-4c31-ad8a-47d3fc04fb1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:39.455980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ab101-dcc8-4c31-ad8a-47d3fc04fb1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:39.457959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ab101-dcc8-4c31-ad8a-47d3fc04fb1e service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:39.476079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1148/2249] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:25:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:25:42.491038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=23 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:45.926020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15906-6edf-478b-b237-a113bcd11173 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:45.927909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15906-6edf-478b-b237-a113bcd11173 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:45.927909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15906-6edf-478b-b237-a113bcd11173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:45.955691 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b6c15906-6edf-478b-b237-a113bcd11173 None None] MFA Rules not processed for user `f0016eb572294fd6835c730b8c2b26c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:45.958047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b6c15906-6edf-478b-b237-a113bcd11173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:45.971256 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1102/2250] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:49.002384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f545740-7717-4296-8414-78a994cea89a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:49.003023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f545740-7717-4296-8414-78a994cea89a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:49.003394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f545740-7717-4296-8414-78a994cea89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:49.049354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5f545740-7717-4296-8414-78a994cea89a None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:49.051116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5f545740-7717-4296-8414-78a994cea89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:49.064008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1149/2251] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:25:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:49.084194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c15906-6edf-478b-b237-a113bcd11173 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:49.105993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c15906-6edf-478b-b237-a113bcd11173 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:49.114685 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433ef6e-5248-4e92-9835-431bf4a765b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:49.115810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ef6e-5248-4e92-9835-431bf4a765b3 service swift] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:49.116364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ef6e-5248-4e92-9835-431bf4a765b3 service swift] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:49.117192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ef6e-5248-4e92-9835-431bf4a765b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:49.137602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433ef6e-5248-4e92-9835-431bf4a765b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:49.140724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433ef6e-5248-4e92-9835-431bf4a765b3 service swift] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:49.157787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1103/2252] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:25:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 21 16:25:52.708084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f545740-7717-4296-8414-78a994cea89a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:52.709854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5f545740-7717-4296-8414-78a994cea89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:52.809292 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f545740-7717-4296-8414-78a994cea89a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:52.815392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee52d78-8641-43d6-a0da-e0a96f27c41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:52.816209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52d78-8641-43d6-a0da-e0a96f27c41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:52.816597 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52d78-8641-43d6-a0da-e0a96f27c41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:52.817745 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52d78-8641-43d6-a0da-e0a96f27c41b admin admin] PATH_INFO: `/v3/users/123606454d414b62b58dc2980a70f402` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:52.819961 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee52d78-8641-43d6-a0da-e0a96f27c41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=123606454d414b62b58dc2980a70f402)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:52.822891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee52d78-8641-43d6-a0da-e0a96f27c41b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:52.867568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:52.920788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ee52d78-8641-43d6-a0da-e0a96f27c41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123606454d414b62b58dc2980a70f402'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:52.921853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ee52d78-8641-43d6-a0da-e0a96f27c41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123606454d414b62b58dc2980a70f402'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:52.948015 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ee52d78-8641-43d6-a0da-e0a96f27c41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123606454d414b62b58dc2980a70f402'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:52.963081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ee52d78-8641-43d6-a0da-e0a96f27c41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123606454d414b62b58dc2980a70f402'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:52.964620 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ee52d78-8641-43d6-a0da-e0a96f27c41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123606454d414b62b58dc2980a70f402'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:52.988092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1150/2253] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:25:52 2022] DELETE /identity/v3/users/123606454d414b62b58dc2980a70f402 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:52.993547 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3459-f8d2-4bc4-a05c-ed25d758c6a1 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:52.994522 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3459-f8d2-4bc4-a05c-ed25d758c6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:52.994710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3459-f8d2-4bc4-a05c-ed25d758c6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:53.023300 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-910b3459-f8d2-4bc4-a05c-ed25d758c6a1 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:53.024542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-910b3459-f8d2-4bc4-a05c-ed25d758c6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:53.195974 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1104/2254] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:25:53.212332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee52d78-8641-43d6-a0da-e0a96f27c41b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:53.214424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3ee52d78-8641-43d6-a0da-e0a96f27c41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:53.376037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee52d78-8641-43d6-a0da-e0a96f27c41b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:53.385171 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822e9a7-6479-451c-b179-6bc6f78a2251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:53.386307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822e9a7-6479-451c-b179-6bc6f78a2251 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:53.386833 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822e9a7-6479-451c-b179-6bc6f78a2251 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:53.387351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822e9a7-6479-451c-b179-6bc6f78a2251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:53.406489 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822e9a7-6479-451c-b179-6bc6f78a2251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:53.408599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822e9a7-6479-451c-b179-6bc6f78a2251 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:53.421777 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1151/2255] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:25:54.048131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b3459-f8d2-4bc4-a05c-ed25d758c6a1 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:54.051648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-910b3459-f8d2-4bc4-a05c-ed25d758c6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:54.109610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b3459-f8d2-4bc4-a05c-ed25d758c6a1 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:54.138847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1077f-604a-4c19-baab-dddcd381e276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:54.139938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1077f-604a-4c19-baab-dddcd381e276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:54.140397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1077f-604a-4c19-baab-dddcd381e276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:54.141133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1077f-604a-4c19-baab-dddcd381e276 admin admin] PATH_INFO: `/v3/projects/1e6cff8d577b44c4a3fad7319da58b40` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:54.150212 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1077f-604a-4c19-baab-dddcd381e276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6cff8d577b44c4a3fad7319da58b40)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:54.154597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1077f-604a-4c19-baab-dddcd381e276 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:54.255885 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-eac1077f-604a-4c19-baab-dddcd381e276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6cff8d577b44c4a3fad7319da58b40', 'request_id': 'req-eac1077f-604a-4c19-baab-dddcd381e276'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:54.303228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-eac1077f-604a-4c19-baab-dddcd381e276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6cff8d577b44c4a3fad7319da58b40', 'request_id': 'req-eac1077f-604a-4c19-baab-dddcd381e276'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:54.322746 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-eac1077f-604a-4c19-baab-dddcd381e276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6cff8d577b44c4a3fad7319da58b40', 'request_id': 'req-eac1077f-604a-4c19-baab-dddcd381e276'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:54.348444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-eac1077f-604a-4c19-baab-dddcd381e276 admin admin] The token cache is being invalidate because project 1e6cff8d577b44c4a3fad7319da58b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:25:54.349050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-eac1077f-604a-4c19-baab-dddcd381e276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:54.359417 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-eac1077f-604a-4c19-baab-dddcd381e276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:25:54.361356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1105/2256] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:25:54 2022] DELETE /identity/v3/projects/1e6cff8d577b44c4a3fad7319da58b40 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:54.365147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb15f0-ae4c-42d9-a248-1a419d013d6f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:54.366350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb15f0-ae4c-42d9-a248-1a419d013d6f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:54.366350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb15f0-ae4c-42d9-a248-1a419d013d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:54.407128 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a0bb15f0-ae4c-42d9-a248-1a419d013d6f None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:54.409918 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a0bb15f0-ae4c-42d9-a248-1a419d013d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:54.555408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1152/2257] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:25:54.557540 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db51be-80b5-4127-a41d-660f93718738 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:54.557805 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db51be-80b5-4127-a41d-660f93718738 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:54.558277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db51be-80b5-4127-a41d-660f93718738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:54.631192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-37db51be-80b5-4127-a41d-660f93718738 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:54.633364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-37db51be-80b5-4127-a41d-660f93718738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:54.656421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1106/2258] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:25:54.661631 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb15f0-ae4c-42d9-a248-1a419d013d6f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:54.672616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb15f0-ae4c-42d9-a248-1a419d013d6f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:54.678253 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0924cfc-d87b-4fe0-9222-6a4559b85040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:54.678889 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0924cfc-d87b-4fe0-9222-6a4559b85040 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:54.679172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0924cfc-d87b-4fe0-9222-6a4559b85040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:54.679445 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0924cfc-d87b-4fe0-9222-6a4559b85040 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:54.680160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0924cfc-d87b-4fe0-9222-6a4559b85040 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:25:54.681457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0924cfc-d87b-4fe0-9222-6a4559b85040 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:54.682327 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0924cfc-d87b-4fe0-9222-6a4559b85040 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:54.697159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1153/2259] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:25:54.703839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db51be-80b5-4127-a41d-660f93718738 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:54.714660 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db51be-80b5-4127-a41d-660f93718738 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:54.720231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdcb92-7709-4c89-b606-4310913f3458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:54.720924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdcb92-7709-4c89-b606-4310913f3458 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:54.721210 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdcb92-7709-4c89-b606-4310913f3458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:54.721487 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdcb92-7709-4c89-b606-4310913f3458 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:54.722148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdcb92-7709-4c89-b606-4310913f3458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:54.732744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdcb92-7709-4c89-b606-4310913f3458 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:54.781342 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1107/2260] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:25:54 2022] POST /identity/v3/projects => generated 363 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:25:54.781577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0924cfc-d87b-4fe0-9222-6a4559b85040 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:54.807140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0924cfc-d87b-4fe0-9222-6a4559b85040 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:54.861703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:54.921564 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d2ead-c432-4198-889c-d96a12ff215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:54.922249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d2ead-c432-4198-889c-d96a12ff215a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:54.922884 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d2ead-c432-4198-889c-d96a12ff215a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:54.922884 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d2ead-c432-4198-889c-d96a12ff215a admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:54.923784 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d2ead-c432-4198-889c-d96a12ff215a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:54.927714 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d2ead-c432-4198-889c-d96a12ff215a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:54.954211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1154/2261] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:25:54 2022] POST /identity/v3/users => generated 282 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:25:54.961382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdcb92-7709-4c89-b606-4310913f3458 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:54.982705 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdcb92-7709-4c89-b606-4310913f3458 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:54.992218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfab89-fa5a-4738-8995-e606644ca0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:54.993519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfab89-fa5a-4738-8995-e606644ca0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:54.994430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfab89-fa5a-4738-8995-e606644ca0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:54.995203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfab89-fa5a-4738-8995-e606644ca0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:54.996646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfab89-fa5a-4738-8995-e606644ca0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:55.000337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfab89-fa5a-4738-8995-e606644ca0c1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:55.028149 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1108/2262] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:25:55.029961 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d2ead-c432-4198-889c-d96a12ff215a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:55.049888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d2ead-c432-4198-889c-d96a12ff215a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:55.094236 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0761b5-ddbb-4bbf-a356-d0df569e1c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:55.095603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0761b5-ddbb-4bbf-a356-d0df569e1c7c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:55.095998 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0761b5-ddbb-4bbf-a356-d0df569e1c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:55.096439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0761b5-ddbb-4bbf-a356-d0df569e1c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:55.097792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0761b5-ddbb-4bbf-a356-d0df569e1c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:55.101817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0761b5-ddbb-4bbf-a356-d0df569e1c7c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:55.117509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1155/2263] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:25:55.124147 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfab89-fa5a-4738-8995-e606644ca0c1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:55.143117 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfab89-fa5a-4738-8995-e606644ca0c1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:55.151777 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13c5ee-84fa-4ee6-a593-bd6b4358cc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:55.152886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13c5ee-84fa-4ee6-a593-bd6b4358cc41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:55.153366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13c5ee-84fa-4ee6-a593-bd6b4358cc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:55.153819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13c5ee-84fa-4ee6-a593-bd6b4358cc41 admin admin] PATH_INFO: `/v3/projects/9b637e25d50645e6922e49b769d203ff/users/6f05f50ac98f46728f83c3284bb09775/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:55.180369 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13c5ee-84fa-4ee6-a593-bd6b4358cc41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b637e25d50645e6922e49b769d203ff, user_id=6f05f50ac98f46728f83c3284bb09775, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:55.185830 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13c5ee-84fa-4ee6-a593-bd6b4358cc41 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:55.203574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:55.211766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1109/2264] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:25:55 2022] PUT /identity/v3/projects/9b637e25d50645e6922e49b769d203ff/users/6f05f50ac98f46728f83c3284bb09775/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:25:55.228170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f9328-9f42-4000-9654-9f285bf3e253 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:55.228668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f9328-9f42-4000-9654-9f285bf3e253 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:55.229195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f9328-9f42-4000-9654-9f285bf3e253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:55.283516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e52f9328-9f42-4000-9654-9f285bf3e253 None None] MFA Rules not processed for user `6f05f50ac98f46728f83c3284bb09775`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:25:55.285252 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e52f9328-9f42-4000-9654-9f285bf3e253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:55.508772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1156/2265] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:25:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:25:55.523165 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13c5ee-84fa-4ee6-a593-bd6b4358cc41 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:25:55.526354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8c13c5ee-84fa-4ee6-a593-bd6b4358cc41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:25:55.645045 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13c5ee-84fa-4ee6-a593-bd6b4358cc41 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:25:55.658747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aeb7ec-46c9-4501-8bc3-3206f5ec8503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:25:55.662026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aeb7ec-46c9-4501-8bc3-3206f5ec8503 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:25:55.662518 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aeb7ec-46c9-4501-8bc3-3206f5ec8503 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:25:55.663016 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aeb7ec-46c9-4501-8bc3-3206f5ec8503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:25:55.690050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aeb7ec-46c9-4501-8bc3-3206f5ec8503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:25:55.692477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aeb7ec-46c9-4501-8bc3-3206f5ec8503 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:25:55.714211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1110/2266] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:25:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:26:05.481982 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=54,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:05.704048 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=26 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:07.533990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f9328-9f42-4000-9654-9f285bf3e253 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:07.537426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e52f9328-9f42-4000-9654-9f285bf3e253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:07.620823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f9328-9f42-4000-9654-9f285bf3e253 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:07.625746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555259f-4314-469c-9999-b69bc20ad0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:07.626411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555259f-4314-469c-9999-b69bc20ad0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:07.626707 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555259f-4314-469c-9999-b69bc20ad0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:07.627009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555259f-4314-469c-9999-b69bc20ad0ae admin admin] PATH_INFO: `/v3/users/01f5cc480b164f6db77f52ac31247da6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:07.628271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555259f-4314-469c-9999-b69bc20ad0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f5cc480b164f6db77f52ac31247da6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:07.630404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555259f-4314-469c-9999-b69bc20ad0ae admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:07.703361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7555259f-4314-469c-9999-b69bc20ad0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f5cc480b164f6db77f52ac31247da6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:07.704336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7555259f-4314-469c-9999-b69bc20ad0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f5cc480b164f6db77f52ac31247da6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:07.723023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7555259f-4314-469c-9999-b69bc20ad0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f5cc480b164f6db77f52ac31247da6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:07.734667 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7555259f-4314-469c-9999-b69bc20ad0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f5cc480b164f6db77f52ac31247da6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:07.735603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7555259f-4314-469c-9999-b69bc20ad0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f5cc480b164f6db77f52ac31247da6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:07.760652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1157/2267] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:26:07 2022] DELETE /identity/v3/users/01f5cc480b164f6db77f52ac31247da6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:26:08.099656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aeb7ec-46c9-4501-8bc3-3206f5ec8503 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:08.113876 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aeb7ec-46c9-4501-8bc3-3206f5ec8503 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:08.223467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:08.224867 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:08.225183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:08.225420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] PATH_INFO: `/v3/projects/9cb67eec245145b9999d1cfc2e472ada` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:08.226718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb67eec245145b9999d1cfc2e472ada)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:08.228705 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:08.303987 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb67eec245145b9999d1cfc2e472ada', 'request_id': 'req-8483e052-a212-4d0e-8239-faac306734dc'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:08.316553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb67eec245145b9999d1cfc2e472ada', 'request_id': 'req-8483e052-a212-4d0e-8239-faac306734dc'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:08.328169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb67eec245145b9999d1cfc2e472ada', 'request_id': 'req-8483e052-a212-4d0e-8239-faac306734dc'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:08.346324 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] The token cache is being invalidate because project 9cb67eec245145b9999d1cfc2e472ada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:26:08.346754 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:08.348388 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:08.351038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1111/2268] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:26:08 2022] DELETE /identity/v3/projects/9cb67eec245145b9999d1cfc2e472ada => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:26:08.356955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555259f-4314-469c-9999-b69bc20ad0ae admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:08.358833 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7555259f-4314-469c-9999-b69bc20ad0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:08.375015 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555259f-4314-469c-9999-b69bc20ad0ae admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:08.452191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a904a8e-39b6-4e43-adb3-da2aa3411389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:08.453047 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a904a8e-39b6-4e43-adb3-da2aa3411389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:08.453323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a904a8e-39b6-4e43-adb3-da2aa3411389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:08.453589 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a904a8e-39b6-4e43-adb3-da2aa3411389 admin admin] PATH_INFO: `/v3/users/db71245d19ee41909aed8998275665a2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:08.455166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a904a8e-39b6-4e43-adb3-da2aa3411389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db71245d19ee41909aed8998275665a2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:08.457303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a904a8e-39b6-4e43-adb3-da2aa3411389 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:08.486778 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:08.529131 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a904a8e-39b6-4e43-adb3-da2aa3411389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db71245d19ee41909aed8998275665a2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:08.529934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a904a8e-39b6-4e43-adb3-da2aa3411389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db71245d19ee41909aed8998275665a2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:08.554076 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a904a8e-39b6-4e43-adb3-da2aa3411389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db71245d19ee41909aed8998275665a2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:08.569159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a904a8e-39b6-4e43-adb3-da2aa3411389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db71245d19ee41909aed8998275665a2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:08.570380 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a904a8e-39b6-4e43-adb3-da2aa3411389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db71245d19ee41909aed8998275665a2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:08.599288 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1158/2269] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:26:08 2022] DELETE /identity/v3/users/db71245d19ee41909aed8998275665a2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:26:08.847139 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:08.850075 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:08.874061 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483e052-a212-4d0e-8239-faac306734dc admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:08.973142 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:08.974478 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:08.975094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:08.975695 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc admin admin] PATH_INFO: `/v3/projects/11f746acfec04d7790b026e71cde6e21` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:08.978006 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f746acfec04d7790b026e71cde6e21)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:08.982216 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:09.044279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:09.064124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f746acfec04d7790b026e71cde6e21', 'request_id': 'req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:09.072132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f746acfec04d7790b026e71cde6e21', 'request_id': 'req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:09.081071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f746acfec04d7790b026e71cde6e21', 'request_id': 'req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:09.101103 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc admin admin] The token cache is being invalidate because project 11f746acfec04d7790b026e71cde6e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:26:09.101778 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:09.103158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-74d7dca1-e0a7-4294-ab55-d76b8c55d2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:09.106579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1112/2270] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:26:08 2022] DELETE /identity/v3/projects/11f746acfec04d7790b026e71cde6e21 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:26:09.111492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4952d2d-5637-4917-bbcd-241c73f3af4d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:09.112035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4952d2d-5637-4917-bbcd-241c73f3af4d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:09.112674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4952d2d-5637-4917-bbcd-241c73f3af4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:09.154504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e4952d2d-5637-4917-bbcd-241c73f3af4d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:26:09.157059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e4952d2d-5637-4917-bbcd-241c73f3af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:09.298408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1159/2271] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:26:09.393766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9cfd6-c656-4357-b23f-17f52414172a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:09.394271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9cfd6-c656-4357-b23f-17f52414172a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:09.394724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9cfd6-c656-4357-b23f-17f52414172a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:09.422157 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c2a9cfd6-c656-4357-b23f-17f52414172a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:26:09.426046 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c2a9cfd6-c656-4357-b23f-17f52414172a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:09.440264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1113/2272] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:26:09.446204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4952d2d-5637-4917-bbcd-241c73f3af4d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:09.465890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4952d2d-5637-4917-bbcd-241c73f3af4d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:09.473868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d89c5-dc2f-4290-b98e-46380cac507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:09.474875 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d89c5-dc2f-4290-b98e-46380cac507d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:09.475361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d89c5-dc2f-4290-b98e-46380cac507d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:09.475894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d89c5-dc2f-4290-b98e-46380cac507d admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:09.477237 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d89c5-dc2f-4290-b98e-46380cac507d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:26:09.477803 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d89c5-dc2f-4290-b98e-46380cac507d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:09.480886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d89c5-dc2f-4290-b98e-46380cac507d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:09.504067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1160/2273] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:26:09.509005 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9cfd6-c656-4357-b23f-17f52414172a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:09.521009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9cfd6-c656-4357-b23f-17f52414172a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:09.527968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe508cd9-0c41-478f-865f-b822b58a23e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:09.528773 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe508cd9-0c41-478f-865f-b822b58a23e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:09.529158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe508cd9-0c41-478f-865f-b822b58a23e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:09.529528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe508cd9-0c41-478f-865f-b822b58a23e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:09.530462 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe508cd9-0c41-478f-865f-b822b58a23e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:09.533188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe508cd9-0c41-478f-865f-b822b58a23e7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:09.582029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1114/2274] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:26:09 2022] POST /identity/v3/projects => generated 359 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:26:09.586903 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d89c5-dc2f-4290-b98e-46380cac507d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:09.599995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d89c5-dc2f-4290-b98e-46380cac507d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:09.679961 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb7c53-b6ae-4650-9e7a-e6a0521656d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:09.680678 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb7c53-b6ae-4650-9e7a-e6a0521656d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:09.681158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb7c53-b6ae-4650-9e7a-e6a0521656d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:09.681479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb7c53-b6ae-4650-9e7a-e6a0521656d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:09.682194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb7c53-b6ae-4650-9e7a-e6a0521656d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:09.685305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb7c53-b6ae-4650-9e7a-e6a0521656d4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:09.711632 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1161/2275] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:26:09 2022] POST /identity/v3/users => generated 280 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:26:09.716658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe508cd9-0c41-478f-865f-b822b58a23e7 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:09.731875 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe508cd9-0c41-478f-865f-b822b58a23e7 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:09.739165 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bbc14-8ca9-449d-831b-f8e722d0b4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:09.739803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bbc14-8ca9-449d-831b-f8e722d0b4ea admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:09.740064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bbc14-8ca9-449d-831b-f8e722d0b4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:09.740544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bbc14-8ca9-449d-831b-f8e722d0b4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:09.741018 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bbc14-8ca9-449d-831b-f8e722d0b4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:09.742651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bbc14-8ca9-449d-831b-f8e722d0b4ea admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:09.753885 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1115/2276] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:26:09.758409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb7c53-b6ae-4650-9e7a-e6a0521656d4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:09.780536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb7c53-b6ae-4650-9e7a-e6a0521656d4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:09.792762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059ab08-e3a5-4fc7-822f-7787e7ace21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:09.793849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059ab08-e3a5-4fc7-822f-7787e7ace21d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:09.794333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059ab08-e3a5-4fc7-822f-7787e7ace21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:09.795063 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059ab08-e3a5-4fc7-822f-7787e7ace21d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:09.796337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059ab08-e3a5-4fc7-822f-7787e7ace21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:09.799965 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059ab08-e3a5-4fc7-822f-7787e7ace21d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:09.826983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1162/2277] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:26:09.832292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bbc14-8ca9-449d-831b-f8e722d0b4ea admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:09.847694 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bbc14-8ca9-449d-831b-f8e722d0b4ea admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:09.855809 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f7b7b-014a-456a-b5b2-e6f8d12ecb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:09.856742 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7b7b-014a-456a-b5b2-e6f8d12ecb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:09.857229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7b7b-014a-456a-b5b2-e6f8d12ecb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:09.857690 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7b7b-014a-456a-b5b2-e6f8d12ecb15 admin admin] PATH_INFO: `/v3/projects/c96af9dd423643a58215d336b84ee7de/users/c68793c7bad4428ca7f86e94af207bea/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:09.889507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f7b7b-014a-456a-b5b2-e6f8d12ecb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96af9dd423643a58215d336b84ee7de, user_id=c68793c7bad4428ca7f86e94af207bea, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:09.893822 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f7b7b-014a-456a-b5b2-e6f8d12ecb15 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:09.917197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1116/2278] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:26:09 2022] PUT /identity/v3/projects/c96af9dd423643a58215d336b84ee7de/users/c68793c7bad4428ca7f86e94af207bea/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:26:09.935433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad0d78-2f94-4092-869a-f9ec46cb70a3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:09.935924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad0d78-2f94-4092-869a-f9ec46cb70a3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:09.936398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad0d78-2f94-4092-869a-f9ec46cb70a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:09.949885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:09.981860 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-23ad0d78-2f94-4092-869a-f9ec46cb70a3 None None] MFA Rules not processed for user `c68793c7bad4428ca7f86e94af207bea`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:26:09.983436 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-23ad0d78-2f94-4092-869a-f9ec46cb70a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:10.076302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1163/2279] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:26:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:26:10.119983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f7b7b-014a-456a-b5b2-e6f8d12ecb15 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:10.122036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-534f7b7b-014a-456a-b5b2-e6f8d12ecb15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:10.190579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f7b7b-014a-456a-b5b2-e6f8d12ecb15 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:10.194489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286aae2-1420-4af8-bf9f-d701f2053225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:10.195107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286aae2-1420-4af8-bf9f-d701f2053225 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:10.195381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286aae2-1420-4af8-bf9f-d701f2053225 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:10.195649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286aae2-1420-4af8-bf9f-d701f2053225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:10.205221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286aae2-1420-4af8-bf9f-d701f2053225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:10.207383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286aae2-1420-4af8-bf9f-d701f2053225 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:10.218103 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1117/2280] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:26:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:26:10.236807 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad0d78-2f94-4092-869a-f9ec46cb70a3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:10.317960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad0d78-2f94-4092-869a-f9ec46cb70a3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:10.323607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f527515-910f-4ca6-bb83-30d51743f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:10.324309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f527515-910f-4ca6-bb83-30d51743f83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:10.324625 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f527515-910f-4ca6-bb83-30d51743f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:10.324976 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f527515-910f-4ca6-bb83-30d51743f83f admin admin] PATH_INFO: `/v3/users/c68793c7bad4428ca7f86e94af207bea` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:10.326240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f527515-910f-4ca6-bb83-30d51743f83f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68793c7bad4428ca7f86e94af207bea)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:10.328269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f527515-910f-4ca6-bb83-30d51743f83f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:10.387739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0f527515-910f-4ca6-bb83-30d51743f83f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68793c7bad4428ca7f86e94af207bea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:10.388482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0f527515-910f-4ca6-bb83-30d51743f83f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68793c7bad4428ca7f86e94af207bea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:10.405489 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0f527515-910f-4ca6-bb83-30d51743f83f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68793c7bad4428ca7f86e94af207bea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:10.414486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0f527515-910f-4ca6-bb83-30d51743f83f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68793c7bad4428ca7f86e94af207bea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:10.415278 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0f527515-910f-4ca6-bb83-30d51743f83f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68793c7bad4428ca7f86e94af207bea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:10.433824 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1164/2281] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:26:10 2022] DELETE /identity/v3/users/c68793c7bad4428ca7f86e94af207bea => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:26:10.438994 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef167d5d-d8af-4e31-857c-9df5dd09ea62 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:10.439278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef167d5d-d8af-4e31-857c-9df5dd09ea62 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:10.439592 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef167d5d-d8af-4e31-857c-9df5dd09ea62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:10.473101 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ef167d5d-d8af-4e31-857c-9df5dd09ea62 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:26:10.473101 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ef167d5d-d8af-4e31-857c-9df5dd09ea62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:10.542969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:10.563301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1118/2282] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:26:10.579746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f527515-910f-4ca6-bb83-30d51743f83f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:10.583354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0f527515-910f-4ca6-bb83-30d51743f83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:10.617040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:10.705744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f527515-910f-4ca6-bb83-30d51743f83f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:10.712300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e19161-2fab-412a-a9f1-39a1bc6f8f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:10.713283 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e19161-2fab-412a-a9f1-39a1bc6f8f12 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:10.713655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e19161-2fab-412a-a9f1-39a1bc6f8f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:10.714046 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e19161-2fab-412a-a9f1-39a1bc6f8f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:10.727486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e19161-2fab-412a-a9f1-39a1bc6f8f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:10.730200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e19161-2fab-412a-a9f1-39a1bc6f8f12 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:10.743887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1165/2283] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:26:11.346380 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef167d5d-d8af-4e31-857c-9df5dd09ea62 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:11.350294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ef167d5d-d8af-4e31-857c-9df5dd09ea62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:11.385363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef167d5d-d8af-4e31-857c-9df5dd09ea62 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:11.393569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:11.394597 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:11.394981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:11.395434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] PATH_INFO: `/v3/projects/c96af9dd423643a58215d336b84ee7de` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:11.396886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96af9dd423643a58215d336b84ee7de)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:11.399443 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:11.505055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96af9dd423643a58215d336b84ee7de', 'request_id': 'req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:11.513108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96af9dd423643a58215d336b84ee7de', 'request_id': 'req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:11.524137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96af9dd423643a58215d336b84ee7de', 'request_id': 'req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:11.543151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] The token cache is being invalidate because project c96af9dd423643a58215d336b84ee7de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:26:11.543772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:11.544677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:11.546479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1119/2284] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:26:11 2022] DELETE /identity/v3/projects/c96af9dd423643a58215d336b84ee7de => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:26:20.737642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=20 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:21.540040 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:22.379006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e19161-2fab-412a-a9f1-39a1bc6f8f12 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:22.390518 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e19161-2fab-412a-a9f1-39a1bc6f8f12 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:22.470275 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d393d58-cbb2-4561-8191-da3923c0c144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:22.470927 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d393d58-cbb2-4561-8191-da3923c0c144 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:22.471212 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d393d58-cbb2-4561-8191-da3923c0c144 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:22.472013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d393d58-cbb2-4561-8191-da3923c0c144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:22.474597 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5d393d58-cbb2-4561-8191-da3923c0c144 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:22.584043 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d393d58-cbb2-4561-8191-da3923c0c144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:22.585832 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d393d58-cbb2-4561-8191-da3923c0c144 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:22.600207 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1166/2285] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:26:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:26:32.592609 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=50 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:40.689274 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:40.691238 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:40.769930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc2339-9d6e-4c19-8cc0-dfd7251514b7 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:40.774740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162a7f3-721b-4359-881a-8d7e8c7ff642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:40.775598 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162a7f3-721b-4359-881a-8d7e8c7ff642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:40.775953 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162a7f3-721b-4359-881a-8d7e8c7ff642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:40.776271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162a7f3-721b-4359-881a-8d7e8c7ff642 admin admin] PATH_INFO: `/v3/users/6f05f50ac98f46728f83c3284bb09775` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:40.777612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162a7f3-721b-4359-881a-8d7e8c7ff642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f05f50ac98f46728f83c3284bb09775)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:40.779652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162a7f3-721b-4359-881a-8d7e8c7ff642 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:40.839994 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5162a7f3-721b-4359-881a-8d7e8c7ff642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f05f50ac98f46728f83c3284bb09775'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:40.840794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5162a7f3-721b-4359-881a-8d7e8c7ff642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f05f50ac98f46728f83c3284bb09775'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:40.841523 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5162a7f3-721b-4359-881a-8d7e8c7ff642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f05f50ac98f46728f83c3284bb09775'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:40.851462 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5162a7f3-721b-4359-881a-8d7e8c7ff642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f05f50ac98f46728f83c3284bb09775'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:40.868500 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5162a7f3-721b-4359-881a-8d7e8c7ff642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f05f50ac98f46728f83c3284bb09775'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:40.884385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1120/2286] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:26:40 2022] DELETE /identity/v3/users/6f05f50ac98f46728f83c3284bb09775 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:26:40.889621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc465e-0fb9-4f95-a3ab-34dee4913967 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:40.890442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc465e-0fb9-4f95-a3ab-34dee4913967 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:40.890442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc465e-0fb9-4f95-a3ab-34dee4913967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:40.914347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cecc465e-0fb9-4f95-a3ab-34dee4913967 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:26:40.916249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cecc465e-0fb9-4f95-a3ab-34dee4913967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:41.005862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1167/2287] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:26:41.017804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162a7f3-721b-4359-881a-8d7e8c7ff642 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:41.019669 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5162a7f3-721b-4359-881a-8d7e8c7ff642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:41.110626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162a7f3-721b-4359-881a-8d7e8c7ff642 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:41.117821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268ca17-218d-47a0-bef0-440cebb775ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:41.118864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268ca17-218d-47a0-bef0-440cebb775ce service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:41.119356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268ca17-218d-47a0-bef0-440cebb775ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:41.119813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268ca17-218d-47a0-bef0-440cebb775ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:41.133819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268ca17-218d-47a0-bef0-440cebb775ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:41.135500 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268ca17-218d-47a0-bef0-440cebb775ce service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:41.147194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1121/2288] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:26:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:26:41.678249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc465e-0fb9-4f95-a3ab-34dee4913967 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:41.682089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cecc465e-0fb9-4f95-a3ab-34dee4913967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:41.713151 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc465e-0fb9-4f95-a3ab-34dee4913967 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:41.720032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:41.722032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:41.722372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:41.722643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] PATH_INFO: `/v3/projects/9b637e25d50645e6922e49b769d203ff` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:41.724003 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b637e25d50645e6922e49b769d203ff)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:41.726423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:41.796053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b637e25d50645e6922e49b769d203ff', 'request_id': 'req-ed154667-777b-4a15-a529-a17f62718ed5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:41.803878 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b637e25d50645e6922e49b769d203ff', 'request_id': 'req-ed154667-777b-4a15-a529-a17f62718ed5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:41.814600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b637e25d50645e6922e49b769d203ff', 'request_id': 'req-ed154667-777b-4a15-a529-a17f62718ed5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:41.829481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] The token cache is being invalidate because project 9b637e25d50645e6922e49b769d203ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:26:41.830339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:41.830986 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:26:41.832548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1168/2289] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:26:41 2022] DELETE /identity/v3/projects/9b637e25d50645e6922e49b769d203ff => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:26:44.336497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369fa0c-000c-41ec-9e8c-0db835f0ed98 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:44.337138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369fa0c-000c-41ec-9e8c-0db835f0ed98 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:44.337503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369fa0c-000c-41ec-9e8c-0db835f0ed98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:44.377373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1369fa0c-000c-41ec-9e8c-0db835f0ed98 None None] MFA Rules not processed for user `b6093246f53b4dcb961f47aea99fb1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:26:44.380013 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1369fa0c-000c-41ec-9e8c-0db835f0ed98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:44.415779 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:44.496765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1122/2290] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:26:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:26:47.460626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:47.466809 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:47.582464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed154667-777b-4a15-a529-a17f62718ed5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:47.591667 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a2253-8a9c-4112-8691-d89ecf820eeb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd3076ca5a84ff7ada13065f9531f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:47.592672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a2253-8a9c-4112-8691-d89ecf820eeb service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:47.593166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a2253-8a9c-4112-8691-d89ecf820eeb service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:47.593616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a2253-8a9c-4112-8691-d89ecf820eeb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:47.597593 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-541a2253-8a9c-4112-8691-d89ecf820eeb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:47.620681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a2253-8a9c-4112-8691-d89ecf820eeb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:47.623427 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a2253-8a9c-4112-8691-d89ecf820eeb service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:47.639704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1169/2291] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:26:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:26:49.374893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5637f8-c549-4a7e-bb43-03660a69fefd None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:49.375732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5637f8-c549-4a7e-bb43-03660a69fefd None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:49.375732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5637f8-c549-4a7e-bb43-03660a69fefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:49.404171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5e5637f8-c549-4a7e-bb43-03660a69fefd None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:26:49.406432 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5e5637f8-c549-4a7e-bb43-03660a69fefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:49.532714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1123/2292] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:26:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:26:49.604237 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a2253-8a9c-4112-8691-d89ecf820eeb service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:26:49.607623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-541a2253-8a9c-4112-8691-d89ecf820eeb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:49.648778 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:49.783751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a2253-8a9c-4112-8691-d89ecf820eeb service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:26:49.789137 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7556808-c31d-48f2-a8ee-6e18975d2768 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:26:49.789771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7556808-c31d-48f2-a8ee-6e18975d2768 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:49.790052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7556808-c31d-48f2-a8ee-6e18975d2768 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:49.790331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7556808-c31d-48f2-a8ee-6e18975d2768 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:49.801005 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7556808-c31d-48f2-a8ee-6e18975d2768 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:26:49.802891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7556808-c31d-48f2-a8ee-6e18975d2768 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:26:49.814344 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1170/2293] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:26:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:26:53.551354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc59c-7cae-4b3a-915c-cffd9dc1712c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:26:53.552556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc59c-7cae-4b3a-915c-cffd9dc1712c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:26:53.553017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc59c-7cae-4b3a-915c-cffd9dc1712c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:26:53.598894 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8f0fc59c-7cae-4b3a-915c-cffd9dc1712c None None] MFA Rules not processed for user `cce8cd0756024404815ebf4e0ffa0209`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:26:53.600565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8f0fc59c-7cae-4b3a-915c-cffd9dc1712c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:26:53.749267 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1124/2294] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:26:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:26:59.809921 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=26 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:03.724072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=65 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:12.502906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feed78c-3b17-4174-8e4a-d1b52799ade8 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:27:12.503901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feed78c-3b17-4174-8e4a-d1b52799ade8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:27:12.504243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feed78c-3b17-4174-8e4a-d1b52799ade8 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:27:12.505825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1171/2295] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 21 16:27:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:27:12.515180 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed294a0c-07b6-47ad-93df-aeb31abea427 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:27:12.516129 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed294a0c-07b6-47ad-93df-aeb31abea427 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:27:12.516590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed294a0c-07b6-47ad-93df-aeb31abea427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:27:12.543592 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ed294a0c-07b6-47ad-93df-aeb31abea427 None None] MFA Rules not processed for user `d7ff08c990dc41b4811f97fecb7c4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:27:12.545537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ed294a0c-07b6-47ad-93df-aeb31abea427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:27:12.631003 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1125/2296] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 21 16:27:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:27:12.646481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feed78c-3b17-4174-8e4a-d1b52799ade8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:27:12.648483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1feed78c-3b17-4174-8e4a-d1b52799ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:27:12.709881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feed78c-3b17-4174-8e4a-d1b52799ade8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:27:12.713259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8274db1-5177-4b25-bd0b-90f4f8176535 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2974669e9d1a417892b1d59dbc9e87ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:27:12.713863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8274db1-5177-4b25-bd0b-90f4f8176535 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:27:12.714137 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8274db1-5177-4b25-bd0b-90f4f8176535 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:27:12.714403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8274db1-5177-4b25-bd0b-90f4f8176535 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:27:12.725267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8274db1-5177-4b25-bd0b-90f4f8176535 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:27:12.726673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8274db1-5177-4b25-bd0b-90f4f8176535 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:27:12.738040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1172/2297] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:27:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:27:12.806909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32b240-574f-4956-9283-4e42ae90ce0c None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:27:12.807192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32b240-574f-4956-9283-4e42ae90ce0c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:27:12.807466 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32b240-574f-4956-9283-4e42ae90ce0c None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:27:12.808886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1126/2298] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 21 16:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:27:12.813924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223e635-fd30-46da-bc71-79fa60817170 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:27:12.814209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223e635-fd30-46da-bc71-79fa60817170 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:27:12.814487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223e635-fd30-46da-bc71-79fa60817170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:27:12.836122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c223e635-fd30-46da-bc71-79fa60817170 None None] MFA Rules not processed for user `0e765e2cc4c94243b00f919e8f8d01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:27:12.836488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c223e635-fd30-46da-bc71-79fa60817170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:27:12.890610 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1173/2299] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 21 16:27:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:27:12.902515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32b240-574f-4956-9283-4e42ae90ce0c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:27:12.904234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ee32b240-574f-4956-9283-4e42ae90ce0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:27:12.918782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32b240-574f-4956-9283-4e42ae90ce0c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:27:12.922972 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f86075-749f-405a-a854-84e9df17cb2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:27:12.923575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86075-749f-405a-a854-84e9df17cb2a service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:27:12.923854 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86075-749f-405a-a854-84e9df17cb2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:27:12.924121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86075-749f-405a-a854-84e9df17cb2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:27:12.931354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f86075-749f-405a-a854-84e9df17cb2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:27:12.932803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f86075-749f-405a-a854-84e9df17cb2a service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:27:12.940567 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1127/2300] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:27:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:27:13.027164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30869c1e-06e9-4cb2-a6e8-6d2c16bc56b6 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:27:13.027453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30869c1e-06e9-4cb2-a6e8-6d2c16bc56b6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:27:13.027756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30869c1e-06e9-4cb2-a6e8-6d2c16bc56b6 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:27:13.029152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1174/2301] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 21 16:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:27:13.035006 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5267e06-a0c0-4bae-8d55-8d810ec49c13 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:27:13.035395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5267e06-a0c0-4bae-8d55-8d810ec49c13 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:27:13.035657 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5267e06-a0c0-4bae-8d55-8d810ec49c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:27:13.055862 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d5267e06-a0c0-4bae-8d55-8d810ec49c13 None None] MFA Rules not processed for user `d7ff08c990dc41b4811f97fecb7c4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:27:13.057114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d5267e06-a0c0-4bae-8d55-8d810ec49c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:27:13.066445 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1128/2302] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 21 16:27:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:27:13.076810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30869c1e-06e9-4cb2-a6e8-6d2c16bc56b6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:27:13.089199 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30869c1e-06e9-4cb2-a6e8-6d2c16bc56b6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:27:13.092892 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f191f-7abf-4b97-b41c-430eb5fb2e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:27:13.093501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f191f-7abf-4b97-b41c-430eb5fb2e13 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:27:13.094379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f191f-7abf-4b97-b41c-430eb5fb2e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:27:13.094652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f191f-7abf-4b97-b41c-430eb5fb2e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:27:13.105460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f191f-7abf-4b97-b41c-430eb5fb2e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:27:13.106918 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f191f-7abf-4b97-b41c-430eb5fb2e13 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:27:13.118240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1175/2303] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:27:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:27:18.208830 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb995b1c-0fb4-47dc-8c3d-9d699f8df396 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:27:18.209295 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb995b1c-0fb4-47dc-8c3d-9d699f8df396 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:27:18.209385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb995b1c-0fb4-47dc-8c3d-9d699f8df396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:27:18.228071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-eb995b1c-0fb4-47dc-8c3d-9d699f8df396 None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:27:18.229285 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-eb995b1c-0fb4-47dc-8c3d-9d699f8df396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:27:18.236932 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1129/2304] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:27:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:27:18.248845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f191f-7abf-4b97-b41c-430eb5fb2e13 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:27:18.260488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f191f-7abf-4b97-b41c-430eb5fb2e13 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:27:18.266184 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce784c-c141-438f-89b3-4cda9ecffb97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:27:18.266713 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce784c-c141-438f-89b3-4cda9ecffb97 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:27:18.266988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce784c-c141-438f-89b3-4cda9ecffb97 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:27:18.267261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce784c-c141-438f-89b3-4cda9ecffb97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:27:18.275300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce784c-c141-438f-89b3-4cda9ecffb97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:27:18.276947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce784c-c141-438f-89b3-4cda9ecffb97 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:27:18.285032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1176/2305] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:27:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:27:28.222859 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=43 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:28.282215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=61 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:43.699183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3a7e4-ea60-4c74-b4a8-e111953f36c7 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:27:43.699678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3a7e4-ea60-4c74-b4a8-e111953f36c7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:27:43.699842 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3a7e4-ea60-4c74-b4a8-e111953f36c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:27:43.721813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-03f3a7e4-ea60-4c74-b4a8-e111953f36c7 None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:27:43.723017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-03f3a7e4-ea60-4c74-b4a8-e111953f36c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:27:43.730392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1130/2306] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 21 16:27:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:27:43.747826 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce784c-c141-438f-89b3-4cda9ecffb97 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:27:43.759235 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce784c-c141-438f-89b3-4cda9ecffb97 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:27:43.765109 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083af95-8d1a-44b7-93c3-4c5ad9380a86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:27:43.766670 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083af95-8d1a-44b7-93c3-4c5ad9380a86 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:27:43.766954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083af95-8d1a-44b7-93c3-4c5ad9380a86 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:27:43.767229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083af95-8d1a-44b7-93c3-4c5ad9380a86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:27:43.776218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083af95-8d1a-44b7-93c3-4c5ad9380a86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:27:43.777929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083af95-8d1a-44b7-93c3-4c5ad9380a86 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:27:43.787616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1177/2307] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:27:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:27:53.715381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:53.784370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:18.954291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3a7e4-ea60-4c74-b4a8-e111953f36c7 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:28:18.964210 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3a7e4-ea60-4c74-b4a8-e111953f36c7 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:28:18.968511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a50353-87d3-4787-84cd-e67dec672b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:28:18.969205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50353-87d3-4787-84cd-e67dec672b35 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:28:18.969634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50353-87d3-4787-84cd-e67dec672b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:28:18.969914 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50353-87d3-4787-84cd-e67dec672b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:28:18.971740 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f0a50353-87d3-4787-84cd-e67dec672b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:28:18.986192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a50353-87d3-4787-84cd-e67dec672b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:28:18.987615 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a50353-87d3-4787-84cd-e67dec672b35 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:28:18.999163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1131/2308] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:28:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:28:22.874886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083af95-8d1a-44b7-93c3-4c5ad9380a86 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:28:22.876556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c083af95-8d1a-44b7-93c3-4c5ad9380a86 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:28:22.888535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083af95-8d1a-44b7-93c3-4c5ad9380a86 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:28:22.892493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2ee3-ac4a-416d-abe3-763f021e9192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:28:22.893148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2ee3-ac4a-416d-abe3-763f021e9192 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:28:22.893431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2ee3-ac4a-416d-abe3-763f021e9192 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:28:22.893709 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2ee3-ac4a-416d-abe3-763f021e9192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:28:22.895474 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e07c2ee3-ac4a-416d-abe3-763f021e9192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:28:22.910146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c2ee3-ac4a-416d-abe3-763f021e9192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:28:22.911589 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c2ee3-ac4a-416d-abe3-763f021e9192 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:28:22.925265 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1178/2309] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:28:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:28:28.994021 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=6 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:32.918836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:42.346075 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a50353-87d3-4787-84cd-e67dec672b35 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:28:42.347602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f0a50353-87d3-4787-84cd-e67dec672b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:28:42.361707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a50353-87d3-4787-84cd-e67dec672b35 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:28:42.367002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bea5d3-2d0d-496a-a3d7-1c8f0aeb6f28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:28:42.367590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea5d3-2d0d-496a-a3d7-1c8f0aeb6f28 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:28:42.367889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea5d3-2d0d-496a-a3d7-1c8f0aeb6f28 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:28:42.368154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea5d3-2d0d-496a-a3d7-1c8f0aeb6f28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:28:42.369818 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-78bea5d3-2d0d-496a-a3d7-1c8f0aeb6f28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:28:42.427852 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bea5d3-2d0d-496a-a3d7-1c8f0aeb6f28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:28:42.429416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bea5d3-2d0d-496a-a3d7-1c8f0aeb6f28 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:28:42.438982 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1132/2310] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:28:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:28:48.445571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2ee3-ac4a-416d-abe3-763f021e9192 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:28:48.446992 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e07c2ee3-ac4a-416d-abe3-763f021e9192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:28:48.461117 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2ee3-ac4a-416d-abe3-763f021e9192 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:28:48.466757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47032a3-718f-418e-9317-9600bdc421ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:28:48.467351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47032a3-718f-418e-9317-9600bdc421ee service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:28:48.467627 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47032a3-718f-418e-9317-9600bdc421ee service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:28:48.467898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47032a3-718f-418e-9317-9600bdc421ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:28:48.469722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b47032a3-718f-418e-9317-9600bdc421ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:28:48.479884 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47032a3-718f-418e-9317-9600bdc421ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:28:48.482045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47032a3-718f-418e-9317-9600bdc421ee service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:28:48.490897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1179/2311] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:28:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:28:52.434189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=28 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:58.486812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:01.411640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bea5d3-2d0d-496a-a3d7-1c8f0aeb6f28 service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:29:01.422655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bea5d3-2d0d-496a-a3d7-1c8f0aeb6f28 service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:29:01.426612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d4c78-1961-438a-8f02-c47340b7ad90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:29:01.427208 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d4c78-1961-438a-8f02-c47340b7ad90 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:01.427493 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d4c78-1961-438a-8f02-c47340b7ad90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:01.427765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d4c78-1961-438a-8f02-c47340b7ad90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:01.429697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a23d4c78-1961-438a-8f02-c47340b7ad90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:01.440879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d4c78-1961-438a-8f02-c47340b7ad90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:29:01.442340 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d4c78-1961-438a-8f02-c47340b7ad90 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:29:01.455932 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1133/2312] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:29:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:29:01.548889 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47032a3-718f-418e-9317-9600bdc421ee service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:29:01.563677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47032a3-718f-418e-9317-9600bdc421ee service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:29:01.573168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e543563-032f-4b68-a72f-9886fd5a4870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:29:01.574826 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e543563-032f-4b68-a72f-9886fd5a4870 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:01.575589 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e543563-032f-4b68-a72f-9886fd5a4870 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:01.576073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e543563-032f-4b68-a72f-9886fd5a4870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:01.579180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8e543563-032f-4b68-a72f-9886fd5a4870 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:01.663204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e543563-032f-4b68-a72f-9886fd5a4870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:29:01.664875 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e543563-032f-4b68-a72f-9886fd5a4870 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:29:01.676371 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1180/2313] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:29:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:29:04.190326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64320862-f70b-4f7a-bd88-0b914a2274fb None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:04.191029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64320862-f70b-4f7a-bd88-0b914a2274fb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:04.191029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64320862-f70b-4f7a-bd88-0b914a2274fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:04.211605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-64320862-f70b-4f7a-bd88-0b914a2274fb None None] MFA Rules not processed for user `b6093246f53b4dcb961f47aea99fb1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:29:04.213086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-64320862-f70b-4f7a-bd88-0b914a2274fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:04.220076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1134/2314] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:29:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:29:04.554772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e543563-032f-4b68-a72f-9886fd5a4870 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:29:04.565095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e543563-032f-4b68-a72f-9886fd5a4870 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:29:04.569020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636e771-6b5e-458f-8210-80c9a99138ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:29:04.569641 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636e771-6b5e-458f-8210-80c9a99138ea service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:04.569922 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636e771-6b5e-458f-8210-80c9a99138ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:04.570201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636e771-6b5e-458f-8210-80c9a99138ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:04.572031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f636e771-6b5e-458f-8210-80c9a99138ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:04.583634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636e771-6b5e-458f-8210-80c9a99138ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:29:04.585113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636e771-6b5e-458f-8210-80c9a99138ea service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:29:04.593658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1181/2315] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:29:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:29:04.979393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64320862-f70b-4f7a-bd88-0b914a2274fb None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:29:04.981720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-64320862-f70b-4f7a-bd88-0b914a2274fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:04.999764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64320862-f70b-4f7a-bd88-0b914a2274fb None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:29:05.009410 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36865dd1-e6ba-4246-a66b-75e99f906f98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd3076ca5a84ff7ada13065f9531f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:29:05.010151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36865dd1-e6ba-4246-a66b-75e99f906f98 service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:05.010627 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36865dd1-e6ba-4246-a66b-75e99f906f98 service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:05.010905 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36865dd1-e6ba-4246-a66b-75e99f906f98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:05.012939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-36865dd1-e6ba-4246-a66b-75e99f906f98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:05.027789 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36865dd1-e6ba-4246-a66b-75e99f906f98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:29:05.031535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36865dd1-e6ba-4246-a66b-75e99f906f98 service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:29:05.044267 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1135/2316] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:29:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:29:09.205425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636e771-6b5e-458f-8210-80c9a99138ea service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:29:09.223017 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636e771-6b5e-458f-8210-80c9a99138ea service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:29:09.232248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c4000-94de-47d3-bd96-5ac92effac8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:29:09.232902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c4000-94de-47d3-bd96-5ac92effac8b service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:09.233182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c4000-94de-47d3-bd96-5ac92effac8b service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:09.233451 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c4000-94de-47d3-bd96-5ac92effac8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:09.235323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-017c4000-94de-47d3-bd96-5ac92effac8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:09.253519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c4000-94de-47d3-bd96-5ac92effac8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:29:09.255214 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c4000-94de-47d3-bd96-5ac92effac8b service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:29:09.269035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1182/2317] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:29:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:29:10.934883 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b77e3-a80f-4a5e-82a9-55cf834d3a1d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:10.935493 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b77e3-a80f-4a5e-82a9-55cf834d3a1d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:10.935599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b77e3-a80f-4a5e-82a9-55cf834d3a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:10.956992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a71b77e3-a80f-4a5e-82a9-55cf834d3a1d None None] MFA Rules not processed for user `d6b48a9e72564cefb5a4865d944a9a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:29:10.958222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a71b77e3-a80f-4a5e-82a9-55cf834d3a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:10.965907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1136/2318] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:29:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:29:11.286176 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c4000-94de-47d3-bd96-5ac92effac8b service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:29:11.296115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c4000-94de-47d3-bd96-5ac92effac8b service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:29:11.299924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046965d3-ca14-4b60-9c97-2c5416d292e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:29:11.300528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046965d3-ca14-4b60-9c97-2c5416d292e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:11.300837 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046965d3-ca14-4b60-9c97-2c5416d292e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:11.301112 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046965d3-ca14-4b60-9c97-2c5416d292e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:11.302917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-046965d3-ca14-4b60-9c97-2c5416d292e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:11.313651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046965d3-ca14-4b60-9c97-2c5416d292e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:29:11.315075 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046965d3-ca14-4b60-9c97-2c5416d292e1 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:29:11.323305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1183/2319] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:29:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:29:20.386415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22813a25-e021-4694-9246-153cc2802037 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:20.387709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22813a25-e021-4694-9246-153cc2802037 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:20.387709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22813a25-e021-4694-9246-153cc2802037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:20.410520 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-22813a25-e021-4694-9246-153cc2802037 None None] MFA Rules not processed for user `cce8cd0756024404815ebf4e0ffa0209`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:29:20.411895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-22813a25-e021-4694-9246-153cc2802037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:20.420247 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1137/2320] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:29:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:29:21.319862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=46 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:27.189172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046965d3-ca14-4b60-9c97-2c5416d292e1 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:29:27.244867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046965d3-ca14-4b60-9c97-2c5416d292e1 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:29:27.251564 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f20b4-a6f4-49f9-bcad-2da4215ebceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:29:27.252281 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f20b4-a6f4-49f9-bcad-2da4215ebceb service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:27.252625 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f20b4-a6f4-49f9-bcad-2da4215ebceb service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:27.253280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f20b4-a6f4-49f9-bcad-2da4215ebceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:27.256387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ba5f20b4-a6f4-49f9-bcad-2da4215ebceb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:27.284155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f20b4-a6f4-49f9-bcad-2da4215ebceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:29:27.285829 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f20b4-a6f4-49f9-bcad-2da4215ebceb service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:29:27.299479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1184/2321] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:29:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:29:30.403632 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=21 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:33.606803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22813a25-e021-4694-9246-153cc2802037 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:29:33.645248 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22813a25-e021-4694-9246-153cc2802037 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:29:33.651305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf8cc9-09d3-4333-977e-994e872f22de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:29:33.651925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8cc9-09d3-4333-977e-994e872f22de service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:33.652202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8cc9-09d3-4333-977e-994e872f22de service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:33.652479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8cc9-09d3-4333-977e-994e872f22de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:33.654474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5adf8cc9-09d3-4333-977e-994e872f22de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:33.679647 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf8cc9-09d3-4333-977e-994e872f22de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:29:33.681288 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf8cc9-09d3-4333-977e-994e872f22de service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:29:33.693507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1138/2322] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:29:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:29:37.294034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=21 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:43.688501 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=21 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:43.912462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d119a-d21a-4235-875b-573ec8b3f4fb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:43.913455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d119a-d21a-4235-875b-573ec8b3f4fb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:43.913455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d119a-d21a-4235-875b-573ec8b3f4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:43.949592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-044d119a-d21a-4235-875b-573ec8b3f4fb None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:29:43.951017 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-044d119a-d21a-4235-875b-573ec8b3f4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:43.960324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1185/2323] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 21 16:29:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:29:44.019185 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf8cc9-09d3-4333-977e-994e872f22de service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:29:44.031688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf8cc9-09d3-4333-977e-994e872f22de service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:29:44.040121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2adbe9-ec66-48b0-8183-8b0b566d71f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:29:44.041073 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2adbe9-ec66-48b0-8183-8b0b566d71f6 service swift] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:44.041523 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2adbe9-ec66-48b0-8183-8b0b566d71f6 service swift] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:44.041965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2adbe9-ec66-48b0-8183-8b0b566d71f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:44.052076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2adbe9-ec66-48b0-8183-8b0b566d71f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:29:44.053684 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2adbe9-ec66-48b0-8183-8b0b566d71f6 service swift] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:29:44.065551 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1139/2324] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:29:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:29:48.004478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d119a-d21a-4235-875b-573ec8b3f4fb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:29:48.024350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d119a-d21a-4235-875b-573ec8b3f4fb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:29:48.034879 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3392c-268b-4a0a-a89f-03563b1d0b0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd3076ca5a84ff7ada13065f9531f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:29:48.035670 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3392c-268b-4a0a-a89f-03563b1d0b0b service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:48.035956 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3392c-268b-4a0a-a89f-03563b1d0b0b service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:48.036347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3392c-268b-4a0a-a89f-03563b1d0b0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:48.039372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e9f3392c-268b-4a0a-a89f-03563b1d0b0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:48.063871 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3392c-268b-4a0a-a89f-03563b1d0b0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:29:48.067966 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3392c-268b-4a0a-a89f-03563b1d0b0b service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:29:48.094090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1186/2325] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:29:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:29:52.109085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2adbe9-ec66-48b0-8183-8b0b566d71f6 service swift] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:29:52.111952 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-aa2adbe9-ec66-48b0-8183-8b0b566d71f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:52.264500 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2adbe9-ec66-48b0-8183-8b0b566d71f6 service swift] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:29:52.269911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20f88a-2b60-4799-9dfa-5b60e7ddf340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:29:52.270576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20f88a-2b60-4799-9dfa-5b60e7ddf340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:52.270857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20f88a-2b60-4799-9dfa-5b60e7ddf340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:52.271131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20f88a-2b60-4799-9dfa-5b60e7ddf340 admin admin] PATH_INFO: `/v3/users/f0016eb572294fd6835c730b8c2b26c2` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:52.272440 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20f88a-2b60-4799-9dfa-5b60e7ddf340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0016eb572294fd6835c730b8c2b26c2)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:29:52.274502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20f88a-2b60-4799-9dfa-5b60e7ddf340 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:29:52.341407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ba20f88a-2b60-4799-9dfa-5b60e7ddf340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0016eb572294fd6835c730b8c2b26c2'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.342010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ba20f88a-2b60-4799-9dfa-5b60e7ddf340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0016eb572294fd6835c730b8c2b26c2'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.342600 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ba20f88a-2b60-4799-9dfa-5b60e7ddf340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0016eb572294fd6835c730b8c2b26c2'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.349553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ba20f88a-2b60-4799-9dfa-5b60e7ddf340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0016eb572294fd6835c730b8c2b26c2'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.364130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ba20f88a-2b60-4799-9dfa-5b60e7ddf340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0016eb572294fd6835c730b8c2b26c2'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.390178 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1140/2326] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:29:52 2022] DELETE /identity/v3/users/f0016eb572294fd6835c730b8c2b26c2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:29:52.588773 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3392c-268b-4a0a-a89f-03563b1d0b0b service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:29:52.601820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3392c-268b-4a0a-a89f-03563b1d0b0b service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:29:52.671595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:29:52.672233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:52.672500 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:52.672804 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] PATH_INFO: `/v3/projects/edb8c48f60b64c9d9550d5c8fdf9043d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:52.673937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edb8c48f60b64c9d9550d5c8fdf9043d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:29:52.675868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:29:52.730248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edb8c48f60b64c9d9550d5c8fdf9043d', 'request_id': 'req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.736856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edb8c48f60b64c9d9550d5c8fdf9043d', 'request_id': 'req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.747431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edb8c48f60b64c9d9550d5c8fdf9043d', 'request_id': 'req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.761392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] The token cache is being invalidate because project edb8c48f60b64c9d9550d5c8fdf9043d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:29:52.761842 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.762354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.763882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1187/2327] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:29:52 2022] DELETE /identity/v3/projects/edb8c48f60b64c9d9550d5c8fdf9043d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:29:52.768031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20f88a-2b60-4799-9dfa-5b60e7ddf340 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:29:52.769664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ba20f88a-2b60-4799-9dfa-5b60e7ddf340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:52.783496 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20f88a-2b60-4799-9dfa-5b60e7ddf340 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:29:52.821664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:52.854608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f4626-0db6-4258-a405-897c5ed8efe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:29:52.855305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f4626-0db6-4258-a405-897c5ed8efe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:52.855749 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f4626-0db6-4258-a405-897c5ed8efe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:52.856131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f4626-0db6-4258-a405-897c5ed8efe9 admin admin] PATH_INFO: `/v3/users/06e7743eeeb24c499368571b350c5e27` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:52.857924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f4626-0db6-4258-a405-897c5ed8efe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e7743eeeb24c499368571b350c5e27)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:29:52.860629 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f4626-0db6-4258-a405-897c5ed8efe9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:29:52.919516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-916f4626-0db6-4258-a405-897c5ed8efe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e7743eeeb24c499368571b350c5e27'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.920542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-916f4626-0db6-4258-a405-897c5ed8efe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e7743eeeb24c499368571b350c5e27'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.921662 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-916f4626-0db6-4258-a405-897c5ed8efe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e7743eeeb24c499368571b350c5e27'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.934019 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-916f4626-0db6-4258-a405-897c5ed8efe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e7743eeeb24c499368571b350c5e27'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.949474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-916f4626-0db6-4258-a405-897c5ed8efe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e7743eeeb24c499368571b350c5e27'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:52.965493 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1141/2328] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:29:52 2022] DELETE /identity/v3/users/06e7743eeeb24c499368571b350c5e27 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:29:53.171509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:29:53.173958 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:29:53.192059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0896f1-d4d9-4ab5-afa6-b6fe2b3f1511 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:29:53.262868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:29:53.263538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:29:53.263903 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:29:53.264179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] PATH_INFO: `/v3/projects/a00966f3838b4cd1a1d37d16eea32830` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:29:53.265520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00966f3838b4cd1a1d37d16eea32830)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:29:53.267476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:29:53.270517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:53.324810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00966f3838b4cd1a1d37d16eea32830', 'request_id': 'req-2db64e0b-c4bd-4432-9af3-e9a03b28d797'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:53.330968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00966f3838b4cd1a1d37d16eea32830', 'request_id': 'req-2db64e0b-c4bd-4432-9af3-e9a03b28d797'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:53.340874 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00966f3838b4cd1a1d37d16eea32830', 'request_id': 'req-2db64e0b-c4bd-4432-9af3-e9a03b28d797'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:53.359664 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] The token cache is being invalidate because project a00966f3838b4cd1a1d37d16eea32830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:29:53.359893 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:53.360595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:29:53.362401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1188/2329] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:29:53 2022] DELETE /identity/v3/projects/a00966f3838b4cd1a1d37d16eea32830 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:30:02.442326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987a309-d217-4726-998d-6e0e696a4cbc None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:30:02.442988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987a309-d217-4726-998d-6e0e696a4cbc None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:30:02.443092 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987a309-d217-4726-998d-6e0e696a4cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:30:02.466132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2987a309-d217-4726-998d-6e0e696a4cbc None None] MFA Rules not processed for user `497c2547b8dd4bd1bbb804a9395dc20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:30:02.467436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2987a309-d217-4726-998d-6e0e696a4cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:30:02.540204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1142/2330] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:30:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:30:03.355276 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=23,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:30:12.531006 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:30:37.184371 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:30:37.186084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:30:37.279761 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64e0b-c4bd-4432-9af3-e9a03b28d797 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:30:37.283867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a94aeb-4e93-4374-a835-749398ef00b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:30:37.284540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a94aeb-4e93-4374-a835-749398ef00b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:30:37.284858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a94aeb-4e93-4374-a835-749398ef00b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:30:37.285127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a94aeb-4e93-4374-a835-749398ef00b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:30:37.287229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-17a94aeb-4e93-4374-a835-749398ef00b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:30:37.357523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a94aeb-4e93-4374-a835-749398ef00b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:30:37.359030 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a94aeb-4e93-4374-a835-749398ef00b2 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:30:37.370967 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1189/2331] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:30:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:30:47.365314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=57 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:30:57.879051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987a309-d217-4726-998d-6e0e696a4cbc None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:30:57.880510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2987a309-d217-4726-998d-6e0e696a4cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:30:57.966668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987a309-d217-4726-998d-6e0e696a4cbc None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:30:57.970850 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda5a11-9399-4f7f-8a35-2aac7e2120aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:30:57.971583 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda5a11-9399-4f7f-8a35-2aac7e2120aa service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:30:57.971893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda5a11-9399-4f7f-8a35-2aac7e2120aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:30:57.972162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda5a11-9399-4f7f-8a35-2aac7e2120aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:30:57.974667 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2bda5a11-9399-4f7f-8a35-2aac7e2120aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:30:58.041986 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda5a11-9399-4f7f-8a35-2aac7e2120aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:30:58.043482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda5a11-9399-4f7f-8a35-2aac7e2120aa service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:30:58.054830 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1143/2332] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:02.056831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a94aeb-4e93-4374-a835-749398ef00b2 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:02.058429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-17a94aeb-4e93-4374-a835-749398ef00b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:02.157275 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda5a11-9399-4f7f-8a35-2aac7e2120aa service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:02.159570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2bda5a11-9399-4f7f-8a35-2aac7e2120aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:02.181294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda5a11-9399-4f7f-8a35-2aac7e2120aa service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:02.186530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47326d5-8783-4aca-94d6-6d7bf377b226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:02.187760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47326d5-8783-4aca-94d6-6d7bf377b226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:02.188197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47326d5-8783-4aca-94d6-6d7bf377b226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:02.188465 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47326d5-8783-4aca-94d6-6d7bf377b226 admin admin] PATH_INFO: `/v3/users/cce8cd0756024404815ebf4e0ffa0209` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:02.189937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47326d5-8783-4aca-94d6-6d7bf377b226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce8cd0756024404815ebf4e0ffa0209)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:02.192099 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47326d5-8783-4aca-94d6-6d7bf377b226 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:02.204596 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a94aeb-4e93-4374-a835-749398ef00b2 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:02.211680 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8067c1-7622-4bfb-b2ed-b7f3ed533ef8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd3076ca5a84ff7ada13065f9531f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:02.212586 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8067c1-7622-4bfb-b2ed-b7f3ed533ef8 service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:02.223993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8067c1-7622-4bfb-b2ed-b7f3ed533ef8 service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:02.223993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8067c1-7622-4bfb-b2ed-b7f3ed533ef8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:02.223993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9f8067c1-7622-4bfb-b2ed-b7f3ed533ef8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:02.234285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8067c1-7622-4bfb-b2ed-b7f3ed533ef8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:02.236339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8067c1-7622-4bfb-b2ed-b7f3ed533ef8 service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:02.249274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1190/2333] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:02.283138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a47326d5-8783-4aca-94d6-6d7bf377b226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce8cd0756024404815ebf4e0ffa0209'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:02.284466 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a47326d5-8783-4aca-94d6-6d7bf377b226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce8cd0756024404815ebf4e0ffa0209'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:02.285539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a47326d5-8783-4aca-94d6-6d7bf377b226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce8cd0756024404815ebf4e0ffa0209'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:02.298142 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a47326d5-8783-4aca-94d6-6d7bf377b226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce8cd0756024404815ebf4e0ffa0209'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:02.314059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a47326d5-8783-4aca-94d6-6d7bf377b226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce8cd0756024404815ebf4e0ffa0209'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:02.333832 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1144/2334] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:31:02 2022] DELETE /identity/v3/users/cce8cd0756024404815ebf4e0ffa0209 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:02.579078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8067c1-7622-4bfb-b2ed-b7f3ed533ef8 service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:02.594590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8067c1-7622-4bfb-b2ed-b7f3ed533ef8 service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:02.721809 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2dcea-9743-4d18-ac17-ae2964754240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:02.723797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2dcea-9743-4d18-ac17-ae2964754240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:02.725534 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2dcea-9743-4d18-ac17-ae2964754240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:02.725863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2dcea-9743-4d18-ac17-ae2964754240 admin admin] PATH_INFO: `/v3/projects/b28034a4f7de46279403c30849e490de` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:02.727896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2dcea-9743-4d18-ac17-ae2964754240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28034a4f7de46279403c30849e490de)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:02.738959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2dcea-9743-4d18-ac17-ae2964754240 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:02.806037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a9c2dcea-9743-4d18-ac17-ae2964754240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28034a4f7de46279403c30849e490de', 'request_id': 'req-a9c2dcea-9743-4d18-ac17-ae2964754240'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:02.815247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a9c2dcea-9743-4d18-ac17-ae2964754240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28034a4f7de46279403c30849e490de', 'request_id': 'req-a9c2dcea-9743-4d18-ac17-ae2964754240'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:02.828426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a9c2dcea-9743-4d18-ac17-ae2964754240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28034a4f7de46279403c30849e490de', 'request_id': 'req-a9c2dcea-9743-4d18-ac17-ae2964754240'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:02.844029 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a9c2dcea-9743-4d18-ac17-ae2964754240 admin admin] The token cache is being invalidate because project b28034a4f7de46279403c30849e490de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:31:02.844360 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a9c2dcea-9743-4d18-ac17-ae2964754240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:02.845125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a9c2dcea-9743-4d18-ac17-ae2964754240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:02.847010 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1191/2335] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:31:02 2022] DELETE /identity/v3/projects/b28034a4f7de46279403c30849e490de => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:02.852522 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31070c6c-57a5-4229-a935-f7b25293b922 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:02.853396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31070c6c-57a5-4229-a935-f7b25293b922 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:02.854075 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31070c6c-57a5-4229-a935-f7b25293b922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:02.862305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:02.958364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-31070c6c-57a5-4229-a935-f7b25293b922 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:02.960745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-31070c6c-57a5-4229-a935-f7b25293b922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:03.047558 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1145/2336] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:31:03.057233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b328c19-2889-4014-8719-0667ab1108e3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:03.057795 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b328c19-2889-4014-8719-0667ab1108e3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:03.058230 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b328c19-2889-4014-8719-0667ab1108e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:03.084043 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3b328c19-2889-4014-8719-0667ab1108e3 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:03.085549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3b328c19-2889-4014-8719-0667ab1108e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:03.095440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1192/2337] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:03.100826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31070c6c-57a5-4229-a935-f7b25293b922 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:03.119373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31070c6c-57a5-4229-a935-f7b25293b922 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:03.126286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc7b75-749f-4753-a963-72bfc05a1467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:03.126965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc7b75-749f-4753-a963-72bfc05a1467 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:03.127246 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc7b75-749f-4753-a963-72bfc05a1467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:03.127514 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc7b75-749f-4753-a963-72bfc05a1467 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:03.128183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc7b75-749f-4753-a963-72bfc05a1467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:31:03.128491 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc7b75-749f-4753-a963-72bfc05a1467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:03.130791 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc7b75-749f-4753-a963-72bfc05a1467 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:03.145599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1146/2338] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:31:03.150246 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b328c19-2889-4014-8719-0667ab1108e3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:03.159863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b328c19-2889-4014-8719-0667ab1108e3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:03.165631 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323669aa-d7ff-4b55-add0-31b9c88e6741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:03.166568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323669aa-d7ff-4b55-add0-31b9c88e6741 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:03.166956 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323669aa-d7ff-4b55-add0-31b9c88e6741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:03.167397 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323669aa-d7ff-4b55-add0-31b9c88e6741 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:03.168130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323669aa-d7ff-4b55-add0-31b9c88e6741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:03.170203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323669aa-d7ff-4b55-add0-31b9c88e6741 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:03.185818 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:03.232388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1193/2339] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:31:03 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:03.233432 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc7b75-749f-4753-a963-72bfc05a1467 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:03.247767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc7b75-749f-4753-a963-72bfc05a1467 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:03.328824 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb9ee7-5eac-472d-a4ba-54e897c6de01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:03.330332 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb9ee7-5eac-472d-a4ba-54e897c6de01 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:03.330734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb9ee7-5eac-472d-a4ba-54e897c6de01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:03.331111 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb9ee7-5eac-472d-a4ba-54e897c6de01 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:03.331985 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb9ee7-5eac-472d-a4ba-54e897c6de01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:03.334181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb9ee7-5eac-472d-a4ba-54e897c6de01 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:03.368276 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1147/2340] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:31:03 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:03.370304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323669aa-d7ff-4b55-add0-31b9c88e6741 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:03.394556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323669aa-d7ff-4b55-add0-31b9c88e6741 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:03.402177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a26f2-cc70-414a-8b3c-053efac1fd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:03.404555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a26f2-cc70-414a-8b3c-053efac1fd93 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:03.405029 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a26f2-cc70-414a-8b3c-053efac1fd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:03.405506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a26f2-cc70-414a-8b3c-053efac1fd93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:03.406373 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a26f2-cc70-414a-8b3c-053efac1fd93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:03.408382 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a26f2-cc70-414a-8b3c-053efac1fd93 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:03.424332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1194/2341] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:31:03.431951 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb9ee7-5eac-472d-a4ba-54e897c6de01 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:03.456213 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb9ee7-5eac-472d-a4ba-54e897c6de01 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:03.467154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e36217-9e84-49be-a1cf-3a96ed8e776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:03.468362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36217-9e84-49be-a1cf-3a96ed8e776e admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:03.469194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36217-9e84-49be-a1cf-3a96ed8e776e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:03.469795 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36217-9e84-49be-a1cf-3a96ed8e776e admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:03.470929 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e36217-9e84-49be-a1cf-3a96ed8e776e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:03.474779 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e36217-9e84-49be-a1cf-3a96ed8e776e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:03.493464 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1148/2342] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:31:03.499122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a26f2-cc70-414a-8b3c-053efac1fd93 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:03.515597 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a26f2-cc70-414a-8b3c-053efac1fd93 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:03.523841 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a1a15-d3ad-41b0-b36e-4794b7bfc3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:03.524812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1a15-d3ad-41b0-b36e-4794b7bfc3b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:03.525322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1a15-d3ad-41b0-b36e-4794b7bfc3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:03.525884 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1a15-d3ad-41b0-b36e-4794b7bfc3b5 admin admin] PATH_INFO: `/v3/projects/2cbbd0d1e10f4902b9bd8d6277afd362/users/b2c47e9a10004362b97b946b405125c1/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:03.547039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a1a15-d3ad-41b0-b36e-4794b7bfc3b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbbd0d1e10f4902b9bd8d6277afd362, user_id=b2c47e9a10004362b97b946b405125c1, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:03.550062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a1a15-d3ad-41b0-b36e-4794b7bfc3b5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:03.567028 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1195/2343] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:03 2022] PUT /identity/v3/projects/2cbbd0d1e10f4902b9bd8d6277afd362/users/b2c47e9a10004362b97b946b405125c1/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:03.587394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd05d8-9151-4f6d-a628-ce925bb8d0e9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:03.587747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd05d8-9151-4f6d-a628-ce925bb8d0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:03.588185 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd05d8-9151-4f6d-a628-ce925bb8d0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:03.639855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-dcdd05d8-9151-4f6d-a628-ce925bb8d0e9 None None] MFA Rules not processed for user `b2c47e9a10004362b97b946b405125c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:03.641221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-dcdd05d8-9151-4f6d-a628-ce925bb8d0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:03.677579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:03.728630 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1149/2344] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:03.733269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a1a15-d3ad-41b0-b36e-4794b7bfc3b5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:03.811937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a1a15-d3ad-41b0-b36e-4794b7bfc3b5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:03.818033 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c750e4b-3cad-4ade-9b0a-4e4e75b8d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:03.818678 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c750e4b-3cad-4ade-9b0a-4e4e75b8d210 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:03.818958 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c750e4b-3cad-4ade-9b0a-4e4e75b8d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:03.819232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c750e4b-3cad-4ade-9b0a-4e4e75b8d210 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:03.820443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c750e4b-3cad-4ade-9b0a-4e4e75b8d210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:03.822969 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c750e4b-3cad-4ade-9b0a-4e4e75b8d210 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:03.865780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1196/2345] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:31:03 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:03.869206 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd05d8-9151-4f6d-a628-ce925bb8d0e9 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:03.882048 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd05d8-9151-4f6d-a628-ce925bb8d0e9 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:03.992717 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a22351-c7e2-4ae8-99d6-18dd684fc859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:03.993592 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22351-c7e2-4ae8-99d6-18dd684fc859 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:03.993937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22351-c7e2-4ae8-99d6-18dd684fc859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:03.994153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22351-c7e2-4ae8-99d6-18dd684fc859 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:03.999901 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a22351-c7e2-4ae8-99d6-18dd684fc859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:04.002683 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a22351-c7e2-4ae8-99d6-18dd684fc859 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:04.040525 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1150/2346] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:31:03 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:04.044411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c750e4b-3cad-4ade-9b0a-4e4e75b8d210 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:04.056446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c750e4b-3cad-4ade-9b0a-4e4e75b8d210 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:04.061859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403054e-edaa-4f8a-8099-481d66446efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:04.062896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403054e-edaa-4f8a-8099-481d66446efa admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:04.062896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403054e-edaa-4f8a-8099-481d66446efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:04.063371 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403054e-edaa-4f8a-8099-481d66446efa admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:04.064242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403054e-edaa-4f8a-8099-481d66446efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:04.066139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403054e-edaa-4f8a-8099-481d66446efa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:04.080412 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1197/2347] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:04.085286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a22351-c7e2-4ae8-99d6-18dd684fc859 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:04.099895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a22351-c7e2-4ae8-99d6-18dd684fc859 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:04.114881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0ec5d-3e85-42a4-a995-23ab3ef14b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:04.115978 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ec5d-3e85-42a4-a995-23ab3ef14b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:04.116547 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ec5d-3e85-42a4-a995-23ab3ef14b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:04.117150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ec5d-3e85-42a4-a995-23ab3ef14b55 admin admin] PATH_INFO: `/v3/projects/af0c3af09a6b4fa283a0c72f3a781b69/users/22e30a18af5c48878bea407456ba2037/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:04.159983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0ec5d-3e85-42a4-a995-23ab3ef14b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0c3af09a6b4fa283a0c72f3a781b69, user_id=22e30a18af5c48878bea407456ba2037, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:04.164582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0ec5d-3e85-42a4-a995-23ab3ef14b55 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:04.188783 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1151/2348] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:04 2022] PUT /identity/v3/projects/af0c3af09a6b4fa283a0c72f3a781b69/users/22e30a18af5c48878bea407456ba2037/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:04.194523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403054e-edaa-4f8a-8099-481d66446efa admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:04.205887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403054e-edaa-4f8a-8099-481d66446efa admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:04.287042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19585d57-fc30-4052-86f4-748974fa2090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:04.287677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19585d57-fc30-4052-86f4-748974fa2090 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:04.287953 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19585d57-fc30-4052-86f4-748974fa2090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:04.288226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19585d57-fc30-4052-86f4-748974fa2090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:04.288967 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19585d57-fc30-4052-86f4-748974fa2090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:04.290601 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19585d57-fc30-4052-86f4-748974fa2090 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:04.311386 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1198/2349] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:04.315836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0ec5d-3e85-42a4-a995-23ab3ef14b55 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:04.327925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0ec5d-3e85-42a4-a995-23ab3ef14b55 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:04.334905 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9018f-eb5b-4da9-8e61-cf213b43d66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:04.335835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9018f-eb5b-4da9-8e61-cf213b43d66b admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:04.336550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9018f-eb5b-4da9-8e61-cf213b43d66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:04.336982 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9018f-eb5b-4da9-8e61-cf213b43d66b admin admin] PATH_INFO: `/v3/projects/af0c3af09a6b4fa283a0c72f3a781b69/users/22e30a18af5c48878bea407456ba2037/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:04.339897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9018f-eb5b-4da9-8e61-cf213b43d66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0c3af09a6b4fa283a0c72f3a781b69, user_id=22e30a18af5c48878bea407456ba2037, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:04.342816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9018f-eb5b-4da9-8e61-cf213b43d66b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:04.356395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1152/2350] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:04 2022] PUT /identity/v3/projects/af0c3af09a6b4fa283a0c72f3a781b69/users/22e30a18af5c48878bea407456ba2037/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:04.367575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b656740-0a88-410c-8b33-4457063ba30d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:04.368120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b656740-0a88-410c-8b33-4457063ba30d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:04.368613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b656740-0a88-410c-8b33-4457063ba30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:04.408227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7b656740-0a88-410c-8b33-4457063ba30d None None] MFA Rules not processed for user `22e30a18af5c48878bea407456ba2037`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:04.409695 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7b656740-0a88-410c-8b33-4457063ba30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:04.416333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:04.519343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1199/2351] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:31:04.537023 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9018f-eb5b-4da9-8e61-cf213b43d66b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:04.538866 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3ef9018f-eb5b-4da9-8e61-cf213b43d66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:04.616611 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9018f-eb5b-4da9-8e61-cf213b43d66b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:04.621990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d54ac0-ee6c-408d-a683-825e825dd956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:04.622701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d54ac0-ee6c-408d-a683-825e825dd956 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:04.622892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d54ac0-ee6c-408d-a683-825e825dd956 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:04.623164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d54ac0-ee6c-408d-a683-825e825dd956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:04.681496 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:04.725802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d54ac0-ee6c-408d-a683-825e825dd956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:04.728821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d54ac0-ee6c-408d-a683-825e825dd956 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:04.745070 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1153/2352] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:31:06.317270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7897f-b523-4fb2-9a7d-6f1048a3ca6e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:06.317910 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7897f-b523-4fb2-9a7d-6f1048a3ca6e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:06.317910 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7897f-b523-4fb2-9a7d-6f1048a3ca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:06.345180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-12f7897f-b523-4fb2-9a7d-6f1048a3ca6e None None] MFA Rules not processed for user `b6093246f53b4dcb961f47aea99fb1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:06.345180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-12f7897f-b523-4fb2-9a7d-6f1048a3ca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:06.357899 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d54ac0-ee6c-408d-a683-825e825dd956 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:06.359421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-98d54ac0-ee6c-408d-a683-825e825dd956 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:06.372600 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d54ac0-ee6c-408d-a683-825e825dd956 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:06.376535 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643a1d0-f7a1-4f02-81e5-537a9d8c4f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:06.377207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643a1d0-f7a1-4f02-81e5-537a9d8c4f8c service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:06.377485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643a1d0-f7a1-4f02-81e5-537a9d8c4f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:06.377839 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643a1d0-f7a1-4f02-81e5-537a9d8c4f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:06.390189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643a1d0-f7a1-4f02-81e5-537a9d8c4f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:06.391661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643a1d0-f7a1-4f02-81e5-537a9d8c4f8c service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:06.402428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1154/2353] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:31:06.416737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1200/2354] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:10.627474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643a1d0-f7a1-4f02-81e5-537a9d8c4f8c service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:10.694416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643a1d0-f7a1-4f02-81e5-537a9d8c4f8c service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:10.699602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16000037-0ba5-41e2-977b-e23392616ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:10.700353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16000037-0ba5-41e2-977b-e23392616ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:10.700632 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16000037-0ba5-41e2-977b-e23392616ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:10.700934 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16000037-0ba5-41e2-977b-e23392616ccc admin admin] PATH_INFO: `/v3/users/b2c47e9a10004362b97b946b405125c1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:10.702191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16000037-0ba5-41e2-977b-e23392616ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c47e9a10004362b97b946b405125c1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:10.704055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16000037-0ba5-41e2-977b-e23392616ccc admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:10.759644 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-16000037-0ba5-41e2-977b-e23392616ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c47e9a10004362b97b946b405125c1'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:10.760252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-16000037-0ba5-41e2-977b-e23392616ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c47e9a10004362b97b946b405125c1'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:10.760894 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-16000037-0ba5-41e2-977b-e23392616ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c47e9a10004362b97b946b405125c1'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:10.768476 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-16000037-0ba5-41e2-977b-e23392616ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c47e9a10004362b97b946b405125c1'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:10.782376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-16000037-0ba5-41e2-977b-e23392616ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c47e9a10004362b97b946b405125c1'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:10.799412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1155/2355] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:31:10 2022] DELETE /identity/v3/users/b2c47e9a10004362b97b946b405125c1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:31:10.804674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c603f2-166c-4a9a-8d72-a0a35eb43891 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:10.805494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c603f2-166c-4a9a-8d72-a0a35eb43891 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:10.805656 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c603f2-166c-4a9a-8d72-a0a35eb43891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:10.829737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c6c603f2-166c-4a9a-8d72-a0a35eb43891 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:10.830970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c6c603f2-166c-4a9a-8d72-a0a35eb43891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:10.915050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1201/2356] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:31:10.927682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16000037-0ba5-41e2-977b-e23392616ccc admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:10.929289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-16000037-0ba5-41e2-977b-e23392616ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:10.978873 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:10.996962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16000037-0ba5-41e2-977b-e23392616ccc admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:11.000763 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c9a11-a0a9-4238-9b74-4a4e28c43b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:11.001400 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c9a11-a0a9-4238-9b74-4a4e28c43b21 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:11.001684 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c9a11-a0a9-4238-9b74-4a4e28c43b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:11.001955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c9a11-a0a9-4238-9b74-4a4e28c43b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:11.012644 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c9a11-a0a9-4238-9b74-4a4e28c43b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:11.014073 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c9a11-a0a9-4238-9b74-4a4e28c43b21 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:11.029487 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1156/2357] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:11.408255 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c603f2-166c-4a9a-8d72-a0a35eb43891 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:11.409763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c6c603f2-166c-4a9a-8d72-a0a35eb43891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:11.424335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c603f2-166c-4a9a-8d72-a0a35eb43891 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:11.437601 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:11.438324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:11.438603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:11.438876 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] PATH_INFO: `/v3/projects/2cbbd0d1e10f4902b9bd8d6277afd362` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:11.440206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cbbd0d1e10f4902b9bd8d6277afd362)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:11.442223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:11.490474 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:11.498419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cbbd0d1e10f4902b9bd8d6277afd362', 'request_id': 'req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:11.512147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cbbd0d1e10f4902b9bd8d6277afd362', 'request_id': 'req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:11.522426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cbbd0d1e10f4902b9bd8d6277afd362', 'request_id': 'req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:11.536026 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] The token cache is being invalidate because project 2cbbd0d1e10f4902b9bd8d6277afd362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:31:11.536318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:11.537036 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:11.538617 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1202/2358] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:31:11 2022] DELETE /identity/v3/projects/2cbbd0d1e10f4902b9bd8d6277afd362 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:31:11.542751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c9a11-a0a9-4238-9b74-4a4e28c43b21 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:11.556169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c9a11-a0a9-4238-9b74-4a4e28c43b21 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:11.626750 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e64e4-1613-4094-a6c2-9231269be4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:11.627399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e64e4-1613-4094-a6c2-9231269be4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:11.627677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e64e4-1613-4094-a6c2-9231269be4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:11.628272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e64e4-1613-4094-a6c2-9231269be4ba admin admin] PATH_INFO: `/v3/users/22e30a18af5c48878bea407456ba2037` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:11.629228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e64e4-1613-4094-a6c2-9231269be4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e30a18af5c48878bea407456ba2037)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:11.631182 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e64e4-1613-4094-a6c2-9231269be4ba admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:11.686343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-404e64e4-1613-4094-a6c2-9231269be4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e30a18af5c48878bea407456ba2037'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:11.687038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-404e64e4-1613-4094-a6c2-9231269be4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e30a18af5c48878bea407456ba2037'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:11.687643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-404e64e4-1613-4094-a6c2-9231269be4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e30a18af5c48878bea407456ba2037'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:11.695697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-404e64e4-1613-4094-a6c2-9231269be4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e30a18af5c48878bea407456ba2037'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:11.709330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-404e64e4-1613-4094-a6c2-9231269be4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e30a18af5c48878bea407456ba2037'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:11.724086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1157/2359] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:31:11 2022] DELETE /identity/v3/users/22e30a18af5c48878bea407456ba2037 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:12.101236 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:12.102906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:12.132943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfddcf7-87df-4c58-bc5f-bbacf75ef27f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:12.206416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b0891-0452-4837-8e78-156c0cdfcf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:12.207573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b0891-0452-4837-8e78-156c0cdfcf81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:12.207863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b0891-0452-4837-8e78-156c0cdfcf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:12.208127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b0891-0452-4837-8e78-156c0cdfcf81 admin admin] PATH_INFO: `/v3/projects/af0c3af09a6b4fa283a0c72f3a781b69` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:12.209338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b0891-0452-4837-8e78-156c0cdfcf81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af0c3af09a6b4fa283a0c72f3a781b69)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:12.211389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b0891-0452-4837-8e78-156c0cdfcf81 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:12.264373 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9e4b0891-0452-4837-8e78-156c0cdfcf81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af0c3af09a6b4fa283a0c72f3a781b69', 'request_id': 'req-9e4b0891-0452-4837-8e78-156c0cdfcf81'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:12.270637 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9e4b0891-0452-4837-8e78-156c0cdfcf81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af0c3af09a6b4fa283a0c72f3a781b69', 'request_id': 'req-9e4b0891-0452-4837-8e78-156c0cdfcf81'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:12.280231 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9e4b0891-0452-4837-8e78-156c0cdfcf81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af0c3af09a6b4fa283a0c72f3a781b69', 'request_id': 'req-9e4b0891-0452-4837-8e78-156c0cdfcf81'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:12.294334 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9e4b0891-0452-4837-8e78-156c0cdfcf81 admin admin] The token cache is being invalidate because project af0c3af09a6b4fa283a0c72f3a781b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:31:12.294651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9e4b0891-0452-4837-8e78-156c0cdfcf81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:12.295333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9e4b0891-0452-4837-8e78-156c0cdfcf81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:12.297076 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1203/2360] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:31:12 2022] DELETE /identity/v3/projects/af0c3af09a6b4fa283a0c72f3a781b69 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:31:12.302279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf621342-784d-43f2-a613-52a94a6cc8a2 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:12.302565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf621342-784d-43f2-a613-52a94a6cc8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:12.302846 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf621342-784d-43f2-a613-52a94a6cc8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:12.330096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-cf621342-784d-43f2-a613-52a94a6cc8a2 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:12.331328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cf621342-784d-43f2-a613-52a94a6cc8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:12.404306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1158/2361] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:12.412959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb28c-186c-4872-bb20-c98600695ea9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:12.413274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb28c-186c-4872-bb20-c98600695ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:12.413512 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb28c-186c-4872-bb20-c98600695ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:12.436324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-040fb28c-186c-4872-bb20-c98600695ea9 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:12.437875 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-040fb28c-186c-4872-bb20-c98600695ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:12.448746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1204/2362] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:31:12.453369 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf621342-784d-43f2-a613-52a94a6cc8a2 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:12.461490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:12.470492 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf621342-784d-43f2-a613-52a94a6cc8a2 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:12.478622 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17345135-ec53-4eca-9bb3-f487628deb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:12.480502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17345135-ec53-4eca-9bb3-f487628deb7c admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:12.480502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17345135-ec53-4eca-9bb3-f487628deb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:12.480502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17345135-ec53-4eca-9bb3-f487628deb7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:12.481035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17345135-ec53-4eca-9bb3-f487628deb7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:31:12.481035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17345135-ec53-4eca-9bb3-f487628deb7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:12.483059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17345135-ec53-4eca-9bb3-f487628deb7c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:12.506430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1159/2363] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:31:12.513206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fb28c-186c-4872-bb20-c98600695ea9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:12.530638 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fb28c-186c-4872-bb20-c98600695ea9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:12.540086 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ace92-e5aa-45f5-9f80-0e921e2fc2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:12.541193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ace92-e5aa-45f5-9f80-0e921e2fc2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:12.541693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ace92-e5aa-45f5-9f80-0e921e2fc2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:12.542168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ace92-e5aa-45f5-9f80-0e921e2fc2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:12.543349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ace92-e5aa-45f5-9f80-0e921e2fc2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:12.546841 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ace92-e5aa-45f5-9f80-0e921e2fc2f2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:12.583324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1205/2364] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:31:12 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:12.588153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17345135-ec53-4eca-9bb3-f487628deb7c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:12.600186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17345135-ec53-4eca-9bb3-f487628deb7c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:12.662956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c822b-c3e2-4818-a6c7-0e65d6d43319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:12.663645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c822b-c3e2-4818-a6c7-0e65d6d43319 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:12.663837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c822b-c3e2-4818-a6c7-0e65d6d43319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:12.664107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c822b-c3e2-4818-a6c7-0e65d6d43319 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:12.664784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c822b-c3e2-4818-a6c7-0e65d6d43319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:12.666737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c822b-c3e2-4818-a6c7-0e65d6d43319 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:12.690280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1160/2365] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:31:12 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:31:12.695144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ace92-e5aa-45f5-9f80-0e921e2fc2f2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:12.706468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ace92-e5aa-45f5-9f80-0e921e2fc2f2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:12.711354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bbfc3-e114-4dd4-84d1-fb143e4131b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:12.711976 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bbfc3-e114-4dd4-84d1-fb143e4131b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:12.712254 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bbfc3-e114-4dd4-84d1-fb143e4131b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:12.712553 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bbfc3-e114-4dd4-84d1-fb143e4131b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:12.713239 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bbfc3-e114-4dd4-84d1-fb143e4131b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:12.714908 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bbfc3-e114-4dd4-84d1-fb143e4131b4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:12.730877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1206/2366] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:12.735517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c822b-c3e2-4818-a6c7-0e65d6d43319 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:12.747071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c822b-c3e2-4818-a6c7-0e65d6d43319 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:12.752192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7a242-717a-4c50-8c52-f945aa564fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:12.752836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a242-717a-4c50-8c52-f945aa564fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:12.753116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a242-717a-4c50-8c52-f945aa564fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:12.753387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a242-717a-4c50-8c52-f945aa564fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:12.754599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7a242-717a-4c50-8c52-f945aa564fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:12.756260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7a242-717a-4c50-8c52-f945aa564fc2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:12.768012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1161/2367] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:12.772553 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bbfc3-e114-4dd4-84d1-fb143e4131b4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:12.782740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bbfc3-e114-4dd4-84d1-fb143e4131b4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:12.787851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3f25f-db45-47aa-940b-c2c77f08526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:12.788517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3f25f-db45-47aa-940b-c2c77f08526e admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:12.788829 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3f25f-db45-47aa-940b-c2c77f08526e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:12.789105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3f25f-db45-47aa-940b-c2c77f08526e admin admin] PATH_INFO: `/v3/projects/4f81785be9404927a1d3a9460a1356f9/users/d12fcdf1051e4515afccbfa67fdd8ac5/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:12.805214 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3f25f-db45-47aa-940b-c2c77f08526e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f81785be9404927a1d3a9460a1356f9, user_id=d12fcdf1051e4515afccbfa67fdd8ac5, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:12.807887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3f25f-db45-47aa-940b-c2c77f08526e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:12.817691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:12.824411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1207/2368] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:12 2022] PUT /identity/v3/projects/4f81785be9404927a1d3a9460a1356f9/users/d12fcdf1051e4515afccbfa67fdd8ac5/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:31:12.837735 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48401-cf33-4bdc-98ee-5e441363f9fc None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:12.838002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48401-cf33-4bdc-98ee-5e441363f9fc None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:12.838279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48401-cf33-4bdc-98ee-5e441363f9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:12.869633 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8df48401-cf33-4bdc-98ee-5e441363f9fc None None] MFA Rules not processed for user `d12fcdf1051e4515afccbfa67fdd8ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:12.870955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8df48401-cf33-4bdc-98ee-5e441363f9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:12.946419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1162/2369] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:12.951316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3f25f-db45-47aa-940b-c2c77f08526e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:13.033901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3f25f-db45-47aa-940b-c2c77f08526e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:13.041231 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cc3f3-dee1-48e2-a3d1-738478e76895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:13.042182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cc3f3-dee1-48e2-a3d1-738478e76895 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:13.042649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cc3f3-dee1-48e2-a3d1-738478e76895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:13.043174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cc3f3-dee1-48e2-a3d1-738478e76895 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:13.044278 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cc3f3-dee1-48e2-a3d1-738478e76895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:13.048022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cc3f3-dee1-48e2-a3d1-738478e76895 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:13.095103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1208/2370] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:31:12 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:13.101251 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df48401-cf33-4bdc-98ee-5e441363f9fc None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:13.119677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df48401-cf33-4bdc-98ee-5e441363f9fc None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:13.197441 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:13.204038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ee477-9082-495f-b934-fb97c252933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:13.204931 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ee477-9082-495f-b934-fb97c252933c admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:13.205393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ee477-9082-495f-b934-fb97c252933c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:13.205844 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ee477-9082-495f-b934-fb97c252933c admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:13.206481 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ee477-9082-495f-b934-fb97c252933c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:13.209183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ee477-9082-495f-b934-fb97c252933c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:13.234866 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1163/2371] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:31:13 2022] POST /identity/v3/users => generated 300 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:13.239504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cc3f3-dee1-48e2-a3d1-738478e76895 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:13.251224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cc3f3-dee1-48e2-a3d1-738478e76895 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:13.258319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9fe27-94e7-48a2-8e9a-5373905283bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:13.259265 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9fe27-94e7-48a2-8e9a-5373905283bc admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:13.259704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9fe27-94e7-48a2-8e9a-5373905283bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:13.260058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9fe27-94e7-48a2-8e9a-5373905283bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:13.260884 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9fe27-94e7-48a2-8e9a-5373905283bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:13.262741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9fe27-94e7-48a2-8e9a-5373905283bc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:13.275353 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1209/2372] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:13.280025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ee477-9082-495f-b934-fb97c252933c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:13.291150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ee477-9082-495f-b934-fb97c252933c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:13.296374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eac307-5c0d-4a73-82e9-7e5ec6565dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:13.297197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eac307-5c0d-4a73-82e9-7e5ec6565dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:13.297556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eac307-5c0d-4a73-82e9-7e5ec6565dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:13.297904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eac307-5c0d-4a73-82e9-7e5ec6565dc0 admin admin] PATH_INFO: `/v3/projects/ad4e545592034e54b840e6193b81b33a/users/4b31c7800220412f906fe40f73206820/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:13.313329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eac307-5c0d-4a73-82e9-7e5ec6565dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4e545592034e54b840e6193b81b33a, user_id=4b31c7800220412f906fe40f73206820, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:13.316020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eac307-5c0d-4a73-82e9-7e5ec6565dc0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:13.334271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1164/2373] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:13 2022] PUT /identity/v3/projects/ad4e545592034e54b840e6193b81b33a/users/4b31c7800220412f906fe40f73206820/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:31:13.338659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9fe27-94e7-48a2-8e9a-5373905283bc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:13.349353 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9fe27-94e7-48a2-8e9a-5373905283bc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:13.406695 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd600ef-02c2-4e74-8c00-f7cf51abbda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:13.407302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd600ef-02c2-4e74-8c00-f7cf51abbda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:13.407575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd600ef-02c2-4e74-8c00-f7cf51abbda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:13.407842 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd600ef-02c2-4e74-8c00-f7cf51abbda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:13.408473 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd600ef-02c2-4e74-8c00-f7cf51abbda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:13.410114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd600ef-02c2-4e74-8c00-f7cf51abbda9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:13.420710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1210/2374] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:13.425308 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eac307-5c0d-4a73-82e9-7e5ec6565dc0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:13.436498 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eac307-5c0d-4a73-82e9-7e5ec6565dc0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:13.441366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b9fac-2fb1-4d7e-9921-9ad165db53be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:13.442574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b9fac-2fb1-4d7e-9921-9ad165db53be admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:13.442849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b9fac-2fb1-4d7e-9921-9ad165db53be admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:13.443118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b9fac-2fb1-4d7e-9921-9ad165db53be admin admin] PATH_INFO: `/v3/projects/ad4e545592034e54b840e6193b81b33a/users/4b31c7800220412f906fe40f73206820/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:13.445087 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b9fac-2fb1-4d7e-9921-9ad165db53be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4e545592034e54b840e6193b81b33a, user_id=4b31c7800220412f906fe40f73206820, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:13.448233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b9fac-2fb1-4d7e-9921-9ad165db53be admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:13.470521 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1165/2375] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:13 2022] PUT /identity/v3/projects/ad4e545592034e54b840e6193b81b33a/users/4b31c7800220412f906fe40f73206820/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:13.484646 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f65da3-018c-48e7-a78c-176d13538679 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:13.485078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f65da3-018c-48e7-a78c-176d13538679 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:13.485401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f65da3-018c-48e7-a78c-176d13538679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:13.532581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-42f65da3-018c-48e7-a78c-176d13538679 None None] MFA Rules not processed for user `4b31c7800220412f906fe40f73206820`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:13.534295 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-42f65da3-018c-48e7-a78c-176d13538679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:13.611035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:13.626879 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1211/2376] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:13.641694 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b9fac-2fb1-4d7e-9921-9ad165db53be admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:13.643701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4e5b9fac-2fb1-4d7e-9921-9ad165db53be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:13.725672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b9fac-2fb1-4d7e-9921-9ad165db53be admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:13.729533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a2a44-4273-49b3-88aa-df18466e3dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:13.730267 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a2a44-4273-49b3-88aa-df18466e3dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:13.733061 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a2a44-4273-49b3-88aa-df18466e3dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:13.733642 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a2a44-4273-49b3-88aa-df18466e3dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:13.745637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a2a44-4273-49b3-88aa-df18466e3dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:13.747121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a2a44-4273-49b3-88aa-df18466e3dd5 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:13.758901 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1166/2377] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:13.844364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f65da3-018c-48e7-a78c-176d13538679 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:13.917154 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f65da3-018c-48e7-a78c-176d13538679 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:13.921941 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946fe0f-bec0-4d0a-b299-a491501a681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:13.922593 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946fe0f-bec0-4d0a-b299-a491501a681a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:13.922867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946fe0f-bec0-4d0a-b299-a491501a681a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:13.923154 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946fe0f-bec0-4d0a-b299-a491501a681a admin admin] PATH_INFO: `/v3/users/d12fcdf1051e4515afccbfa67fdd8ac5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:13.924300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946fe0f-bec0-4d0a-b299-a491501a681a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12fcdf1051e4515afccbfa67fdd8ac5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:13.926948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946fe0f-bec0-4d0a-b299-a491501a681a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:13.977774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c946fe0f-bec0-4d0a-b299-a491501a681a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12fcdf1051e4515afccbfa67fdd8ac5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:13.978432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c946fe0f-bec0-4d0a-b299-a491501a681a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12fcdf1051e4515afccbfa67fdd8ac5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:13.990564 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c946fe0f-bec0-4d0a-b299-a491501a681a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12fcdf1051e4515afccbfa67fdd8ac5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:13.997510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c946fe0f-bec0-4d0a-b299-a491501a681a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12fcdf1051e4515afccbfa67fdd8ac5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:13.998250 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c946fe0f-bec0-4d0a-b299-a491501a681a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12fcdf1051e4515afccbfa67fdd8ac5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:14.011618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1212/2378] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:31:13 2022] DELETE /identity/v3/users/d12fcdf1051e4515afccbfa67fdd8ac5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:14.016332 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79535f-dde6-477d-bfd9-bba9d1842bb9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:14.016650 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79535f-dde6-477d-bfd9-bba9d1842bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:14.016979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79535f-dde6-477d-bfd9-bba9d1842bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:14.036278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8e79535f-dde6-477d-bfd9-bba9d1842bb9 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:14.037532 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8e79535f-dde6-477d-bfd9-bba9d1842bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:14.102039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1167/2379] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:31:14.114318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946fe0f-bec0-4d0a-b299-a491501a681a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:14.115743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c946fe0f-bec0-4d0a-b299-a491501a681a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:14.174266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946fe0f-bec0-4d0a-b299-a491501a681a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:14.178520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b56a98-e671-45f0-bd46-19666d38211f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:14.179142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b56a98-e671-45f0-bd46-19666d38211f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:14.179416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b56a98-e671-45f0-bd46-19666d38211f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:14.179684 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b56a98-e671-45f0-bd46-19666d38211f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:14.189390 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b56a98-e671-45f0-bd46-19666d38211f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:14.190824 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b56a98-e671-45f0-bd46-19666d38211f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:14.202119 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1213/2380] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:31:14.503328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79535f-dde6-477d-bfd9-bba9d1842bb9 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:14.505317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8e79535f-dde6-477d-bfd9-bba9d1842bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:14.523603 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79535f-dde6-477d-bfd9-bba9d1842bb9 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:14.529926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:14.530984 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:14.531480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:14.531983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] PATH_INFO: `/v3/projects/4f81785be9404927a1d3a9460a1356f9` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:14.533945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f81785be9404927a1d3a9460a1356f9)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:14.538526 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:14.588119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:14.589660 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f81785be9404927a1d3a9460a1356f9', 'request_id': 'req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:14.598637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f81785be9404927a1d3a9460a1356f9', 'request_id': 'req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:14.604649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f81785be9404927a1d3a9460a1356f9', 'request_id': 'req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:14.618289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] The token cache is being invalidate because project 4f81785be9404927a1d3a9460a1356f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:31:14.618585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:14.619242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:14.620774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1168/2381] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:31:14 2022] DELETE /identity/v3/projects/4f81785be9404927a1d3a9460a1356f9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:14.624761 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b56a98-e671-45f0-bd46-19666d38211f service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:14.634439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b56a98-e671-45f0-bd46-19666d38211f service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:14.645690 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:14.693349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5504eb-dfdf-4a2c-99b8-b555b042957f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:14.693979 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5504eb-dfdf-4a2c-99b8-b555b042957f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:14.694272 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5504eb-dfdf-4a2c-99b8-b555b042957f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:14.694528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5504eb-dfdf-4a2c-99b8-b555b042957f admin admin] PATH_INFO: `/v3/users/4b31c7800220412f906fe40f73206820` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:14.695631 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5504eb-dfdf-4a2c-99b8-b555b042957f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b31c7800220412f906fe40f73206820)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:14.697855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5504eb-dfdf-4a2c-99b8-b555b042957f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:14.744517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ce5504eb-dfdf-4a2c-99b8-b555b042957f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b31c7800220412f906fe40f73206820'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:14.745180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ce5504eb-dfdf-4a2c-99b8-b555b042957f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b31c7800220412f906fe40f73206820'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:14.756715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ce5504eb-dfdf-4a2c-99b8-b555b042957f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b31c7800220412f906fe40f73206820'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:14.763423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ce5504eb-dfdf-4a2c-99b8-b555b042957f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b31c7800220412f906fe40f73206820'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:14.764050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ce5504eb-dfdf-4a2c-99b8-b555b042957f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b31c7800220412f906fe40f73206820'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:14.776987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1214/2382] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:31:14 2022] DELETE /identity/v3/users/4b31c7800220412f906fe40f73206820 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:15.097841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:15.099394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:15.112490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46dc0f-b1a7-473d-8bd4-614fc29c4669 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:15.171532 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235268d-f046-4bc7-988b-de2a0c893ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:15.172173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235268d-f046-4bc7-988b-de2a0c893ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:15.172429 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235268d-f046-4bc7-988b-de2a0c893ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:15.172705 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235268d-f046-4bc7-988b-de2a0c893ee3 admin admin] PATH_INFO: `/v3/projects/ad4e545592034e54b840e6193b81b33a` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:15.173825 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235268d-f046-4bc7-988b-de2a0c893ee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4e545592034e54b840e6193b81b33a)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:15.176216 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235268d-f046-4bc7-988b-de2a0c893ee3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:15.223154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7235268d-f046-4bc7-988b-de2a0c893ee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4e545592034e54b840e6193b81b33a', 'request_id': 'req-7235268d-f046-4bc7-988b-de2a0c893ee3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:15.229579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7235268d-f046-4bc7-988b-de2a0c893ee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4e545592034e54b840e6193b81b33a', 'request_id': 'req-7235268d-f046-4bc7-988b-de2a0c893ee3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:15.235817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7235268d-f046-4bc7-988b-de2a0c893ee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4e545592034e54b840e6193b81b33a', 'request_id': 'req-7235268d-f046-4bc7-988b-de2a0c893ee3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:15.250912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7235268d-f046-4bc7-988b-de2a0c893ee3 admin admin] The token cache is being invalidate because project ad4e545592034e54b840e6193b81b33a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:31:15.251369 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7235268d-f046-4bc7-988b-de2a0c893ee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:15.252040 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7235268d-f046-4bc7-988b-de2a0c893ee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:15.253584 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1169/2383] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:31:15 2022] DELETE /identity/v3/projects/ad4e545592034e54b840e6193b81b33a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:15.258574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83204892-9414-46e7-b88f-792b85548167 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:15.258857 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83204892-9414-46e7-b88f-792b85548167 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:15.259133 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83204892-9414-46e7-b88f-792b85548167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:15.278819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-83204892-9414-46e7-b88f-792b85548167 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:15.280408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-83204892-9414-46e7-b88f-792b85548167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:15.340013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1215/2384] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:15.349853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595adbe6-032d-4e42-b274-61f295b7052e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:15.350135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595adbe6-032d-4e42-b274-61f295b7052e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:15.350403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595adbe6-032d-4e42-b274-61f295b7052e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:15.370343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-595adbe6-032d-4e42-b274-61f295b7052e None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:15.371528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-595adbe6-032d-4e42-b274-61f295b7052e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:15.379384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1170/2385] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:15.383924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83204892-9414-46e7-b88f-792b85548167 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:15.393800 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83204892-9414-46e7-b88f-792b85548167 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:15.398546 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bdf1f-7652-4bbb-97b2-7abe12c2de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:15.399145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bdf1f-7652-4bbb-97b2-7abe12c2de95 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:15.399421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bdf1f-7652-4bbb-97b2-7abe12c2de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:15.399692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bdf1f-7652-4bbb-97b2-7abe12c2de95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:15.400331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1bdf1f-7652-4bbb-97b2-7abe12c2de95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:31:15.400630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1bdf1f-7652-4bbb-97b2-7abe12c2de95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:15.402234 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1bdf1f-7652-4bbb-97b2-7abe12c2de95 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:15.414782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1216/2386] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:31:15.419272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595adbe6-032d-4e42-b274-61f295b7052e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:15.429647 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595adbe6-032d-4e42-b274-61f295b7052e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:15.434406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493f5a0-ecfe-4e01-b64a-e58ab73e2c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:15.435008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493f5a0-ecfe-4e01-b64a-e58ab73e2c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:15.435298 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493f5a0-ecfe-4e01-b64a-e58ab73e2c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:15.435560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493f5a0-ecfe-4e01-b64a-e58ab73e2c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:15.436201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493f5a0-ecfe-4e01-b64a-e58ab73e2c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:15.438122 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493f5a0-ecfe-4e01-b64a-e58ab73e2c05 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:15.470098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1171/2387] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:31:15 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:15.471212 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bdf1f-7652-4bbb-97b2-7abe12c2de95 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:15.481858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bdf1f-7652-4bbb-97b2-7abe12c2de95 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:15.501497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:15.558151 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca32296-4d70-4703-b086-a808a2ec05ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:15.558776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca32296-4d70-4703-b086-a808a2ec05ee admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:15.559053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca32296-4d70-4703-b086-a808a2ec05ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:15.559340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca32296-4d70-4703-b086-a808a2ec05ee admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:15.560023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca32296-4d70-4703-b086-a808a2ec05ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:15.561972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca32296-4d70-4703-b086-a808a2ec05ee admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:15.586717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1217/2388] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:31:15 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:15.590896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493f5a0-ecfe-4e01-b64a-e58ab73e2c05 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:15.602702 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493f5a0-ecfe-4e01-b64a-e58ab73e2c05 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:15.607739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6bd2b-543f-4d0d-9aad-e6e3e56f869c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:15.608600 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6bd2b-543f-4d0d-9aad-e6e3e56f869c admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:15.608992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6bd2b-543f-4d0d-9aad-e6e3e56f869c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:15.609330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6bd2b-543f-4d0d-9aad-e6e3e56f869c admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:15.610134 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6bd2b-543f-4d0d-9aad-e6e3e56f869c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:15.611882 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6bd2b-543f-4d0d-9aad-e6e3e56f869c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:15.626881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1172/2389] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:31:15.628446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca32296-4d70-4703-b086-a808a2ec05ee admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:15.641633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca32296-4d70-4703-b086-a808a2ec05ee admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:15.647405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cead273-eeb0-42c1-aae4-0a175645722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:15.647868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cead273-eeb0-42c1-aae4-0a175645722e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:15.648150 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cead273-eeb0-42c1-aae4-0a175645722e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:15.648429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cead273-eeb0-42c1-aae4-0a175645722e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:15.649238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cead273-eeb0-42c1-aae4-0a175645722e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:15.651337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cead273-eeb0-42c1-aae4-0a175645722e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:15.662890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1218/2390] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:15.667602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6bd2b-543f-4d0d-9aad-e6e3e56f869c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:15.678382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6bd2b-543f-4d0d-9aad-e6e3e56f869c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:15.683330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8d16a-573c-4dd1-9d65-92c176b2d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:15.684145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8d16a-573c-4dd1-9d65-92c176b2d191 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:15.684425 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8d16a-573c-4dd1-9d65-92c176b2d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:15.684754 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8d16a-573c-4dd1-9d65-92c176b2d191 admin admin] PATH_INFO: `/v3/projects/c6b622f0c0c7424eb2495f52907fa928/users/30126c02e5cd4310a76f68590d451245/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:15.700865 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8d16a-573c-4dd1-9d65-92c176b2d191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b622f0c0c7424eb2495f52907fa928, user_id=30126c02e5cd4310a76f68590d451245, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:15.703141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8d16a-573c-4dd1-9d65-92c176b2d191 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:15.724764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1173/2391] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:15 2022] PUT /identity/v3/projects/c6b622f0c0c7424eb2495f52907fa928/users/30126c02e5cd4310a76f68590d451245/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:15.735813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bc722-1b7a-4ee5-9077-7014421161a3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:15.736099 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bc722-1b7a-4ee5-9077-7014421161a3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:15.736370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bc722-1b7a-4ee5-9077-7014421161a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:15.764262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-762bc722-1b7a-4ee5-9077-7014421161a3 None None] MFA Rules not processed for user `30126c02e5cd4310a76f68590d451245`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:15.765501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-762bc722-1b7a-4ee5-9077-7014421161a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:15.833517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1219/2392] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:31:15.838267 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8d16a-573c-4dd1-9d65-92c176b2d191 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:15.842806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:15.904237 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8d16a-573c-4dd1-9d65-92c176b2d191 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:15.908966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d858cc-cf18-4de6-8c85-56e2c3d79404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:15.909562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d858cc-cf18-4de6-8c85-56e2c3d79404 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:15.909881 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d858cc-cf18-4de6-8c85-56e2c3d79404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:15.910737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d858cc-cf18-4de6-8c85-56e2c3d79404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:15.911371 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d858cc-cf18-4de6-8c85-56e2c3d79404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:15.913284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d858cc-cf18-4de6-8c85-56e2c3d79404 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:15.939484 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1174/2393] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:31:15 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:15.943753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bc722-1b7a-4ee5-9077-7014421161a3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:15.954729 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bc722-1b7a-4ee5-9077-7014421161a3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:16.013528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdeaa69-f93f-4e56-8d19-9e0dd1bffb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:16.014141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeaa69-f93f-4e56-8d19-9e0dd1bffb02 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:16.014419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeaa69-f93f-4e56-8d19-9e0dd1bffb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:16.014693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeaa69-f93f-4e56-8d19-9e0dd1bffb02 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:16.015339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdeaa69-f93f-4e56-8d19-9e0dd1bffb02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:16.017358 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdeaa69-f93f-4e56-8d19-9e0dd1bffb02 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:16.041724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1220/2394] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:31:15 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:31:16.043208 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d858cc-cf18-4de6-8c85-56e2c3d79404 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:16.057794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d858cc-cf18-4de6-8c85-56e2c3d79404 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:16.063774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9c312-3136-4746-a066-d6c5bbbca42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:16.064914 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9c312-3136-4746-a066-d6c5bbbca42a admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:16.065348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9c312-3136-4746-a066-d6c5bbbca42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:16.065729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9c312-3136-4746-a066-d6c5bbbca42a admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:16.066943 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9c312-3136-4746-a066-d6c5bbbca42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:16.068802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9c312-3136-4746-a066-d6c5bbbca42a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:16.083132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1175/2395] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:16.088271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdeaa69-f93f-4e56-8d19-9e0dd1bffb02 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:16.099734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdeaa69-f93f-4e56-8d19-9e0dd1bffb02 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:16.105014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c184f-469e-4dd4-934b-069ca4293334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:16.105783 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c184f-469e-4dd4-934b-069ca4293334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:16.106140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c184f-469e-4dd4-934b-069ca4293334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:16.106715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c184f-469e-4dd4-934b-069ca4293334 admin admin] PATH_INFO: `/v3/projects/20dcafc2120e4f74930462bd289c7aeb/users/554ac7683ae8401c8bff2e1e0ef7cb7e/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:16.124343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c184f-469e-4dd4-934b-069ca4293334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20dcafc2120e4f74930462bd289c7aeb, user_id=554ac7683ae8401c8bff2e1e0ef7cb7e, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:16.127943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c184f-469e-4dd4-934b-069ca4293334 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:16.132480 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:16.143897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1221/2396] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:16 2022] PUT /identity/v3/projects/20dcafc2120e4f74930462bd289c7aeb/users/554ac7683ae8401c8bff2e1e0ef7cb7e/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:16.148631 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9c312-3136-4746-a066-d6c5bbbca42a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:16.162025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9c312-3136-4746-a066-d6c5bbbca42a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:16.237288 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e35792-6b21-4708-b4db-295689d783d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:16.237482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35792-6b21-4708-b4db-295689d783d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:16.237693 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35792-6b21-4708-b4db-295689d783d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:16.237871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35792-6b21-4708-b4db-295689d783d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:16.239202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e35792-6b21-4708-b4db-295689d783d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:16.240989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e35792-6b21-4708-b4db-295689d783d6 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:16.254853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1176/2397] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:16.256106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c184f-469e-4dd4-934b-069ca4293334 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:16.266569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c184f-469e-4dd4-934b-069ca4293334 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:16.271840 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c596e3-c0b1-441d-b8c4-cc2f0c9a76e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:16.272550 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c596e3-c0b1-441d-b8c4-cc2f0c9a76e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:16.272814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c596e3-c0b1-441d-b8c4-cc2f0c9a76e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:16.273088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c596e3-c0b1-441d-b8c4-cc2f0c9a76e6 admin admin] PATH_INFO: `/v3/projects/20dcafc2120e4f74930462bd289c7aeb/users/554ac7683ae8401c8bff2e1e0ef7cb7e/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:16.276704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c596e3-c0b1-441d-b8c4-cc2f0c9a76e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20dcafc2120e4f74930462bd289c7aeb, user_id=554ac7683ae8401c8bff2e1e0ef7cb7e, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:16.279555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c596e3-c0b1-441d-b8c4-cc2f0c9a76e6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:16.296881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1222/2398] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:16 2022] PUT /identity/v3/projects/20dcafc2120e4f74930462bd289c7aeb/users/554ac7683ae8401c8bff2e1e0ef7cb7e/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:16.307516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af639c2-19ba-4c43-b365-de4e24623e6e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:16.308020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af639c2-19ba-4c43-b365-de4e24623e6e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:16.308497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af639c2-19ba-4c43-b365-de4e24623e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:16.342492 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1af639c2-19ba-4c43-b365-de4e24623e6e None None] MFA Rules not processed for user `554ac7683ae8401c8bff2e1e0ef7cb7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:16.343731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1af639c2-19ba-4c43-b365-de4e24623e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:16.415279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:16.423444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1177/2399] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:16.434828 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c596e3-c0b1-441d-b8c4-cc2f0c9a76e6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:16.436626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-52c596e3-c0b1-441d-b8c4-cc2f0c9a76e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:16.508906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c596e3-c0b1-441d-b8c4-cc2f0c9a76e6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:16.513179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3303234-151e-4365-96c4-27b7ae3ba57e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:16.513789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303234-151e-4365-96c4-27b7ae3ba57e service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:16.514068 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303234-151e-4365-96c4-27b7ae3ba57e service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:16.514614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303234-151e-4365-96c4-27b7ae3ba57e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:16.527232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3303234-151e-4365-96c4-27b7ae3ba57e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:16.528786 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3303234-151e-4365-96c4-27b7ae3ba57e service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:16.540424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1223/2400] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:16.654232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af639c2-19ba-4c43-b365-de4e24623e6e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:16.664583 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af639c2-19ba-4c43-b365-de4e24623e6e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:16.668430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8227d-c0ba-44be-8a1d-55cb4ea928d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:16.669079 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8227d-c0ba-44be-8a1d-55cb4ea928d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:16.669381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8227d-c0ba-44be-8a1d-55cb4ea928d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:16.669656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8227d-c0ba-44be-8a1d-55cb4ea928d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:16.731893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8227d-c0ba-44be-8a1d-55cb4ea928d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:16.733398 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8227d-c0ba-44be-8a1d-55cb4ea928d9 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:16.744563 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1178/2401] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:19.369288 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3303234-151e-4365-96c4-27b7ae3ba57e service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:19.431165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3303234-151e-4365-96c4-27b7ae3ba57e service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:19.435694 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a11e13-6f91-4e96-a9ec-957cc8146865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:19.436321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a11e13-6f91-4e96-a9ec-957cc8146865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:19.436607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a11e13-6f91-4e96-a9ec-957cc8146865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:19.436903 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a11e13-6f91-4e96-a9ec-957cc8146865 admin admin] PATH_INFO: `/v3/users/30126c02e5cd4310a76f68590d451245` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:19.438014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a11e13-6f91-4e96-a9ec-957cc8146865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30126c02e5cd4310a76f68590d451245)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:19.439971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a11e13-6f91-4e96-a9ec-957cc8146865 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:19.487114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c9a11e13-6f91-4e96-a9ec-957cc8146865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30126c02e5cd4310a76f68590d451245'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:19.487782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c9a11e13-6f91-4e96-a9ec-957cc8146865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30126c02e5cd4310a76f68590d451245'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:19.500473 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c9a11e13-6f91-4e96-a9ec-957cc8146865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30126c02e5cd4310a76f68590d451245'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:19.507773 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c9a11e13-6f91-4e96-a9ec-957cc8146865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30126c02e5cd4310a76f68590d451245'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:19.508464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c9a11e13-6f91-4e96-a9ec-957cc8146865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30126c02e5cd4310a76f68590d451245'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:19.521841 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1224/2402] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:31:19 2022] DELETE /identity/v3/users/30126c02e5cd4310a76f68590d451245 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:19.526712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8111096-e34d-4be0-8d8c-a4f1f0ead073 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:19.527230 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8111096-e34d-4be0-8d8c-a4f1f0ead073 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:19.527331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8111096-e34d-4be0-8d8c-a4f1f0ead073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:19.546989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c8111096-e34d-4be0-8d8c-a4f1f0ead073 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:19.548216 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c8111096-e34d-4be0-8d8c-a4f1f0ead073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:19.611590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1179/2403] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:19.622098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a11e13-6f91-4e96-a9ec-957cc8146865 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:19.623469 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c9a11e13-6f91-4e96-a9ec-957cc8146865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:19.631098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:19.691699 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a11e13-6f91-4e96-a9ec-957cc8146865 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:19.695426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b893b6-1f1d-4637-a2a5-76dd5c65b583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:19.696035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b893b6-1f1d-4637-a2a5-76dd5c65b583 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:19.696314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b893b6-1f1d-4637-a2a5-76dd5c65b583 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:19.696871 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b893b6-1f1d-4637-a2a5-76dd5c65b583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:19.707264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b893b6-1f1d-4637-a2a5-76dd5c65b583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:19.710436 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b893b6-1f1d-4637-a2a5-76dd5c65b583 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:19.719440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1225/2404] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:20.340956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8111096-e34d-4be0-8d8c-a4f1f0ead073 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:20.342383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c8111096-e34d-4be0-8d8c-a4f1f0ead073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:20.356074 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8111096-e34d-4be0-8d8c-a4f1f0ead073 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:20.361918 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:20.362626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:20.363056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:20.363191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] PATH_INFO: `/v3/projects/c6b622f0c0c7424eb2495f52907fa928` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:20.364380 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b622f0c0c7424eb2495f52907fa928)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:20.366422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:20.415862 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b622f0c0c7424eb2495f52907fa928', 'request_id': 'req-73716118-eaa0-4b92-8def-901c843ae7f7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:20.422315 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b622f0c0c7424eb2495f52907fa928', 'request_id': 'req-73716118-eaa0-4b92-8def-901c843ae7f7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:20.427967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b622f0c0c7424eb2495f52907fa928', 'request_id': 'req-73716118-eaa0-4b92-8def-901c843ae7f7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:20.442769 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] The token cache is being invalidate because project c6b622f0c0c7424eb2495f52907fa928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:31:20.443109 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:20.443817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:20.445983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1180/2405] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:31:20 2022] DELETE /identity/v3/projects/c6b622f0c0c7424eb2495f52907fa928 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:20.450342 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b893b6-1f1d-4637-a2a5-76dd5c65b583 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:20.460986 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b893b6-1f1d-4637-a2a5-76dd5c65b583 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:20.521316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27422f4f-4bc9-4743-bbaa-a99b1ac06087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:20.521948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422f4f-4bc9-4743-bbaa-a99b1ac06087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:20.522264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422f4f-4bc9-4743-bbaa-a99b1ac06087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:20.522556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422f4f-4bc9-4743-bbaa-a99b1ac06087 admin admin] PATH_INFO: `/v3/users/554ac7683ae8401c8bff2e1e0ef7cb7e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:20.523682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27422f4f-4bc9-4743-bbaa-a99b1ac06087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=554ac7683ae8401c8bff2e1e0ef7cb7e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:20.525698 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27422f4f-4bc9-4743-bbaa-a99b1ac06087 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:20.580527 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-27422f4f-4bc9-4743-bbaa-a99b1ac06087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554ac7683ae8401c8bff2e1e0ef7cb7e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:20.581571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-27422f4f-4bc9-4743-bbaa-a99b1ac06087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554ac7683ae8401c8bff2e1e0ef7cb7e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:20.594373 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-27422f4f-4bc9-4743-bbaa-a99b1ac06087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554ac7683ae8401c8bff2e1e0ef7cb7e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:20.601135 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-27422f4f-4bc9-4743-bbaa-a99b1ac06087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554ac7683ae8401c8bff2e1e0ef7cb7e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:20.601712 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-27422f4f-4bc9-4743-bbaa-a99b1ac06087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554ac7683ae8401c8bff2e1e0ef7cb7e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:20.614322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1226/2406] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:31:20 2022] DELETE /identity/v3/users/554ac7683ae8401c8bff2e1e0ef7cb7e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:20.900608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:20.902150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:20.916254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73716118-eaa0-4b92-8def-901c843ae7f7 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:20.934988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:20.985292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8481b7-9ceb-4669-a79c-88cd439351c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:20.985936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8481b7-9ceb-4669-a79c-88cd439351c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:20.986219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8481b7-9ceb-4669-a79c-88cd439351c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:20.986488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8481b7-9ceb-4669-a79c-88cd439351c5 admin admin] PATH_INFO: `/v3/projects/20dcafc2120e4f74930462bd289c7aeb` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:20.987779 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8481b7-9ceb-4669-a79c-88cd439351c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20dcafc2120e4f74930462bd289c7aeb)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:20.989907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8481b7-9ceb-4669-a79c-88cd439351c5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:21.044525 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-db8481b7-9ceb-4669-a79c-88cd439351c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20dcafc2120e4f74930462bd289c7aeb', 'request_id': 'req-db8481b7-9ceb-4669-a79c-88cd439351c5'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:21.052122 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-db8481b7-9ceb-4669-a79c-88cd439351c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20dcafc2120e4f74930462bd289c7aeb', 'request_id': 'req-db8481b7-9ceb-4669-a79c-88cd439351c5'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:21.058091 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-db8481b7-9ceb-4669-a79c-88cd439351c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20dcafc2120e4f74930462bd289c7aeb', 'request_id': 'req-db8481b7-9ceb-4669-a79c-88cd439351c5'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:21.070359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-db8481b7-9ceb-4669-a79c-88cd439351c5 admin admin] The token cache is being invalidate because project 20dcafc2120e4f74930462bd289c7aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:31:21.070649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-db8481b7-9ceb-4669-a79c-88cd439351c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:21.071285 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-db8481b7-9ceb-4669-a79c-88cd439351c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:21.073134 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1181/2407] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:31:20 2022] DELETE /identity/v3/projects/20dcafc2120e4f74930462bd289c7aeb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:21.078103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029f292-5a3e-4988-be9f-82eeb2e49bce None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:21.078405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029f292-5a3e-4988-be9f-82eeb2e49bce None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:21.078667 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029f292-5a3e-4988-be9f-82eeb2e49bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:21.099906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4029f292-5a3e-4988-be9f-82eeb2e49bce None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:21.101201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4029f292-5a3e-4988-be9f-82eeb2e49bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:21.122590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:21.165470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1227/2408] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:21.174051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612e064-88aa-4d41-8d63-a3bbba67b386 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:21.174340 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612e064-88aa-4d41-8d63-a3bbba67b386 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:21.174617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612e064-88aa-4d41-8d63-a3bbba67b386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:21.196451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7612e064-88aa-4d41-8d63-a3bbba67b386 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:21.197960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7612e064-88aa-4d41-8d63-a3bbba67b386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:21.206006 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1182/2409] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:21.210945 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029f292-5a3e-4988-be9f-82eeb2e49bce None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:21.224977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029f292-5a3e-4988-be9f-82eeb2e49bce None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:21.230046 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac148e2-3bb1-40d1-9602-0f4767bcb340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:21.230659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac148e2-3bb1-40d1-9602-0f4767bcb340 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:21.230937 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac148e2-3bb1-40d1-9602-0f4767bcb340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:21.231210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac148e2-3bb1-40d1-9602-0f4767bcb340 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:21.231869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac148e2-3bb1-40d1-9602-0f4767bcb340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:31:21.232170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac148e2-3bb1-40d1-9602-0f4767bcb340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:21.233790 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac148e2-3bb1-40d1-9602-0f4767bcb340 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:21.252281 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1228/2410] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:31:21.254282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612e064-88aa-4d41-8d63-a3bbba67b386 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:21.263701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612e064-88aa-4d41-8d63-a3bbba67b386 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:21.268377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd59e31-83b8-449d-89a7-fb79045e1ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:21.270155 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd59e31-83b8-449d-89a7-fb79045e1ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:21.270983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd59e31-83b8-449d-89a7-fb79045e1ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:21.270983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd59e31-83b8-449d-89a7-fb79045e1ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:21.271348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd59e31-83b8-449d-89a7-fb79045e1ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:21.273288 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd59e31-83b8-449d-89a7-fb79045e1ff8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:21.303075 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1183/2411] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:31:21 2022] POST /identity/v3/projects => generated 407 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:21.307607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac148e2-3bb1-40d1-9602-0f4767bcb340 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:21.320050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac148e2-3bb1-40d1-9602-0f4767bcb340 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:21.379153 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e3398-9f9e-4487-99ec-92b938e17f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:21.379765 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e3398-9f9e-4487-99ec-92b938e17f25 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:21.380045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e3398-9f9e-4487-99ec-92b938e17f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:21.380315 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e3398-9f9e-4487-99ec-92b938e17f25 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:21.381004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e3398-9f9e-4487-99ec-92b938e17f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:21.382902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e3398-9f9e-4487-99ec-92b938e17f25 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:21.406816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1229/2412] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:31:21 2022] POST /identity/v3/users => generated 304 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:21.411365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd59e31-83b8-449d-89a7-fb79045e1ff8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:21.422525 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd59e31-83b8-449d-89a7-fb79045e1ff8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:21.427714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031924b8-96b3-4466-bbf5-978987f97802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:21.428473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031924b8-96b3-4466-bbf5-978987f97802 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:21.428787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031924b8-96b3-4466-bbf5-978987f97802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:21.429092 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031924b8-96b3-4466-bbf5-978987f97802 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:21.429742 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031924b8-96b3-4466-bbf5-978987f97802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:21.431382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031924b8-96b3-4466-bbf5-978987f97802 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:21.442701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1184/2413] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:21.448613 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e3398-9f9e-4487-99ec-92b938e17f25 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:21.461547 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e3398-9f9e-4487-99ec-92b938e17f25 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:21.468488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac13c5-9162-4eca-a30b-fce059ded922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:21.469142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac13c5-9162-4eca-a30b-fce059ded922 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:21.469421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac13c5-9162-4eca-a30b-fce059ded922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:21.469691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac13c5-9162-4eca-a30b-fce059ded922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:21.470341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac13c5-9162-4eca-a30b-fce059ded922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:21.471942 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac13c5-9162-4eca-a30b-fce059ded922 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:21.484187 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1230/2414] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:21.488568 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031924b8-96b3-4466-bbf5-978987f97802 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:21.499082 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031924b8-96b3-4466-bbf5-978987f97802 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:21.506134 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e6570-2ab5-4ea7-b1ae-ebaddbbba6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:21.506900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e6570-2ab5-4ea7-b1ae-ebaddbbba6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:21.507254 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e6570-2ab5-4ea7-b1ae-ebaddbbba6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:21.507622 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e6570-2ab5-4ea7-b1ae-ebaddbbba6e2 admin admin] PATH_INFO: `/v3/projects/83827361d2584c6aae10f09acd507f21/users/27fd44bfd884416ab98693dcdff5cf25/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:21.531752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e6570-2ab5-4ea7-b1ae-ebaddbbba6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83827361d2584c6aae10f09acd507f21, user_id=27fd44bfd884416ab98693dcdff5cf25, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:21.535864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e6570-2ab5-4ea7-b1ae-ebaddbbba6e2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:21.551518 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1185/2415] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:21 2022] PUT /identity/v3/projects/83827361d2584c6aae10f09acd507f21/users/27fd44bfd884416ab98693dcdff5cf25/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:31:21.570617 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507cd5a-f2a2-4b97-8f2b-57a3dba2a988 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:21.571029 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507cd5a-f2a2-4b97-8f2b-57a3dba2a988 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:21.571204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507cd5a-f2a2-4b97-8f2b-57a3dba2a988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:21.601801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8507cd5a-f2a2-4b97-8f2b-57a3dba2a988 None None] MFA Rules not processed for user `27fd44bfd884416ab98693dcdff5cf25`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:21.603097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8507cd5a-f2a2-4b97-8f2b-57a3dba2a988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:21.702019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1231/2416] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:21 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:21.707331 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e6570-2ab5-4ea7-b1ae-ebaddbbba6e2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:21.762102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:21.783689 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e6570-2ab5-4ea7-b1ae-ebaddbbba6e2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:21.789880 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227c71e-070a-4a9f-8240-af735c4a3435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:21.790713 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227c71e-070a-4a9f-8240-af735c4a3435 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:21.791095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227c71e-070a-4a9f-8240-af735c4a3435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:21.791454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227c71e-070a-4a9f-8240-af735c4a3435 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:21.792732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227c71e-070a-4a9f-8240-af735c4a3435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:21.794202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227c71e-070a-4a9f-8240-af735c4a3435 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:21.841537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1186/2417] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:31:21 2022] POST /identity/v3/projects => generated 407 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:21.844484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507cd5a-f2a2-4b97-8f2b-57a3dba2a988 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:21.860486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507cd5a-f2a2-4b97-8f2b-57a3dba2a988 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:21.880461 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:21.928107 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be3de2-8770-442c-97e1-91d360cfc8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:21.928746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be3de2-8770-442c-97e1-91d360cfc8ba admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:21.929021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be3de2-8770-442c-97e1-91d360cfc8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:21.929286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be3de2-8770-442c-97e1-91d360cfc8ba admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:21.930055 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be3de2-8770-442c-97e1-91d360cfc8ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:21.931953 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be3de2-8770-442c-97e1-91d360cfc8ba admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:21.957785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1232/2418] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:31:21 2022] POST /identity/v3/users => generated 310 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:21.959270 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227c71e-070a-4a9f-8240-af735c4a3435 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:21.970430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227c71e-070a-4a9f-8240-af735c4a3435 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:21.975991 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e12567-795f-484f-a012-72c89bfc60de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:21.976611 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e12567-795f-484f-a012-72c89bfc60de admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:21.976960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e12567-795f-484f-a012-72c89bfc60de admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:21.977188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e12567-795f-484f-a012-72c89bfc60de admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:21.977814 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e12567-795f-484f-a012-72c89bfc60de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:21.979436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e12567-795f-484f-a012-72c89bfc60de admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:21.990891 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1187/2419] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:31:21.995365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be3de2-8770-442c-97e1-91d360cfc8ba admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:22.005892 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be3de2-8770-442c-97e1-91d360cfc8ba admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:22.010807 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c8e79-a408-4f2e-8d05-81764a110e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:22.011459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8e79-a408-4f2e-8d05-81764a110e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:22.011735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8e79-a408-4f2e-8d05-81764a110e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:22.012010 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8e79-a408-4f2e-8d05-81764a110e28 admin admin] PATH_INFO: `/v3/projects/d8c15f123db74ce5a733c5b751cf379b/users/2413ab1052b845ff84cef205dce7972e/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:22.031684 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c8e79-a408-4f2e-8d05-81764a110e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c15f123db74ce5a733c5b751cf379b, user_id=2413ab1052b845ff84cef205dce7972e, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:22.034721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c8e79-a408-4f2e-8d05-81764a110e28 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:22.057627 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1233/2420] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:21 2022] PUT /identity/v3/projects/d8c15f123db74ce5a733c5b751cf379b/users/2413ab1052b845ff84cef205dce7972e/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:22.061598 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e12567-795f-484f-a012-72c89bfc60de admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:22.072861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e12567-795f-484f-a012-72c89bfc60de admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:22.143710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684215e9-54af-4a79-a920-3058850dfa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:22.145021 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684215e9-54af-4a79-a920-3058850dfa84 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:22.145302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684215e9-54af-4a79-a920-3058850dfa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:22.145573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684215e9-54af-4a79-a920-3058850dfa84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:22.146571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684215e9-54af-4a79-a920-3058850dfa84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:22.147942 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684215e9-54af-4a79-a920-3058850dfa84 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:22.158646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1188/2421] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:22.163611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c8e79-a408-4f2e-8d05-81764a110e28 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:22.176712 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c8e79-a408-4f2e-8d05-81764a110e28 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:22.181513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b999d9d-e324-4225-919a-f2611514895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:22.182190 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b999d9d-e324-4225-919a-f2611514895b admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:22.182465 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b999d9d-e324-4225-919a-f2611514895b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:22.182736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b999d9d-e324-4225-919a-f2611514895b admin admin] PATH_INFO: `/v3/projects/d8c15f123db74ce5a733c5b751cf379b/users/2413ab1052b845ff84cef205dce7972e/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:22.184711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b999d9d-e324-4225-919a-f2611514895b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c15f123db74ce5a733c5b751cf379b, user_id=2413ab1052b845ff84cef205dce7972e, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:22.187339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b999d9d-e324-4225-919a-f2611514895b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:22.198983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1234/2422] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:22 2022] PUT /identity/v3/projects/d8c15f123db74ce5a733c5b751cf379b/users/2413ab1052b845ff84cef205dce7972e/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:31:22.210775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db762f0-045e-422e-a882-aad0c478b767 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:22.211218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db762f0-045e-422e-a882-aad0c478b767 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:22.211506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db762f0-045e-422e-a882-aad0c478b767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:22.240939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8db762f0-045e-422e-a882-aad0c478b767 None None] MFA Rules not processed for user `2413ab1052b845ff84cef205dce7972e`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:22.242166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8db762f0-045e-422e-a882-aad0c478b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:22.311021 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1189/2423] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:22 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:22.322496 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b999d9d-e324-4225-919a-f2611514895b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:22.324185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6b999d9d-e324-4225-919a-f2611514895b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:22.398443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b999d9d-e324-4225-919a-f2611514895b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:22.402631 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5852f18-1bd7-4319-9fc1-e6308d959a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:22.403398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5852f18-1bd7-4319-9fc1-e6308d959a59 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:22.403780 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5852f18-1bd7-4319-9fc1-e6308d959a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:22.404223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5852f18-1bd7-4319-9fc1-e6308d959a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:22.417876 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5852f18-1bd7-4319-9fc1-e6308d959a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:22.420633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5852f18-1bd7-4319-9fc1-e6308d959a59 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:22.432896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1235/2424] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:22 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:22.618155 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db762f0-045e-422e-a882-aad0c478b767 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:22.628301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db762f0-045e-422e-a882-aad0c478b767 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:22.632677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8782485-fa63-41e2-b30c-f48b6bbe8af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:22.633400 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8782485-fa63-41e2-b30c-f48b6bbe8af3 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:22.633676 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8782485-fa63-41e2-b30c-f48b6bbe8af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:22.633947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8782485-fa63-41e2-b30c-f48b6bbe8af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:22.687395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:22.707102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8782485-fa63-41e2-b30c-f48b6bbe8af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:22.708552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8782485-fa63-41e2-b30c-f48b6bbe8af3 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:22.718362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1190/2425] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:22 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:25.209948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ea7bc-2ef8-48ba-91e3-a3360540a79c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:25.210543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ea7bc-2ef8-48ba-91e3-a3360540a79c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:25.210543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ea7bc-2ef8-48ba-91e3-a3360540a79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:25.230317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2a1ea7bc-2ef8-48ba-91e3-a3360540a79c None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:25.231518 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2a1ea7bc-2ef8-48ba-91e3-a3360540a79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:25.293873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1236/2426] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:31:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:25.343460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8782485-fa63-41e2-b30c-f48b6bbe8af3 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:25.344936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b8782485-fa63-41e2-b30c-f48b6bbe8af3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:25.421959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8782485-fa63-41e2-b30c-f48b6bbe8af3 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:25.427742 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0738352-f264-4427-bbe0-4761381cb749 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:25.428359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738352-f264-4427-bbe0-4761381cb749 service swift] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:25.428640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738352-f264-4427-bbe0-4761381cb749 service swift] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:25.428947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738352-f264-4427-bbe0-4761381cb749 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:25.438207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0738352-f264-4427-bbe0-4761381cb749 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:25.439802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0738352-f264-4427-bbe0-4761381cb749 service swift] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:25.449636 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1191/2427] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:31:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:31:28.346299 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ea7bc-2ef8-48ba-91e3-a3360540a79c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:28.372089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:28.443857 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ea7bc-2ef8-48ba-91e3-a3360540a79c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:28.455016 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5532e0-8f74-462e-8ca6-508153892610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:28.455764 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5532e0-8f74-462e-8ca6-508153892610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:28.456046 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5532e0-8f74-462e-8ca6-508153892610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:28.456388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5532e0-8f74-462e-8ca6-508153892610 admin admin] PATH_INFO: `/v3/users/27fd44bfd884416ab98693dcdff5cf25` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:28.458771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5532e0-8f74-462e-8ca6-508153892610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27fd44bfd884416ab98693dcdff5cf25)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:28.461460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5532e0-8f74-462e-8ca6-508153892610 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:28.548016 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa5532e0-8f74-462e-8ca6-508153892610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27fd44bfd884416ab98693dcdff5cf25'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:28.550813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa5532e0-8f74-462e-8ca6-508153892610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27fd44bfd884416ab98693dcdff5cf25'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:28.585630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa5532e0-8f74-462e-8ca6-508153892610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27fd44bfd884416ab98693dcdff5cf25'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:28.595437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa5532e0-8f74-462e-8ca6-508153892610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27fd44bfd884416ab98693dcdff5cf25'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:28.596621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa5532e0-8f74-462e-8ca6-508153892610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27fd44bfd884416ab98693dcdff5cf25'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:28.618423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1237/2428] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:31:28 2022] DELETE /identity/v3/users/27fd44bfd884416ab98693dcdff5cf25 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:28.623203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787a02b-57ee-4232-ad30-327b9d733cca None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:28.624232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787a02b-57ee-4232-ad30-327b9d733cca None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:28.624721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787a02b-57ee-4232-ad30-327b9d733cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:28.654897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-4787a02b-57ee-4232-ad30-327b9d733cca None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:28.656949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4787a02b-57ee-4232-ad30-327b9d733cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:28.764509 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1192/2429] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:28.775756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5532e0-8f74-462e-8ca6-508153892610 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:28.777781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fa5532e0-8f74-462e-8ca6-508153892610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:28.845363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5532e0-8f74-462e-8ca6-508153892610 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:28.850993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435078f0-e4d3-4318-87f9-5177414f6ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:28.851691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435078f0-e4d3-4318-87f9-5177414f6ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:28.852040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435078f0-e4d3-4318-87f9-5177414f6ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:28.852381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435078f0-e4d3-4318-87f9-5177414f6ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:28.862835 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435078f0-e4d3-4318-87f9-5177414f6ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:28.864521 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435078f0-e4d3-4318-87f9-5177414f6ba7 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:28.877696 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1238/2430] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:29.204971 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787a02b-57ee-4232-ad30-327b9d733cca None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:29.207524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4787a02b-57ee-4232-ad30-327b9d733cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:29.223452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787a02b-57ee-4232-ad30-327b9d733cca None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:29.228634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:29.229731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:29.230030 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:29.230348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] PATH_INFO: `/v3/projects/83827361d2584c6aae10f09acd507f21` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:29.231454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83827361d2584c6aae10f09acd507f21)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:29.233452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:29.338421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83827361d2584c6aae10f09acd507f21', 'request_id': 'req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:29.349346 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83827361d2584c6aae10f09acd507f21', 'request_id': 'req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:29.355862 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83827361d2584c6aae10f09acd507f21', 'request_id': 'req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:29.360863 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:29.375656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] The token cache is being invalidate because project 83827361d2584c6aae10f09acd507f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:31:29.376014 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:29.377157 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:29.381511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1193/2431] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:31:29 2022] DELETE /identity/v3/projects/83827361d2584c6aae10f09acd507f21 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:29.385873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435078f0-e4d3-4318-87f9-5177414f6ba7 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:29.398885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435078f0-e4d3-4318-87f9-5177414f6ba7 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:29.464269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:29.501167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecebe6-5454-4a1f-8f4e-bc5e6ac4985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:29.501898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecebe6-5454-4a1f-8f4e-bc5e6ac4985c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:29.502500 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecebe6-5454-4a1f-8f4e-bc5e6ac4985c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:29.502890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecebe6-5454-4a1f-8f4e-bc5e6ac4985c admin admin] PATH_INFO: `/v3/users/2413ab1052b845ff84cef205dce7972e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:29.505554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecebe6-5454-4a1f-8f4e-bc5e6ac4985c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2413ab1052b845ff84cef205dce7972e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:29.507753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecebe6-5454-4a1f-8f4e-bc5e6ac4985c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:29.577957 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9ecebe6-5454-4a1f-8f4e-bc5e6ac4985c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2413ab1052b845ff84cef205dce7972e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:29.578892 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9ecebe6-5454-4a1f-8f4e-bc5e6ac4985c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2413ab1052b845ff84cef205dce7972e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:29.620792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9ecebe6-5454-4a1f-8f4e-bc5e6ac4985c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2413ab1052b845ff84cef205dce7972e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:29.633143 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9ecebe6-5454-4a1f-8f4e-bc5e6ac4985c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2413ab1052b845ff84cef205dce7972e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:29.634466 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9ecebe6-5454-4a1f-8f4e-bc5e6ac4985c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2413ab1052b845ff84cef205dce7972e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:29.658667 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1239/2432] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:31:29 2022] DELETE /identity/v3/users/2413ab1052b845ff84cef205dce7972e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:30.066313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:30.068432 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:30.095207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db5453-6a4d-4a2a-b31a-7f38e1c92b87 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:30.174117 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c20c98-e86f-4662-92a9-9dc89f9233b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:30.175162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c20c98-e86f-4662-92a9-9dc89f9233b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:30.176916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c20c98-e86f-4662-92a9-9dc89f9233b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:30.177761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c20c98-e86f-4662-92a9-9dc89f9233b4 admin admin] PATH_INFO: `/v3/projects/d8c15f123db74ce5a733c5b751cf379b` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:30.179067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c20c98-e86f-4662-92a9-9dc89f9233b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c15f123db74ce5a733c5b751cf379b)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:30.181754 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c20c98-e86f-4662-92a9-9dc89f9233b4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:30.248594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b6c20c98-e86f-4662-92a9-9dc89f9233b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c15f123db74ce5a733c5b751cf379b', 'request_id': 'req-b6c20c98-e86f-4662-92a9-9dc89f9233b4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:30.257323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b6c20c98-e86f-4662-92a9-9dc89f9233b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c15f123db74ce5a733c5b751cf379b', 'request_id': 'req-b6c20c98-e86f-4662-92a9-9dc89f9233b4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:30.265743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b6c20c98-e86f-4662-92a9-9dc89f9233b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c15f123db74ce5a733c5b751cf379b', 'request_id': 'req-b6c20c98-e86f-4662-92a9-9dc89f9233b4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:30.285943 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b6c20c98-e86f-4662-92a9-9dc89f9233b4 admin admin] The token cache is being invalidate because project d8c15f123db74ce5a733c5b751cf379b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:31:30.286365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b6c20c98-e86f-4662-92a9-9dc89f9233b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:30.287081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b6c20c98-e86f-4662-92a9-9dc89f9233b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:30.288620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1194/2433] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:31:30 2022] DELETE /identity/v3/projects/d8c15f123db74ce5a733c5b751cf379b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:30.293610 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802eaee3-b77f-4321-8961-94a4f7083b6a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:30.293961 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802eaee3-b77f-4321-8961-94a4f7083b6a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:30.294320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802eaee3-b77f-4321-8961-94a4f7083b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:30.316968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-802eaee3-b77f-4321-8961-94a4f7083b6a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:30.318611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-802eaee3-b77f-4321-8961-94a4f7083b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:30.389116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1240/2434] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:30.397670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0023e2b-9f65-46c5-a99d-adbe1b651096 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:30.397979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0023e2b-9f65-46c5-a99d-adbe1b651096 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:30.398250 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0023e2b-9f65-46c5-a99d-adbe1b651096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:30.418168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e0023e2b-9f65-46c5-a99d-adbe1b651096 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:30.419403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e0023e2b-9f65-46c5-a99d-adbe1b651096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:30.427909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1195/2435] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:30.432188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802eaee3-b77f-4321-8961-94a4f7083b6a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:30.442746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802eaee3-b77f-4321-8961-94a4f7083b6a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:30.452616 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd3837-9cf1-4dfa-85f2-f68d1813f2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:30.458437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd3837-9cf1-4dfa-85f2-f68d1813f2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:30.458437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd3837-9cf1-4dfa-85f2-f68d1813f2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:30.458437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd3837-9cf1-4dfa-85f2-f68d1813f2c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:30.458437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd3837-9cf1-4dfa-85f2-f68d1813f2c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:31:30.458437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd3837-9cf1-4dfa-85f2-f68d1813f2c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:30.460140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd3837-9cf1-4dfa-85f2-f68d1813f2c0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:30.478433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1241/2436] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:31:30.480210 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0023e2b-9f65-46c5-a99d-adbe1b651096 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:30.490246 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0023e2b-9f65-46c5-a99d-adbe1b651096 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:30.495944 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28f989-92e4-4ade-942c-73ba2b7f40c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:30.496629 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28f989-92e4-4ade-942c-73ba2b7f40c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:30.496933 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28f989-92e4-4ade-942c-73ba2b7f40c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:30.497199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28f989-92e4-4ade-942c-73ba2b7f40c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:30.497903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28f989-92e4-4ade-942c-73ba2b7f40c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:30.500202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28f989-92e4-4ade-942c-73ba2b7f40c2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:30.543801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1196/2437] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:31:30 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:30.547994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd3837-9cf1-4dfa-85f2-f68d1813f2c0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:30.562346 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd3837-9cf1-4dfa-85f2-f68d1813f2c0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:30.611557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:30.632269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b089c7-d4ca-4260-805a-59830d734699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:30.633050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b089c7-d4ca-4260-805a-59830d734699 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:30.633399 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b089c7-d4ca-4260-805a-59830d734699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:30.634003 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b089c7-d4ca-4260-805a-59830d734699 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:30.634754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b089c7-d4ca-4260-805a-59830d734699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:30.636870 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b089c7-d4ca-4260-805a-59830d734699 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:30.663728 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1242/2438] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:31:30 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:30.665069 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28f989-92e4-4ade-942c-73ba2b7f40c2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:30.676156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28f989-92e4-4ade-942c-73ba2b7f40c2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:30.681703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc6709-4b6f-4c56-9e87-f8d56207191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:30.682419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc6709-4b6f-4c56-9e87-f8d56207191a admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:30.682848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc6709-4b6f-4c56-9e87-f8d56207191a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:30.683048 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc6709-4b6f-4c56-9e87-f8d56207191a admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:30.683768 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc6709-4b6f-4c56-9e87-f8d56207191a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:30.685494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc6709-4b6f-4c56-9e87-f8d56207191a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:30.697924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1197/2439] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:30.701969 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b089c7-d4ca-4260-805a-59830d734699 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:30.716142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b089c7-d4ca-4260-805a-59830d734699 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:30.721784 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bc89f-7487-424c-bb00-a92888704686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:30.723232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bc89f-7487-424c-bb00-a92888704686 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:30.723232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bc89f-7487-424c-bb00-a92888704686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:30.723232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bc89f-7487-424c-bb00-a92888704686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:30.723853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bc89f-7487-424c-bb00-a92888704686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:30.726657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bc89f-7487-424c-bb00-a92888704686 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:30.739703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1243/2440] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:31:30.744273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc6709-4b6f-4c56-9e87-f8d56207191a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:30.757097 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc6709-4b6f-4c56-9e87-f8d56207191a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:30.762222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3249-5861-43a0-b377-874a334385bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:30.763146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3249-5861-43a0-b377-874a334385bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:30.763438 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3249-5861-43a0-b377-874a334385bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:30.763710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3249-5861-43a0-b377-874a334385bd admin admin] PATH_INFO: `/v3/projects/0df84f89fef343308da8400246b22a9b/users/01b7616f8e4040eba4e397acd5d4a1e3/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:30.781155 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc3249-5861-43a0-b377-874a334385bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df84f89fef343308da8400246b22a9b, user_id=01b7616f8e4040eba4e397acd5d4a1e3, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:30.783959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc3249-5861-43a0-b377-874a334385bd admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:30.799012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1198/2441] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:30 2022] PUT /identity/v3/projects/0df84f89fef343308da8400246b22a9b/users/01b7616f8e4040eba4e397acd5d4a1e3/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:30.812733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd71e1f-9d4e-4918-b5a9-1acc8f14050c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:30.813125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd71e1f-9d4e-4918-b5a9-1acc8f14050c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:30.813434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd71e1f-9d4e-4918-b5a9-1acc8f14050c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:30.856607 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8bd71e1f-9d4e-4918-b5a9-1acc8f14050c None None] MFA Rules not processed for user `01b7616f8e4040eba4e397acd5d4a1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:30.857866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8bd71e1f-9d4e-4918-b5a9-1acc8f14050c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:30.964739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1244/2442] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:30.969116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3249-5861-43a0-b377-874a334385bd admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:31.014097 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:31.120596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3249-5861-43a0-b377-874a334385bd admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:31.129253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529458f-896a-48f9-bde6-c16068e0708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:31.130420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529458f-896a-48f9-bde6-c16068e0708a admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:31.131007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529458f-896a-48f9-bde6-c16068e0708a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:31.131592 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529458f-896a-48f9-bde6-c16068e0708a admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:31.132584 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529458f-896a-48f9-bde6-c16068e0708a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:31.134984 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529458f-896a-48f9-bde6-c16068e0708a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:31.176930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1199/2443] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:31:30 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:31.189950 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd71e1f-9d4e-4918-b5a9-1acc8f14050c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:31.206225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd71e1f-9d4e-4918-b5a9-1acc8f14050c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:31.310981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad3a4a-746c-40d0-b785-7b4ed51f5c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:31.312308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad3a4a-746c-40d0-b785-7b4ed51f5c20 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:31.312756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad3a4a-746c-40d0-b785-7b4ed51f5c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:31.313274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad3a4a-746c-40d0-b785-7b4ed51f5c20 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:31.314293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad3a4a-746c-40d0-b785-7b4ed51f5c20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:31.318419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad3a4a-746c-40d0-b785-7b4ed51f5c20 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:31.367110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1245/2444] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:31:31 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:31.371260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529458f-896a-48f9-bde6-c16068e0708a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:31.389778 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529458f-896a-48f9-bde6-c16068e0708a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:31.401608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0cece-569f-403d-8267-659433f0e448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:31.402239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0cece-569f-403d-8267-659433f0e448 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:31.402519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0cece-569f-403d-8267-659433f0e448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:31.402843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0cece-569f-403d-8267-659433f0e448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:31.403498 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0cece-569f-403d-8267-659433f0e448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:31.405218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0cece-569f-403d-8267-659433f0e448 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:31.420817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1200/2445] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:31.421819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad3a4a-746c-40d0-b785-7b4ed51f5c20 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:31.436773 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad3a4a-746c-40d0-b785-7b4ed51f5c20 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:31.443579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb8cf5-5fb0-4b0a-bec8-7e1757f7af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:31.444623 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb8cf5-5fb0-4b0a-bec8-7e1757f7af23 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:31.445081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb8cf5-5fb0-4b0a-bec8-7e1757f7af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:31.445424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb8cf5-5fb0-4b0a-bec8-7e1757f7af23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:31.446156 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb8cf5-5fb0-4b0a-bec8-7e1757f7af23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:31.448198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb8cf5-5fb0-4b0a-bec8-7e1757f7af23 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:31.460962 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1246/2446] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:31.464860 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0cece-569f-403d-8267-659433f0e448 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:31.475852 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0cece-569f-403d-8267-659433f0e448 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:31.487686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ae91e-289b-4430-a8ca-636866c21389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:31.487686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ae91e-289b-4430-a8ca-636866c21389 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:31.487686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ae91e-289b-4430-a8ca-636866c21389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:31.487686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ae91e-289b-4430-a8ca-636866c21389 admin admin] PATH_INFO: `/v3/projects/d61fd301563548019553f63abfed2da2/users/40b4304c999541b68f1f3f95e1d14851/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:31.509302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ae91e-289b-4430-a8ca-636866c21389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61fd301563548019553f63abfed2da2, user_id=40b4304c999541b68f1f3f95e1d14851, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:31.512262 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ae91e-289b-4430-a8ca-636866c21389 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:31.534123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1201/2447] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:31 2022] PUT /identity/v3/projects/d61fd301563548019553f63abfed2da2/users/40b4304c999541b68f1f3f95e1d14851/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:31.547867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03ed56-9c52-4ee8-b070-0310acf26c63 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:31.548145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03ed56-9c52-4ee8-b070-0310acf26c63 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:31.548464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03ed56-9c52-4ee8-b070-0310acf26c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:31.582974 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7d03ed56-9c52-4ee8-b070-0310acf26c63 None None] MFA Rules not processed for user `40b4304c999541b68f1f3f95e1d14851`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:31.584117 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7d03ed56-9c52-4ee8-b070-0310acf26c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:31.605572 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:31.681551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1247/2448] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:31.687037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ae91e-289b-4430-a8ca-636866c21389 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:31.773031 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ae91e-289b-4430-a8ca-636866c21389 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:31.778768 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8f8d3-d2db-4736-83bb-c800d801232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:31.779493 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8f8d3-d2db-4736-83bb-c800d801232e admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:31.779774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8f8d3-d2db-4736-83bb-c800d801232e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:31.780133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8f8d3-d2db-4736-83bb-c800d801232e admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:31.781226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8f8d3-d2db-4736-83bb-c800d801232e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:31.783099 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8f8d3-d2db-4736-83bb-c800d801232e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:31.819317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1202/2449] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:31:31 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:31:31.824097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03ed56-9c52-4ee8-b070-0310acf26c63 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:31.837339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03ed56-9c52-4ee8-b070-0310acf26c63 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:31.907402 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d044-7f10-417d-a84e-12d5da7569cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:31.908025 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d044-7f10-417d-a84e-12d5da7569cb admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:31.908306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d044-7f10-417d-a84e-12d5da7569cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:31.908585 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d044-7f10-417d-a84e-12d5da7569cb admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:31.909254 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437d044-7f10-417d-a84e-12d5da7569cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:31.911303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437d044-7f10-417d-a84e-12d5da7569cb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:31.935128 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1248/2450] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:31:31 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:31:31.939313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8f8d3-d2db-4736-83bb-c800d801232e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:31.951079 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8f8d3-d2db-4736-83bb-c800d801232e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:31.956289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274dd7a-5572-44cc-a492-308d0eb5bb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:31.957803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274dd7a-5572-44cc-a492-308d0eb5bb5a admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:31.958097 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274dd7a-5572-44cc-a492-308d0eb5bb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:31.958373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274dd7a-5572-44cc-a492-308d0eb5bb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:31.959039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274dd7a-5572-44cc-a492-308d0eb5bb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:31.960897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274dd7a-5572-44cc-a492-308d0eb5bb5a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:31.974396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1203/2451] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:31.978986 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d044-7f10-417d-a84e-12d5da7569cb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:31.991446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d044-7f10-417d-a84e-12d5da7569cb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:31.997675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54c227-5f75-4788-b0e3-8901885cde12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:31.998366 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54c227-5f75-4788-b0e3-8901885cde12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:31.998645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54c227-5f75-4788-b0e3-8901885cde12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:31.998916 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54c227-5f75-4788-b0e3-8901885cde12 admin admin] PATH_INFO: `/v3/projects/4bf40f6c3b6e4256b5d2a64da99ea6c1/users/9a7866ecbf1b43b780684030d4029666/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:32.023744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54c227-5f75-4788-b0e3-8901885cde12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf40f6c3b6e4256b5d2a64da99ea6c1, user_id=9a7866ecbf1b43b780684030d4029666, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:32.029271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54c227-5f75-4788-b0e3-8901885cde12 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:32.049083 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1249/2452] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:31 2022] PUT /identity/v3/projects/4bf40f6c3b6e4256b5d2a64da99ea6c1/users/9a7866ecbf1b43b780684030d4029666/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:32.053575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274dd7a-5572-44cc-a492-308d0eb5bb5a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:32.064387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274dd7a-5572-44cc-a492-308d0eb5bb5a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:32.117695 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:32.141936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe315d-0286-4ebe-adcc-e8f3c18425a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:32.143580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe315d-0286-4ebe-adcc-e8f3c18425a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:32.143891 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe315d-0286-4ebe-adcc-e8f3c18425a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:32.144167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe315d-0286-4ebe-adcc-e8f3c18425a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:32.145016 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe315d-0286-4ebe-adcc-e8f3c18425a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:32.146540 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe315d-0286-4ebe-adcc-e8f3c18425a1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:32.158527 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1204/2453] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:32.162789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54c227-5f75-4788-b0e3-8901885cde12 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:32.176341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54c227-5f75-4788-b0e3-8901885cde12 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:32.181606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ebba0-96d6-42c4-af83-b8415a4d47f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:32.182391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ebba0-96d6-42c4-af83-b8415a4d47f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:32.182744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ebba0-96d6-42c4-af83-b8415a4d47f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:32.183093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ebba0-96d6-42c4-af83-b8415a4d47f0 admin admin] PATH_INFO: `/v3/projects/4bf40f6c3b6e4256b5d2a64da99ea6c1/users/9a7866ecbf1b43b780684030d4029666/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:32.185428 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ebba0-96d6-42c4-af83-b8415a4d47f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf40f6c3b6e4256b5d2a64da99ea6c1, user_id=9a7866ecbf1b43b780684030d4029666, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:32.188363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ebba0-96d6-42c4-af83-b8415a4d47f0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:32.201409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1250/2454] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:32 2022] PUT /identity/v3/projects/4bf40f6c3b6e4256b5d2a64da99ea6c1/users/9a7866ecbf1b43b780684030d4029666/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:32.212907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36003b-c7f5-4755-b571-3bd81737d516 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:32.213265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36003b-c7f5-4755-b571-3bd81737d516 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:32.213549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36003b-c7f5-4755-b571-3bd81737d516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:32.249769 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5a36003b-c7f5-4755-b571-3bd81737d516 None None] MFA Rules not processed for user `9a7866ecbf1b43b780684030d4029666`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:32.251034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5a36003b-c7f5-4755-b571-3bd81737d516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:32.364787 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1205/2455] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:32.370420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ebba0-96d6-42c4-af83-b8415a4d47f0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:32.372232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-816ebba0-96d6-42c4-af83-b8415a4d47f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:32.476918 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ebba0-96d6-42c4-af83-b8415a4d47f0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:32.481389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77561bf4-e9cc-4b76-99c0-df36f3259d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:32.482009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77561bf4-e9cc-4b76-99c0-df36f3259d3e service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:32.482290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77561bf4-e9cc-4b76-99c0-df36f3259d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:32.482563 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77561bf4-e9cc-4b76-99c0-df36f3259d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:32.521442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:32.565191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77561bf4-e9cc-4b76-99c0-df36f3259d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:32.567536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77561bf4-e9cc-4b76-99c0-df36f3259d3e service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:32.584705 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1251/2456] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:34.275580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36003b-c7f5-4755-b571-3bd81737d516 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:34.278858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5a36003b-c7f5-4755-b571-3bd81737d516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:34.292582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36003b-c7f5-4755-b571-3bd81737d516 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:34.297407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb287608-2670-43a8-83c3-b5232f00b559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:34.298027 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287608-2670-43a8-83c3-b5232f00b559 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:34.298306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287608-2670-43a8-83c3-b5232f00b559 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:34.298571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287608-2670-43a8-83c3-b5232f00b559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:34.364130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb287608-2670-43a8-83c3-b5232f00b559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:34.365649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb287608-2670-43a8-83c3-b5232f00b559 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:34.375640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1206/2457] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:31:35.175066 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77561bf4-e9cc-4b76-99c0-df36f3259d3e service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:35.184651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77561bf4-e9cc-4b76-99c0-df36f3259d3e service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:35.188747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da76e0-6f20-46ff-a2e5-2917932ffc88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:35.189483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da76e0-6f20-46ff-a2e5-2917932ffc88 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:35.189865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da76e0-6f20-46ff-a2e5-2917932ffc88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:35.190239 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da76e0-6f20-46ff-a2e5-2917932ffc88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:35.201088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da76e0-6f20-46ff-a2e5-2917932ffc88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:35.202653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da76e0-6f20-46ff-a2e5-2917932ffc88 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:35.214855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1252/2458] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:39.248589 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb287608-2670-43a8-83c3-b5232f00b559 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:39.313100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb287608-2670-43a8-83c3-b5232f00b559 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:39.317669 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965ffa7-6376-4b34-ba72-3bd5e247b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:39.318292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ffa7-6376-4b34-ba72-3bd5e247b57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:39.318574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ffa7-6376-4b34-ba72-3bd5e247b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:39.318846 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ffa7-6376-4b34-ba72-3bd5e247b57a admin admin] PATH_INFO: `/v3/users/01b7616f8e4040eba4e397acd5d4a1e3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:39.319962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965ffa7-6376-4b34-ba72-3bd5e247b57a admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b7616f8e4040eba4e397acd5d4a1e3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:39.322209 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965ffa7-6376-4b34-ba72-3bd5e247b57a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:39.326812 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:39.373726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5965ffa7-6376-4b34-ba72-3bd5e247b57a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b7616f8e4040eba4e397acd5d4a1e3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:39.374383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5965ffa7-6376-4b34-ba72-3bd5e247b57a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b7616f8e4040eba4e397acd5d4a1e3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:39.374985 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5965ffa7-6376-4b34-ba72-3bd5e247b57a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b7616f8e4040eba4e397acd5d4a1e3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:39.382925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5965ffa7-6376-4b34-ba72-3bd5e247b57a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b7616f8e4040eba4e397acd5d4a1e3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:39.397211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5965ffa7-6376-4b34-ba72-3bd5e247b57a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b7616f8e4040eba4e397acd5d4a1e3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:39.410456 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1207/2459] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:31:39 2022] DELETE /identity/v3/users/01b7616f8e4040eba4e397acd5d4a1e3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:39.415293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb66f70-8fd4-451e-9ace-fb99d3e7e866 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:39.415781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb66f70-8fd4-451e-9ace-fb99d3e7e866 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:39.415901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb66f70-8fd4-451e-9ace-fb99d3e7e866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:39.437052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cbb66f70-8fd4-451e-9ace-fb99d3e7e866 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:39.438286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cbb66f70-8fd4-451e-9ace-fb99d3e7e866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:39.502915 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1253/2460] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:39.514937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965ffa7-6376-4b34-ba72-3bd5e247b57a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:39.516370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5965ffa7-6376-4b34-ba72-3bd5e247b57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:39.580217 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965ffa7-6376-4b34-ba72-3bd5e247b57a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:39.585480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ba4de-63e2-4448-8cee-9a8a7df845ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:39.586454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ba4de-63e2-4448-8cee-9a8a7df845ca service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:39.586887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ba4de-63e2-4448-8cee-9a8a7df845ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:39.587338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ba4de-63e2-4448-8cee-9a8a7df845ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:39.597730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ba4de-63e2-4448-8cee-9a8a7df845ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:39.599173 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ba4de-63e2-4448-8cee-9a8a7df845ca service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:39.609401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1208/2461] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:39.977763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb66f70-8fd4-451e-9ace-fb99d3e7e866 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:39.979294 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cbb66f70-8fd4-451e-9ace-fb99d3e7e866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:39.993178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb66f70-8fd4-451e-9ace-fb99d3e7e866 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:39.997906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:39.998552 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:39.998826 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:39.999095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] PATH_INFO: `/v3/projects/0df84f89fef343308da8400246b22a9b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:40.000228 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df84f89fef343308da8400246b22a9b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:40.002179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:40.055833 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df84f89fef343308da8400246b22a9b', 'request_id': 'req-72fb8189-9c02-4b39-aa0f-bf308647a279'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.061799 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df84f89fef343308da8400246b22a9b', 'request_id': 'req-72fb8189-9c02-4b39-aa0f-bf308647a279'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.069677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df84f89fef343308da8400246b22a9b', 'request_id': 'req-72fb8189-9c02-4b39-aa0f-bf308647a279'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.082468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] The token cache is being invalidate because project 0df84f89fef343308da8400246b22a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:31:40.082758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.083424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.085188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1254/2462] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:31:39 2022] DELETE /identity/v3/projects/0df84f89fef343308da8400246b22a9b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:40.089057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ba4de-63e2-4448-8cee-9a8a7df845ca service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:40.099217 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ba4de-63e2-4448-8cee-9a8a7df845ca service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:40.158538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030650b-6ea6-4e52-b6ff-ed792d8f75c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:40.159102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030650b-6ea6-4e52-b6ff-ed792d8f75c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:40.159400 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030650b-6ea6-4e52-b6ff-ed792d8f75c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:40.159655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030650b-6ea6-4e52-b6ff-ed792d8f75c4 admin admin] PATH_INFO: `/v3/users/40b4304c999541b68f1f3f95e1d14851` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:40.160869 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030650b-6ea6-4e52-b6ff-ed792d8f75c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b4304c999541b68f1f3f95e1d14851)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:40.162907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030650b-6ea6-4e52-b6ff-ed792d8f75c4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:40.194463 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:40.219251 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1030650b-6ea6-4e52-b6ff-ed792d8f75c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b4304c999541b68f1f3f95e1d14851'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.219914 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1030650b-6ea6-4e52-b6ff-ed792d8f75c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b4304c999541b68f1f3f95e1d14851'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.220823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1030650b-6ea6-4e52-b6ff-ed792d8f75c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b4304c999541b68f1f3f95e1d14851'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.227938 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1030650b-6ea6-4e52-b6ff-ed792d8f75c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b4304c999541b68f1f3f95e1d14851'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.241417 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1030650b-6ea6-4e52-b6ff-ed792d8f75c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b4304c999541b68f1f3f95e1d14851'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.256969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1209/2463] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:31:40 2022] DELETE /identity/v3/users/40b4304c999541b68f1f3f95e1d14851 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:40.558917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:40.560568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:40.584380 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb8189-9c02-4b39-aa0f-bf308647a279 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:40.626319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:40.656220 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:40.657159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:40.657507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:40.657956 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] PATH_INFO: `/v3/projects/d61fd301563548019553f63abfed2da2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:40.659333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61fd301563548019553f63abfed2da2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:40.662274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:40.716183 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61fd301563548019553f63abfed2da2', 'request_id': 'req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.722820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61fd301563548019553f63abfed2da2', 'request_id': 'req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.732340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61fd301563548019553f63abfed2da2', 'request_id': 'req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.746456 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] The token cache is being invalidate because project d61fd301563548019553f63abfed2da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:31:40.746744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.747455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.749125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1255/2464] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:31:40 2022] DELETE /identity/v3/projects/d61fd301563548019553f63abfed2da2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:40.754313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030650b-6ea6-4e52-b6ff-ed792d8f75c4 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:40.755897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1030650b-6ea6-4e52-b6ff-ed792d8f75c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:40.770115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030650b-6ea6-4e52-b6ff-ed792d8f75c4 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:40.837794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79a6b4-2475-46a5-ad47-64f0190a4492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:40.838436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79a6b4-2475-46a5-ad47-64f0190a4492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:40.838707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79a6b4-2475-46a5-ad47-64f0190a4492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:40.838975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79a6b4-2475-46a5-ad47-64f0190a4492 admin admin] PATH_INFO: `/v3/users/9a7866ecbf1b43b780684030d4029666` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:40.840133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79a6b4-2475-46a5-ad47-64f0190a4492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a7866ecbf1b43b780684030d4029666)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:40.842105 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79a6b4-2475-46a5-ad47-64f0190a4492 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:40.894760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0a79a6b4-2475-46a5-ad47-64f0190a4492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a7866ecbf1b43b780684030d4029666'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.896825 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0a79a6b4-2475-46a5-ad47-64f0190a4492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a7866ecbf1b43b780684030d4029666'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.897482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0a79a6b4-2475-46a5-ad47-64f0190a4492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a7866ecbf1b43b780684030d4029666'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.905558 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0a79a6b4-2475-46a5-ad47-64f0190a4492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a7866ecbf1b43b780684030d4029666'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.926383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0a79a6b4-2475-46a5-ad47-64f0190a4492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a7866ecbf1b43b780684030d4029666'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:40.949596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1210/2465] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:31:40 2022] DELETE /identity/v3/users/9a7866ecbf1b43b780684030d4029666 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:41.289137 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:41.291661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:41.311470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97b3d5-2510-4a6e-aa2b-7c3280e2ea33 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:41.391733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d2c22-21b6-4e43-9bd8-19c2bef6408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:41.392521 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d2c22-21b6-4e43-9bd8-19c2bef6408d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:41.392869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d2c22-21b6-4e43-9bd8-19c2bef6408d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:41.393206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d2c22-21b6-4e43-9bd8-19c2bef6408d admin admin] PATH_INFO: `/v3/projects/4bf40f6c3b6e4256b5d2a64da99ea6c1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:41.394543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d2c22-21b6-4e43-9bd8-19c2bef6408d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf40f6c3b6e4256b5d2a64da99ea6c1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:41.396931 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d2c22-21b6-4e43-9bd8-19c2bef6408d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:41.464402 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-931d2c22-21b6-4e43-9bd8-19c2bef6408d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf40f6c3b6e4256b5d2a64da99ea6c1', 'request_id': 'req-931d2c22-21b6-4e43-9bd8-19c2bef6408d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:41.470760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-931d2c22-21b6-4e43-9bd8-19c2bef6408d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf40f6c3b6e4256b5d2a64da99ea6c1', 'request_id': 'req-931d2c22-21b6-4e43-9bd8-19c2bef6408d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:41.480680 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-931d2c22-21b6-4e43-9bd8-19c2bef6408d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf40f6c3b6e4256b5d2a64da99ea6c1', 'request_id': 'req-931d2c22-21b6-4e43-9bd8-19c2bef6408d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:41.490673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:41.497876 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-931d2c22-21b6-4e43-9bd8-19c2bef6408d admin admin] The token cache is being invalidate because project 4bf40f6c3b6e4256b5d2a64da99ea6c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:31:41.498581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-931d2c22-21b6-4e43-9bd8-19c2bef6408d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:41.499335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-931d2c22-21b6-4e43-9bd8-19c2bef6408d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:31:41.508178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1256/2466] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:31:41 2022] DELETE /identity/v3/projects/4bf40f6c3b6e4256b5d2a64da99ea6c1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:41.510925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e08c22-811a-4184-a9b9-39e2e9582778 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:41.511461 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e08c22-811a-4184-a9b9-39e2e9582778 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:41.511712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e08c22-811a-4184-a9b9-39e2e9582778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:41.532608 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-11e08c22-811a-4184-a9b9-39e2e9582778 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:41.534026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-11e08c22-811a-4184-a9b9-39e2e9582778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:41.554675 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:41.613356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1211/2467] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:41.621310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d3b7-5786-4d85-befa-6485360a5e85 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:41.621807 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d3b7-5786-4d85-befa-6485360a5e85 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:41.621903 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d3b7-5786-4d85-befa-6485360a5e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:41.645331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fe56d3b7-5786-4d85-befa-6485360a5e85 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:41.646582 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fe56d3b7-5786-4d85-befa-6485360a5e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:41.655354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1257/2468] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:31:41.660252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e08c22-811a-4184-a9b9-39e2e9582778 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:41.672546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e08c22-811a-4184-a9b9-39e2e9582778 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:41.678614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1db2af-3943-4349-a61a-cc88d0368594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:41.679226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1db2af-3943-4349-a61a-cc88d0368594 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:41.679516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1db2af-3943-4349-a61a-cc88d0368594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:41.681590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1db2af-3943-4349-a61a-cc88d0368594 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:41.684107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1db2af-3943-4349-a61a-cc88d0368594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:31:41.684422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1db2af-3943-4349-a61a-cc88d0368594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:41.686425 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1db2af-3943-4349-a61a-cc88d0368594 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:41.706175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1212/2469] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:31:41.709843 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d3b7-5786-4d85-befa-6485360a5e85 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:41.725756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d3b7-5786-4d85-befa-6485360a5e85 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:41.730899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293690b-1c70-4a2c-bd1f-3000e0565089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:41.731703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293690b-1c70-4a2c-bd1f-3000e0565089 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:41.732142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293690b-1c70-4a2c-bd1f-3000e0565089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:41.732580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293690b-1c70-4a2c-bd1f-3000e0565089 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:41.733518 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293690b-1c70-4a2c-bd1f-3000e0565089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:41.736324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293690b-1c70-4a2c-bd1f-3000e0565089 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:41.773185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1258/2470] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:31:41 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:31:41.774669 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1db2af-3943-4349-a61a-cc88d0368594 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:41.786583 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1db2af-3943-4349-a61a-cc88d0368594 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:41.868437 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1c681-3eb5-44af-bdfc-902a8760cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:41.869108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1c681-3eb5-44af-bdfc-902a8760cd64 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:41.869390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1c681-3eb5-44af-bdfc-902a8760cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:41.869733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1c681-3eb5-44af-bdfc-902a8760cd64 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:41.870355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1c681-3eb5-44af-bdfc-902a8760cd64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:41.872415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1c681-3eb5-44af-bdfc-902a8760cd64 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:41.902292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1213/2471] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:31:41 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:31:41.906489 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293690b-1c70-4a2c-bd1f-3000e0565089 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:41.919663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293690b-1c70-4a2c-bd1f-3000e0565089 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:41.925881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91b9dd-f0eb-45fd-9fe9-84a287fa34cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:41.926568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91b9dd-f0eb-45fd-9fe9-84a287fa34cb admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:41.926876 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91b9dd-f0eb-45fd-9fe9-84a287fa34cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:41.927214 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91b9dd-f0eb-45fd-9fe9-84a287fa34cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:41.927867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91b9dd-f0eb-45fd-9fe9-84a287fa34cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:41.929559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91b9dd-f0eb-45fd-9fe9-84a287fa34cb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:41.940659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1259/2472] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:41.945482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1c681-3eb5-44af-bdfc-902a8760cd64 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:41.957885 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1c681-3eb5-44af-bdfc-902a8760cd64 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:41.963075 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bed1a6-fcf0-40af-b30a-d299eac18fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:41.963653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bed1a6-fcf0-40af-b30a-d299eac18fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:41.964076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bed1a6-fcf0-40af-b30a-d299eac18fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:41.964363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bed1a6-fcf0-40af-b30a-d299eac18fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:41.965047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bed1a6-fcf0-40af-b30a-d299eac18fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:41.966661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bed1a6-fcf0-40af-b30a-d299eac18fb1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:41.980733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1214/2473] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:31:41.984166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91b9dd-f0eb-45fd-9fe9-84a287fa34cb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:41.995290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91b9dd-f0eb-45fd-9fe9-84a287fa34cb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:42.000109 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991081e6-fbd1-4c60-8b67-b5b40afc3685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:42.000775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991081e6-fbd1-4c60-8b67-b5b40afc3685 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:42.001050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991081e6-fbd1-4c60-8b67-b5b40afc3685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:42.001325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991081e6-fbd1-4c60-8b67-b5b40afc3685 admin admin] PATH_INFO: `/v3/projects/ba7777987d49451998ab6aa5c8a7e68a/users/14f187b4e5754df3a2321142d20767ce/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:42.017085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991081e6-fbd1-4c60-8b67-b5b40afc3685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7777987d49451998ab6aa5c8a7e68a, user_id=14f187b4e5754df3a2321142d20767ce, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:42.019918 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991081e6-fbd1-4c60-8b67-b5b40afc3685 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:42.033072 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1260/2474] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:31:41 2022] PUT /identity/v3/projects/ba7777987d49451998ab6aa5c8a7e68a/users/14f187b4e5754df3a2321142d20767ce/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:31:42.043115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a2459-770d-496d-811d-fbda475282d0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:42.043403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a2459-770d-496d-811d-fbda475282d0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:42.043774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a2459-770d-496d-811d-fbda475282d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:42.073222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-806a2459-770d-496d-811d-fbda475282d0 None None] MFA Rules not processed for user `14f187b4e5754df3a2321142d20767ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:42.074536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-806a2459-770d-496d-811d-fbda475282d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:42.144346 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1215/2475] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:42.158766 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991081e6-fbd1-4c60-8b67-b5b40afc3685 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:42.160838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-991081e6-fbd1-4c60-8b67-b5b40afc3685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:42.210549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864e0d-8b74-483b-94d1-1e2b0b1ad50b None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:42.211375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864e0d-8b74-483b-94d1-1e2b0b1ad50b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:42.212121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864e0d-8b74-483b-94d1-1e2b0b1ad50b None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:42.214189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1216/2476] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 21 16:31:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:31:42.220614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec9ece-220b-4b7b-8217-42228bc6d0b0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:42.221062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec9ece-220b-4b7b-8217-42228bc6d0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:42.223457 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec9ece-220b-4b7b-8217-42228bc6d0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:42.226197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991081e6-fbd1-4c60-8b67-b5b40afc3685 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:42.230462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2622b58-f15b-4a3e-95a4-7d8117345157 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2974669e9d1a417892b1d59dbc9e87ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:42.231073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622b58-f15b-4a3e-95a4-7d8117345157 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:42.231349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622b58-f15b-4a3e-95a4-7d8117345157 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:42.231619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622b58-f15b-4a3e-95a4-7d8117345157 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:42.240767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2622b58-f15b-4a3e-95a4-7d8117345157 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:42.242195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2622b58-f15b-4a3e-95a4-7d8117345157 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:42.252320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1261/2477] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:42.259287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-15ec9ece-220b-4b7b-8217-42228bc6d0b0 None None] MFA Rules not processed for user `d7ff08c990dc41b4811f97fecb7c4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:42.260605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-15ec9ece-220b-4b7b-8217-42228bc6d0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:42.265599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:42.366903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1217/2478] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 21 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:42.376074 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2622b58-f15b-4a3e-95a4-7d8117345157 service glance] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:42.386068 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2622b58-f15b-4a3e-95a4-7d8117345157 service glance] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:42.390350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc06daa-89b0-49d8-b537-9b6de7b71742 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2974669e9d1a417892b1d59dbc9e87ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:42.390967 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc06daa-89b0-49d8-b537-9b6de7b71742 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:42.391245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc06daa-89b0-49d8-b537-9b6de7b71742 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:42.391522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc06daa-89b0-49d8-b537-9b6de7b71742 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:42.403118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc06daa-89b0-49d8-b537-9b6de7b71742 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:42.404544 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc06daa-89b0-49d8-b537-9b6de7b71742 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:42.416592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1262/2479] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:42.494878 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db998a3f-8f44-4f24-bb8f-12c4bdfa5d3f None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:42.495261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db998a3f-8f44-4f24-bb8f-12c4bdfa5d3f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:42.495466 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db998a3f-8f44-4f24-bb8f-12c4bdfa5d3f None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:42.496834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1218/2480] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 21 16:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:31:42.502111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda6911-89e1-4fcd-8cdc-4c4ac301fb97 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:42.502393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda6911-89e1-4fcd-8cdc-4c4ac301fb97 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:42.502683 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda6911-89e1-4fcd-8cdc-4c4ac301fb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:42.523063 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cfda6911-89e1-4fcd-8cdc-4c4ac301fb97 None None] MFA Rules not processed for user `0e765e2cc4c94243b00f919e8f8d01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:42.524300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cfda6911-89e1-4fcd-8cdc-4c4ac301fb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:42.591448 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1263/2481] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 21 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:42.606187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db998a3f-8f44-4f24-bb8f-12c4bdfa5d3f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:42.609320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-db998a3f-8f44-4f24-bb8f-12c4bdfa5d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:42.628956 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db998a3f-8f44-4f24-bb8f-12c4bdfa5d3f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:42.633831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97aeeb4-40c0-40dc-beed-1938de64b60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:42.634613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aeeb4-40c0-40dc-beed-1938de64b60d service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:42.634998 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aeeb4-40c0-40dc-beed-1938de64b60d service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:42.635551 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aeeb4-40c0-40dc-beed-1938de64b60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:42.646075 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97aeeb4-40c0-40dc-beed-1938de64b60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:42.647548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97aeeb4-40c0-40dc-beed-1938de64b60d service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:42.657396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1219/2482] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:42.793333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fd7d8-860f-4839-8bb1-0dd7c3d04f3c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:42.794538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fd7d8-860f-4839-8bb1-0dd7c3d04f3c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:42.795064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fd7d8-860f-4839-8bb1-0dd7c3d04f3c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:42.798134 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1264/2483] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 21 16:31:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 16:31:42.805917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2db621-5cfb-4e42-b02b-4d16434ca599 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:42.806214 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2db621-5cfb-4e42-b02b-4d16434ca599 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:42.806493 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2db621-5cfb-4e42-b02b-4d16434ca599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:42.846008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9d2db621-5cfb-4e42-b02b-4d16434ca599 None None] MFA Rules not processed for user `d7ff08c990dc41b4811f97fecb7c4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:42.846008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9d2db621-5cfb-4e42-b02b-4d16434ca599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:42.848264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1220/2484] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 21 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:42.860126 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fd7d8-860f-4839-8bb1-0dd7c3d04f3c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:42.862151 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f61fd7d8-860f-4839-8bb1-0dd7c3d04f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:42.876157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fd7d8-860f-4839-8bb1-0dd7c3d04f3c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:42.890688 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04090e-c1ca-4898-a4ee-0fd5fba3c7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:42.891335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04090e-c1ca-4898-a4ee-0fd5fba3c7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:42.891736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04090e-c1ca-4898-a4ee-0fd5fba3c7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:42.891869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04090e-c1ca-4898-a4ee-0fd5fba3c7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:42.904071 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04090e-c1ca-4898-a4ee-0fd5fba3c7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:42.905586 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04090e-c1ca-4898-a4ee-0fd5fba3c7a7 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:42.918093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1265/2485] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:31:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:31:45.019467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6db07a-8fdb-43b6-ad00-4ef469f02e74 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:45.020068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6db07a-8fdb-43b6-ad00-4ef469f02e74 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:45.020068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6db07a-8fdb-43b6-ad00-4ef469f02e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:45.041081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-bc6db07a-8fdb-43b6-ad00-4ef469f02e74 None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:31:45.042320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bc6db07a-8fdb-43b6-ad00-4ef469f02e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:45.117847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1221/2486] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:31:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:31:45.132744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04090e-c1ca-4898-a4ee-0fd5fba3c7a7 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:31:45.134195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ea04090e-c1ca-4898-a4ee-0fd5fba3c7a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:31:45.159823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:45.216290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04090e-c1ca-4898-a4ee-0fd5fba3c7a7 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:31:45.221746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8557f-ad4e-4d22-ad7b-27bc04c34b45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:31:45.222904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8557f-ad4e-4d22-ad7b-27bc04c34b45 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:31:45.223172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8557f-ad4e-4d22-ad7b-27bc04c34b45 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:31:45.223436 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8557f-ad4e-4d22-ad7b-27bc04c34b45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:31:45.232090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8557f-ad4e-4d22-ad7b-27bc04c34b45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:31:45.233699 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8557f-ad4e-4d22-ad7b-27bc04c34b45 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:31:45.242192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1266/2487] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:31:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:31:55.106327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=65 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:55.238997 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=23 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:14.054516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90489ec-0502-4ad3-9b76-1bf1dc226718 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:14.055132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90489ec-0502-4ad3-9b76-1bf1dc226718 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:14.055132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90489ec-0502-4ad3-9b76-1bf1dc226718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:14.077049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e90489ec-0502-4ad3-9b76-1bf1dc226718 None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:14.078352 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e90489ec-0502-4ad3-9b76-1bf1dc226718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:14.085705 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1222/2488] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 21 16:32:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:14.098801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8557f-ad4e-4d22-ad7b-27bc04c34b45 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:14.109690 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8557f-ad4e-4d22-ad7b-27bc04c34b45 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:14.114792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae624b2b-cb14-440a-893e-008390a4879b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:14.115930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624b2b-cb14-440a-893e-008390a4879b service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:14.116211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624b2b-cb14-440a-893e-008390a4879b service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:14.116487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624b2b-cb14-440a-893e-008390a4879b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:14.124720 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae624b2b-cb14-440a-893e-008390a4879b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:14.126381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae624b2b-cb14-440a-893e-008390a4879b service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:14.135387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1267/2489] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:32:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:32:15.900810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90489ec-0502-4ad3-9b76-1bf1dc226718 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:15.981432 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90489ec-0502-4ad3-9b76-1bf1dc226718 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:15.986043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495d66d-f2be-4bca-92d1-a2b77282739f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:15.986687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495d66d-f2be-4bca-92d1-a2b77282739f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:15.986965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495d66d-f2be-4bca-92d1-a2b77282739f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:15.987239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495d66d-f2be-4bca-92d1-a2b77282739f admin admin] PATH_INFO: `/v3/users/14f187b4e5754df3a2321142d20767ce` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:15.988388 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495d66d-f2be-4bca-92d1-a2b77282739f admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f187b4e5754df3a2321142d20767ce)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:15.990895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495d66d-f2be-4bca-92d1-a2b77282739f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:16.043659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b495d66d-f2be-4bca-92d1-a2b77282739f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f187b4e5754df3a2321142d20767ce'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:16.044301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b495d66d-f2be-4bca-92d1-a2b77282739f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f187b4e5754df3a2321142d20767ce'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:16.044939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b495d66d-f2be-4bca-92d1-a2b77282739f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f187b4e5754df3a2321142d20767ce'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:16.053189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b495d66d-f2be-4bca-92d1-a2b77282739f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f187b4e5754df3a2321142d20767ce'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:16.066482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b495d66d-f2be-4bca-92d1-a2b77282739f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f187b4e5754df3a2321142d20767ce'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:16.081708 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1223/2490] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:32:15 2022] DELETE /identity/v3/users/14f187b4e5754df3a2321142d20767ce => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:16.086466 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505215c1-951c-4c79-80d7-b16ec932755a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:16.086973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505215c1-951c-4c79-80d7-b16ec932755a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:16.086973 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505215c1-951c-4c79-80d7-b16ec932755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:16.106429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-505215c1-951c-4c79-80d7-b16ec932755a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:16.107654 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-505215c1-951c-4c79-80d7-b16ec932755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:16.165781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1268/2491] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:32:16.175731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495d66d-f2be-4bca-92d1-a2b77282739f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:16.177241 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b495d66d-f2be-4bca-92d1-a2b77282739f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:16.236162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495d66d-f2be-4bca-92d1-a2b77282739f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:16.240000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cd0ca-8621-4824-8a08-ae912fc95136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:16.241401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cd0ca-8621-4824-8a08-ae912fc95136 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:16.241682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cd0ca-8621-4824-8a08-ae912fc95136 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:16.241955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cd0ca-8621-4824-8a08-ae912fc95136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:16.250947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cd0ca-8621-4824-8a08-ae912fc95136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:16.252363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cd0ca-8621-4824-8a08-ae912fc95136 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:16.262538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1224/2492] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:32:16.538427 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505215c1-951c-4c79-80d7-b16ec932755a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:16.540090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-505215c1-951c-4c79-80d7-b16ec932755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:16.553320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505215c1-951c-4c79-80d7-b16ec932755a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:16.558125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:16.558804 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:16.559091 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:16.559365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] PATH_INFO: `/v3/projects/ba7777987d49451998ab6aa5c8a7e68a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:16.569339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba7777987d49451998ab6aa5c8a7e68a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:16.571291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:16.619365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba7777987d49451998ab6aa5c8a7e68a', 'request_id': 'req-982e2112-dacf-435a-b65b-c570e797a1f0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:16.625110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba7777987d49451998ab6aa5c8a7e68a', 'request_id': 'req-982e2112-dacf-435a-b65b-c570e797a1f0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:16.632458 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba7777987d49451998ab6aa5c8a7e68a', 'request_id': 'req-982e2112-dacf-435a-b65b-c570e797a1f0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:16.643525 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] The token cache is being invalidate because project ba7777987d49451998ab6aa5c8a7e68a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:32:16.643803 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:16.644420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:16.645903 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1269/2493] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:32:16 2022] DELETE /identity/v3/projects/ba7777987d49451998ab6aa5c8a7e68a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:17.358996 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cd0ca-8621-4824-8a08-ae912fc95136 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:17.360445 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-493cd0ca-8621-4824-8a08-ae912fc95136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:17.381503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:17.469679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cd0ca-8621-4824-8a08-ae912fc95136 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:17.530366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4529e12-9dcd-4998-bcf5-359658e37c70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd3076ca5a84ff7ada13065f9531f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:17.530366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4529e12-9dcd-4998-bcf5-359658e37c70 service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:17.530790 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4529e12-9dcd-4998-bcf5-359658e37c70 service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:17.531130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4529e12-9dcd-4998-bcf5-359658e37c70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:17.532648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c4529e12-9dcd-4998-bcf5-359658e37c70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:17.544285 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4529e12-9dcd-4998-bcf5-359658e37c70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:17.545905 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4529e12-9dcd-4998-bcf5-359658e37c70 service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:17.556642 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1225/2494] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:32:26.640621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:27.551621 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=60 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:30.467273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:30.468698 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:30.525999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e2112-dacf-435a-b65b-c570e797a1f0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:30.529670 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17386eb4-e6c8-4aae-accd-da3883ae6160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:30.530273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386eb4-e6c8-4aae-accd-da3883ae6160 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:30.530553 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386eb4-e6c8-4aae-accd-da3883ae6160 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:30.530815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386eb4-e6c8-4aae-accd-da3883ae6160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:30.532594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-17386eb4-e6c8-4aae-accd-da3883ae6160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:30.595964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17386eb4-e6c8-4aae-accd-da3883ae6160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:30.597398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17386eb4-e6c8-4aae-accd-da3883ae6160 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:30.607508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1270/2495] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:32:33.812834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4529e12-9dcd-4998-bcf5-359658e37c70 service placement] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:33.814461 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c4529e12-9dcd-4998-bcf5-359658e37c70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:33.838804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4529e12-9dcd-4998-bcf5-359658e37c70 service placement] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:33.845068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa97d8-656a-42c0-baa1-964d8ead00ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:33.845690 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa97d8-656a-42c0-baa1-964d8ead00ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:33.845968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa97d8-656a-42c0-baa1-964d8ead00ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:33.846231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa97d8-656a-42c0-baa1-964d8ead00ec admin admin] PATH_INFO: `/v3/users/497c2547b8dd4bd1bbb804a9395dc20e` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:33.847341 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa97d8-656a-42c0-baa1-964d8ead00ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=497c2547b8dd4bd1bbb804a9395dc20e)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:33.849381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa97d8-656a-42c0-baa1-964d8ead00ec admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:33.898563 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7eaa97d8-656a-42c0-baa1-964d8ead00ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497c2547b8dd4bd1bbb804a9395dc20e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:33.899211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7eaa97d8-656a-42c0-baa1-964d8ead00ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497c2547b8dd4bd1bbb804a9395dc20e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:33.899847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7eaa97d8-656a-42c0-baa1-964d8ead00ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497c2547b8dd4bd1bbb804a9395dc20e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:33.907722 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7eaa97d8-656a-42c0-baa1-964d8ead00ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497c2547b8dd4bd1bbb804a9395dc20e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:33.924096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7eaa97d8-656a-42c0-baa1-964d8ead00ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497c2547b8dd4bd1bbb804a9395dc20e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:33.938499 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1226/2496] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:32:33 2022] DELETE /identity/v3/users/497c2547b8dd4bd1bbb804a9395dc20e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:34.114539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17386eb4-e6c8-4aae-accd-da3883ae6160 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:34.126393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17386eb4-e6c8-4aae-accd-da3883ae6160 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:34.184403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56cfea-155e-41f0-8e00-59ce466d1c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:34.185053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56cfea-155e-41f0-8e00-59ce466d1c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:34.185327 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56cfea-155e-41f0-8e00-59ce466d1c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:34.185593 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56cfea-155e-41f0-8e00-59ce466d1c26 admin admin] PATH_INFO: `/v3/projects/ec47ba6becd2422b97e3ff4b7e87734a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:34.186696 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56cfea-155e-41f0-8e00-59ce466d1c26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec47ba6becd2422b97e3ff4b7e87734a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:34.188595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56cfea-155e-41f0-8e00-59ce466d1c26 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:34.237316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4f56cfea-155e-41f0-8e00-59ce466d1c26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec47ba6becd2422b97e3ff4b7e87734a', 'request_id': 'req-4f56cfea-155e-41f0-8e00-59ce466d1c26'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:34.239214 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:34.244020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4f56cfea-155e-41f0-8e00-59ce466d1c26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec47ba6becd2422b97e3ff4b7e87734a', 'request_id': 'req-4f56cfea-155e-41f0-8e00-59ce466d1c26'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:34.251074 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4f56cfea-155e-41f0-8e00-59ce466d1c26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec47ba6becd2422b97e3ff4b7e87734a', 'request_id': 'req-4f56cfea-155e-41f0-8e00-59ce466d1c26'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:34.262204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4f56cfea-155e-41f0-8e00-59ce466d1c26 admin admin] The token cache is being invalidate because project ec47ba6becd2422b97e3ff4b7e87734a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:32:34.262510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4f56cfea-155e-41f0-8e00-59ce466d1c26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:34.263122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4f56cfea-155e-41f0-8e00-59ce466d1c26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:34.264641 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1271/2497] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:32:34 2022] DELETE /identity/v3/projects/ec47ba6becd2422b97e3ff4b7e87734a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:32:34.269686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d617a-dc4b-4d4d-8f68-53d04799a8cd None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:34.269977 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d617a-dc4b-4d4d-8f68-53d04799a8cd None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:34.270261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d617a-dc4b-4d4d-8f68-53d04799a8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:34.291059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b24d617a-dc4b-4d4d-8f68-53d04799a8cd None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:34.292191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b24d617a-dc4b-4d4d-8f68-53d04799a8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:34.351268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1227/2498] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:34.359146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4131a1-888d-4c10-91b5-c0ec93b02070 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:34.359452 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4131a1-888d-4c10-91b5-c0ec93b02070 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:34.359725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4131a1-888d-4c10-91b5-c0ec93b02070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:34.379162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8e4131a1-888d-4c10-91b5-c0ec93b02070 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:34.380352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8e4131a1-888d-4c10-91b5-c0ec93b02070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:34.388759 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1272/2499] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:34.393002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d617a-dc4b-4d4d-8f68-53d04799a8cd None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:34.403426 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d617a-dc4b-4d4d-8f68-53d04799a8cd None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:34.408067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1f56-21fa-4426-9054-4004c60d1f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:34.408656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1f56-21fa-4426-9054-4004c60d1f48 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:34.408966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1f56-21fa-4426-9054-4004c60d1f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:34.409234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1f56-21fa-4426-9054-4004c60d1f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:34.409873 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c1f56-21fa-4426-9054-4004c60d1f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:32:34.410169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c1f56-21fa-4426-9054-4004c60d1f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:34.411745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c1f56-21fa-4426-9054-4004c60d1f48 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:34.423181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1228/2500] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:32:34.427453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4131a1-888d-4c10-91b5-c0ec93b02070 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:34.436572 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4131a1-888d-4c10-91b5-c0ec93b02070 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:34.441302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317655f2-975c-4e36-a736-6ac426d6e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:34.441886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317655f2-975c-4e36-a736-6ac426d6e8ec admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:34.442158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317655f2-975c-4e36-a736-6ac426d6e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:34.442423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317655f2-975c-4e36-a736-6ac426d6e8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:34.443054 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317655f2-975c-4e36-a736-6ac426d6e8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:34.445594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317655f2-975c-4e36-a736-6ac426d6e8ec admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:34.476049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1273/2501] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:32:34 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:32:34.480028 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1f56-21fa-4426-9054-4004c60d1f48 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:34.490421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1f56-21fa-4426-9054-4004c60d1f48 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:34.548606 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4756176-d098-4405-9fcc-c457c9962fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:34.549181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4756176-d098-4405-9fcc-c457c9962fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:34.549464 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4756176-d098-4405-9fcc-c457c9962fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:34.549738 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4756176-d098-4405-9fcc-c457c9962fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:34.550370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4756176-d098-4405-9fcc-c457c9962fa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:34.552384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4756176-d098-4405-9fcc-c457c9962fa7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:34.560656 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:34.576989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1229/2502] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:32:34 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:32:34.581049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317655f2-975c-4e36-a736-6ac426d6e8ec admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:34.591876 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317655f2-975c-4e36-a736-6ac426d6e8ec admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:34.596520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536eba9-c2e6-47ae-8a46-68036187063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:34.597146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536eba9-c2e6-47ae-8a46-68036187063b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:34.597427 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536eba9-c2e6-47ae-8a46-68036187063b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:34.597701 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536eba9-c2e6-47ae-8a46-68036187063b admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:34.598338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536eba9-c2e6-47ae-8a46-68036187063b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:34.600116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536eba9-c2e6-47ae-8a46-68036187063b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:34.610049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1274/2503] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:32:34.613917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4756176-d098-4405-9fcc-c457c9962fa7 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:34.624023 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4756176-d098-4405-9fcc-c457c9962fa7 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:34.628713 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab7925-f7e5-49bb-a6c7-fd1e920bda7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:34.629315 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab7925-f7e5-49bb-a6c7-fd1e920bda7a admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:34.629601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab7925-f7e5-49bb-a6c7-fd1e920bda7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:34.629872 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab7925-f7e5-49bb-a6c7-fd1e920bda7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:34.630505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab7925-f7e5-49bb-a6c7-fd1e920bda7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:34.632643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab7925-f7e5-49bb-a6c7-fd1e920bda7a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:34.643053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1230/2504] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:34.647975 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536eba9-c2e6-47ae-8a46-68036187063b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:34.658179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536eba9-c2e6-47ae-8a46-68036187063b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:34.662887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd30e93-7878-41fe-a07b-fa0b9aea18f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:34.663566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd30e93-7878-41fe-a07b-fa0b9aea18f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:34.663845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd30e93-7878-41fe-a07b-fa0b9aea18f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:34.664120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd30e93-7878-41fe-a07b-fa0b9aea18f7 admin admin] PATH_INFO: `/v3/projects/1c52c9277976476183f1ba4c22e6829a/users/f8a5e33561794d76ab5b374486329fc3/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:34.678592 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd30e93-7878-41fe-a07b-fa0b9aea18f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c52c9277976476183f1ba4c22e6829a, user_id=f8a5e33561794d76ab5b374486329fc3, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:34.681270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd30e93-7878-41fe-a07b-fa0b9aea18f7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:34.695297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1275/2505] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:32:34 2022] PUT /identity/v3/projects/1c52c9277976476183f1ba4c22e6829a/users/f8a5e33561794d76ab5b374486329fc3/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:34.707077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e19f-7cde-408b-8963-8e17735241a5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:34.707363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e19f-7cde-408b-8963-8e17735241a5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:34.707643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e19f-7cde-408b-8963-8e17735241a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:34.737412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-fc73e19f-7cde-408b-8963-8e17735241a5 None None] MFA Rules not processed for user `f8a5e33561794d76ab5b374486329fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:34.738635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-fc73e19f-7cde-408b-8963-8e17735241a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:34.802509 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1231/2506] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:34.811515 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd30e93-7878-41fe-a07b-fa0b9aea18f7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:34.890627 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd30e93-7878-41fe-a07b-fa0b9aea18f7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:34.895424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba78e5-379a-4f48-8aa4-ad37dd615954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:34.896028 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba78e5-379a-4f48-8aa4-ad37dd615954 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:34.896303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba78e5-379a-4f48-8aa4-ad37dd615954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:34.896665 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba78e5-379a-4f48-8aa4-ad37dd615954 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:34.897339 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba78e5-379a-4f48-8aa4-ad37dd615954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:34.899247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba78e5-379a-4f48-8aa4-ad37dd615954 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:34.926024 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1276/2507] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:32:34 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:32:34.930885 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73e19f-7cde-408b-8963-8e17735241a5 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:34.941982 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73e19f-7cde-408b-8963-8e17735241a5 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:35.001048 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e964d4b-dbe1-4d08-98ad-cf68633757cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:35.001665 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e964d4b-dbe1-4d08-98ad-cf68633757cd admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:35.001944 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e964d4b-dbe1-4d08-98ad-cf68633757cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:35.002213 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e964d4b-dbe1-4d08-98ad-cf68633757cd admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:35.002843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e964d4b-dbe1-4d08-98ad-cf68633757cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:35.004812 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e964d4b-dbe1-4d08-98ad-cf68633757cd admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:35.030518 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1232/2508] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:32:34 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:32:35.033878 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba78e5-379a-4f48-8aa4-ad37dd615954 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:35.044891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba78e5-379a-4f48-8aa4-ad37dd615954 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:35.049550 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c534a3-a77d-4b0a-b630-d7ef0592a5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:35.050145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c534a3-a77d-4b0a-b630-d7ef0592a5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:35.050421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c534a3-a77d-4b0a-b630-d7ef0592a5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:35.050692 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c534a3-a77d-4b0a-b630-d7ef0592a5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:35.051331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c534a3-a77d-4b0a-b630-d7ef0592a5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:35.053057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c534a3-a77d-4b0a-b630-d7ef0592a5a7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:35.063882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1277/2509] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:35.068222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e964d4b-dbe1-4d08-98ad-cf68633757cd admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:35.078955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e964d4b-dbe1-4d08-98ad-cf68633757cd admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:35.083579 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e366797-9154-49e8-a6b5-c2b6f08e24a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:35.084743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e366797-9154-49e8-a6b5-c2b6f08e24a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:35.085023 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e366797-9154-49e8-a6b5-c2b6f08e24a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:35.085292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e366797-9154-49e8-a6b5-c2b6f08e24a9 admin admin] PATH_INFO: `/v3/projects/555f70a3a3564232b28d9646e1dbacec/users/65ab4ab10c5d47d589f3d3d1e93daeed/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:35.101735 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e366797-9154-49e8-a6b5-c2b6f08e24a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555f70a3a3564232b28d9646e1dbacec, user_id=65ab4ab10c5d47d589f3d3d1e93daeed, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:35.104379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e366797-9154-49e8-a6b5-c2b6f08e24a9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:35.117125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1233/2510] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:32:35 2022] PUT /identity/v3/projects/555f70a3a3564232b28d9646e1dbacec/users/65ab4ab10c5d47d589f3d3d1e93daeed/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:35.121052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c534a3-a77d-4b0a-b630-d7ef0592a5a7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:35.131766 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c534a3-a77d-4b0a-b630-d7ef0592a5a7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:35.182456 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:35.193210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a932c-3265-4750-8322-5ef7762b58fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:35.194357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a932c-3265-4750-8322-5ef7762b58fc admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:35.194629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a932c-3265-4750-8322-5ef7762b58fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:35.194891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a932c-3265-4750-8322-5ef7762b58fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:35.195515 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a932c-3265-4750-8322-5ef7762b58fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:35.197377 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a932c-3265-4750-8322-5ef7762b58fc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:35.207605 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1278/2511] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:35.212495 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e366797-9154-49e8-a6b5-c2b6f08e24a9 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:35.223070 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e366797-9154-49e8-a6b5-c2b6f08e24a9 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:35.227909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a3616-4752-4546-a542-548563176210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:35.228575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a3616-4752-4546-a542-548563176210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:35.228885 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a3616-4752-4546-a542-548563176210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:35.229157 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a3616-4752-4546-a542-548563176210 admin admin] PATH_INFO: `/v3/projects/555f70a3a3564232b28d9646e1dbacec/users/65ab4ab10c5d47d589f3d3d1e93daeed/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:35.231080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a3616-4752-4546-a542-548563176210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555f70a3a3564232b28d9646e1dbacec, user_id=65ab4ab10c5d47d589f3d3d1e93daeed, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:35.233763 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a3616-4752-4546-a542-548563176210 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:35.244504 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1234/2512] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:32:35 2022] PUT /identity/v3/projects/555f70a3a3564232b28d9646e1dbacec/users/65ab4ab10c5d47d589f3d3d1e93daeed/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:35.255247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a1e37-ff6d-4d07-946c-2c0d18d8d8c9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:35.255535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a1e37-ff6d-4d07-946c-2c0d18d8d8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:35.256317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a1e37-ff6d-4d07-946c-2c0d18d8d8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:35.283794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-748a1e37-ff6d-4d07-946c-2c0d18d8d8c9 None None] MFA Rules not processed for user `65ab4ab10c5d47d589f3d3d1e93daeed`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:35.285019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-748a1e37-ff6d-4d07-946c-2c0d18d8d8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:35.352711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1279/2513] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:35.363873 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a3616-4752-4546-a542-548563176210 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:35.366275 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-411a3616-4752-4546-a542-548563176210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:35.388542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:35.425225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a3616-4752-4546-a542-548563176210 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:35.429879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef93e5-b4cb-4c63-99b4-f7a533a8075f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:35.430490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef93e5-b4cb-4c63-99b4-f7a533a8075f service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:35.430720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef93e5-b4cb-4c63-99b4-f7a533a8075f service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:35.430990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef93e5-b4cb-4c63-99b4-f7a533a8075f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:35.440145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef93e5-b4cb-4c63-99b4-f7a533a8075f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:35.441697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef93e5-b4cb-4c63-99b4-f7a533a8075f service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:35.455168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1235/2514] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:32:35.530914 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a1e37-ff6d-4d07-946c-2c0d18d8d8c9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:35.541263 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a1e37-ff6d-4d07-946c-2c0d18d8d8c9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:35.544930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93238889-4538-47f2-a722-34660c8fd700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:35.545531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93238889-4538-47f2-a722-34660c8fd700 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:35.545808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93238889-4538-47f2-a722-34660c8fd700 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:35.546077 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93238889-4538-47f2-a722-34660c8fd700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:35.603191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93238889-4538-47f2-a722-34660c8fd700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:35.604522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93238889-4538-47f2-a722-34660c8fd700 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:35.613338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1280/2515] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:32:42.436200 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef93e5-b4cb-4c63-99b4-f7a533a8075f service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:42.520829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef93e5-b4cb-4c63-99b4-f7a533a8075f service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:42.528000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9737f9-2daf-4b8f-a763-91240970b4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:42.528641 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9737f9-2daf-4b8f-a763-91240970b4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:42.528951 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9737f9-2daf-4b8f-a763-91240970b4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:42.529221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9737f9-2daf-4b8f-a763-91240970b4be admin admin] PATH_INFO: `/v3/users/f8a5e33561794d76ab5b374486329fc3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:42.530364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9737f9-2daf-4b8f-a763-91240970b4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a5e33561794d76ab5b374486329fc3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:42.532285 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9737f9-2daf-4b8f-a763-91240970b4be admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:42.587209 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b9737f9-2daf-4b8f-a763-91240970b4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a5e33561794d76ab5b374486329fc3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:42.587861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b9737f9-2daf-4b8f-a763-91240970b4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a5e33561794d76ab5b374486329fc3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:42.588455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b9737f9-2daf-4b8f-a763-91240970b4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a5e33561794d76ab5b374486329fc3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:42.595377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b9737f9-2daf-4b8f-a763-91240970b4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a5e33561794d76ab5b374486329fc3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:42.608076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b9737f9-2daf-4b8f-a763-91240970b4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a5e33561794d76ab5b374486329fc3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:42.622286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1236/2516] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:32:42 2022] DELETE /identity/v3/users/f8a5e33561794d76ab5b374486329fc3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:42.626915 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b12db1-84aa-461b-9bd2-dceaae1279b0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:42.627436 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b12db1-84aa-461b-9bd2-dceaae1279b0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:42.627568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b12db1-84aa-461b-9bd2-dceaae1279b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:42.647899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-78b12db1-84aa-461b-9bd2-dceaae1279b0 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:42.649361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78b12db1-84aa-461b-9bd2-dceaae1279b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:42.707404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1281/2517] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:32:42.717801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9737f9-2daf-4b8f-a763-91240970b4be admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:42.719195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8b9737f9-2daf-4b8f-a763-91240970b4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:42.764141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:42.778348 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9737f9-2daf-4b8f-a763-91240970b4be admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:42.782411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393321c-2764-46cf-9a7b-ecc7e496de20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:42.783008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393321c-2764-46cf-9a7b-ecc7e496de20 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:42.783365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393321c-2764-46cf-9a7b-ecc7e496de20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:42.783553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393321c-2764-46cf-9a7b-ecc7e496de20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:42.792805 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393321c-2764-46cf-9a7b-ecc7e496de20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:42.794229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393321c-2764-46cf-9a7b-ecc7e496de20 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:42.803546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1237/2518] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:32:43.076426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b12db1-84aa-461b-9bd2-dceaae1279b0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:43.077981 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78b12db1-84aa-461b-9bd2-dceaae1279b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:43.091911 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b12db1-84aa-461b-9bd2-dceaae1279b0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:43.096977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:43.097617 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:43.097895 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:43.098163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] PATH_INFO: `/v3/projects/1c52c9277976476183f1ba4c22e6829a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:43.099289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c52c9277976476183f1ba4c22e6829a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:43.101940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:43.109000 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:43.150104 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c52c9277976476183f1ba4c22e6829a', 'request_id': 'req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.155652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c52c9277976476183f1ba4c22e6829a', 'request_id': 'req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.162953 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c52c9277976476183f1ba4c22e6829a', 'request_id': 'req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.174090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] The token cache is being invalidate because project 1c52c9277976476183f1ba4c22e6829a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:32:43.174381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.175023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.176505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1282/2519] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:32:43 2022] DELETE /identity/v3/projects/1c52c9277976476183f1ba4c22e6829a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:43.181216 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393321c-2764-46cf-9a7b-ecc7e496de20 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:43.190998 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393321c-2764-46cf-9a7b-ecc7e496de20 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:43.248600 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c761e-9768-441c-b6dd-7484ac6c81cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:43.249171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c761e-9768-441c-b6dd-7484ac6c81cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:43.249451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c761e-9768-441c-b6dd-7484ac6c81cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:43.249722 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c761e-9768-441c-b6dd-7484ac6c81cf admin admin] PATH_INFO: `/v3/users/65ab4ab10c5d47d589f3d3d1e93daeed` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:43.250836 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c761e-9768-441c-b6dd-7484ac6c81cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ab4ab10c5d47d589f3d3d1e93daeed)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:43.252792 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c761e-9768-441c-b6dd-7484ac6c81cf admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:43.297279 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cc4c761e-9768-441c-b6dd-7484ac6c81cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ab4ab10c5d47d589f3d3d1e93daeed'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.297944 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cc4c761e-9768-441c-b6dd-7484ac6c81cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ab4ab10c5d47d589f3d3d1e93daeed'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.298548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cc4c761e-9768-441c-b6dd-7484ac6c81cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ab4ab10c5d47d589f3d3d1e93daeed'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.305975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cc4c761e-9768-441c-b6dd-7484ac6c81cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ab4ab10c5d47d589f3d3d1e93daeed'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.317699 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cc4c761e-9768-441c-b6dd-7484ac6c81cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ab4ab10c5d47d589f3d3d1e93daeed'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.333784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1238/2520] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:32:43 2022] DELETE /identity/v3/users/65ab4ab10c5d47d589f3d3d1e93daeed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:43.616029 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:43.617533 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:43.631356 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a99f6f-bf18-4bf6-936b-ea92962dd22d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:43.686825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512733e7-d2d1-47fc-ad69-b41989c19575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:43.687457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512733e7-d2d1-47fc-ad69-b41989c19575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:43.687729 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512733e7-d2d1-47fc-ad69-b41989c19575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:43.687994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512733e7-d2d1-47fc-ad69-b41989c19575 admin admin] PATH_INFO: `/v3/projects/555f70a3a3564232b28d9646e1dbacec` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:43.689120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512733e7-d2d1-47fc-ad69-b41989c19575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=555f70a3a3564232b28d9646e1dbacec)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:43.690991 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512733e7-d2d1-47fc-ad69-b41989c19575 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:43.737036 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-512733e7-d2d1-47fc-ad69-b41989c19575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555f70a3a3564232b28d9646e1dbacec', 'request_id': 'req-512733e7-d2d1-47fc-ad69-b41989c19575'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.742853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-512733e7-d2d1-47fc-ad69-b41989c19575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555f70a3a3564232b28d9646e1dbacec', 'request_id': 'req-512733e7-d2d1-47fc-ad69-b41989c19575'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.749808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-512733e7-d2d1-47fc-ad69-b41989c19575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555f70a3a3564232b28d9646e1dbacec', 'request_id': 'req-512733e7-d2d1-47fc-ad69-b41989c19575'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.761761 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-512733e7-d2d1-47fc-ad69-b41989c19575 admin admin] The token cache is being invalidate because project 555f70a3a3564232b28d9646e1dbacec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:32:43.762053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-512733e7-d2d1-47fc-ad69-b41989c19575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.762696 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-512733e7-d2d1-47fc-ad69-b41989c19575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:43.764232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1283/2521] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:32:43 2022] DELETE /identity/v3/projects/555f70a3a3564232b28d9646e1dbacec => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:43.769134 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77c454-775a-4003-98c9-3d7835c673bf None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:43.769615 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77c454-775a-4003-98c9-3d7835c673bf None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:43.769730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77c454-775a-4003-98c9-3d7835c673bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:43.789721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1f77c454-775a-4003-98c9-3d7835c673bf None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:43.790849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1f77c454-775a-4003-98c9-3d7835c673bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:43.850910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1239/2522] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:32:43.858764 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d25585-6d6f-432d-9fbd-473894962f79 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:43.859045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d25585-6d6f-432d-9fbd-473894962f79 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:43.859313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d25585-6d6f-432d-9fbd-473894962f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:43.879376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e6d25585-6d6f-432d-9fbd-473894962f79 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:43.880642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e6d25585-6d6f-432d-9fbd-473894962f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:43.889044 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1284/2523] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:43.893170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77c454-775a-4003-98c9-3d7835c673bf None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:43.899140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:43.902856 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77c454-775a-4003-98c9-3d7835c673bf None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:43.908404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9815e-a784-43ba-8f46-815a796820d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:43.909037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9815e-a784-43ba-8f46-815a796820d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:43.909510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9815e-a784-43ba-8f46-815a796820d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:43.909983 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9815e-a784-43ba-8f46-815a796820d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:43.910781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9815e-a784-43ba-8f46-815a796820d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:32:43.911085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9815e-a784-43ba-8f46-815a796820d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:43.912768 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9815e-a784-43ba-8f46-815a796820d3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:43.924234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1240/2524] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:32:43.929072 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d25585-6d6f-432d-9fbd-473894962f79 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:43.938571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d25585-6d6f-432d-9fbd-473894962f79 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:43.943885 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b096-be95-4748-b1e6-fefff5592866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:43.944484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b096-be95-4748-b1e6-fefff5592866 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:43.944814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b096-be95-4748-b1e6-fefff5592866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:43.945085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b096-be95-4748-b1e6-fefff5592866 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:43.945717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7b096-be95-4748-b1e6-fefff5592866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:43.947871 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7b096-be95-4748-b1e6-fefff5592866 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:43.964978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:43.978224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1285/2525] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:32:43 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:32:43.982393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9815e-a784-43ba-8f46-815a796820d3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:43.992232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9815e-a784-43ba-8f46-815a796820d3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:44.047238 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9601b-e97c-45e0-b33e-be17fe8392a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:44.047755 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9601b-e97c-45e0-b33e-be17fe8392a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:44.048029 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9601b-e97c-45e0-b33e-be17fe8392a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:44.048302 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9601b-e97c-45e0-b33e-be17fe8392a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:44.048957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9601b-e97c-45e0-b33e-be17fe8392a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:44.050879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9601b-e97c-45e0-b33e-be17fe8392a7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:44.072866 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1241/2526] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:32:43 2022] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:32:44.076956 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b096-be95-4748-b1e6-fefff5592866 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:44.088016 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b096-be95-4748-b1e6-fefff5592866 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:44.092667 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c2497-58c7-49cc-8f8f-bae883e1096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:44.093289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c2497-58c7-49cc-8f8f-bae883e1096a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:44.093569 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c2497-58c7-49cc-8f8f-bae883e1096a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:44.093841 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c2497-58c7-49cc-8f8f-bae883e1096a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:44.094479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c2497-58c7-49cc-8f8f-bae883e1096a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:44.096052 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c2497-58c7-49cc-8f8f-bae883e1096a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:44.106514 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1286/2527] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:44.110418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9601b-e97c-45e0-b33e-be17fe8392a7 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:44.120480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9601b-e97c-45e0-b33e-be17fe8392a7 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:44.125151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b7b7c-ff3a-426f-8a7c-5371e125abe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:44.125762 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b7b7c-ff3a-426f-8a7c-5371e125abe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:44.126042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b7b7c-ff3a-426f-8a7c-5371e125abe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:44.126310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b7b7c-ff3a-426f-8a7c-5371e125abe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:44.127103 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b7b7c-ff3a-426f-8a7c-5371e125abe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:44.128765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b7b7c-ff3a-426f-8a7c-5371e125abe2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:44.140050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1242/2528] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:44.144205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c2497-58c7-49cc-8f8f-bae883e1096a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:44.154820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c2497-58c7-49cc-8f8f-bae883e1096a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:44.159578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af724c-f728-442d-8cbc-4578c4246884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:44.160274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af724c-f728-442d-8cbc-4578c4246884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:44.160552 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af724c-f728-442d-8cbc-4578c4246884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:44.160859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af724c-f728-442d-8cbc-4578c4246884 admin admin] PATH_INFO: `/v3/projects/19b2f21cf85b4672983e5de3af807343/users/9bbf6251d1e14bbeb5c9a5e9b10122cc/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:44.175181 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af724c-f728-442d-8cbc-4578c4246884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b2f21cf85b4672983e5de3af807343, user_id=9bbf6251d1e14bbeb5c9a5e9b10122cc, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:44.177851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af724c-f728-442d-8cbc-4578c4246884 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:44.190373 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1287/2529] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:32:44 2022] PUT /identity/v3/projects/19b2f21cf85b4672983e5de3af807343/users/9bbf6251d1e14bbeb5c9a5e9b10122cc/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:44.203186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680a314-8582-4e51-bb88-56492a2df38b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:44.203464 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680a314-8582-4e51-bb88-56492a2df38b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:44.203734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680a314-8582-4e51-bb88-56492a2df38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:44.232666 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-6680a314-8582-4e51-bb88-56492a2df38b None None] MFA Rules not processed for user `9bbf6251d1e14bbeb5c9a5e9b10122cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:44.233926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6680a314-8582-4e51-bb88-56492a2df38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:44.296616 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1243/2530] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:44.301357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af724c-f728-442d-8cbc-4578c4246884 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:44.360989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af724c-f728-442d-8cbc-4578c4246884 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:44.365584 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c2ae6-5913-4159-a7f0-14d9cf5bf58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:44.366169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c2ae6-5913-4159-a7f0-14d9cf5bf58e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:44.366443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c2ae6-5913-4159-a7f0-14d9cf5bf58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:44.366730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c2ae6-5913-4159-a7f0-14d9cf5bf58e admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:44.367333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c2ae6-5913-4159-a7f0-14d9cf5bf58e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:44.369231 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c2ae6-5913-4159-a7f0-14d9cf5bf58e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:44.395455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1288/2531] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:32:44 2022] POST /identity/v3/projects => generated 401 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:32:44.400153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680a314-8582-4e51-bb88-56492a2df38b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:44.410708 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680a314-8582-4e51-bb88-56492a2df38b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:44.471156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a088f89-9c68-4844-ac63-e2d322c7ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:44.471841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a088f89-9c68-4844-ac63-e2d322c7ee60 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:44.472118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a088f89-9c68-4844-ac63-e2d322c7ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:44.472386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a088f89-9c68-4844-ac63-e2d322c7ee60 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:44.473128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a088f89-9c68-4844-ac63-e2d322c7ee60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:44.475048 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a088f89-9c68-4844-ac63-e2d322c7ee60 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:44.483224 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:44.497478 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1244/2532] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:32:44 2022] POST /identity/v3/users => generated 307 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:32:44.501471 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c2ae6-5913-4159-a7f0-14d9cf5bf58e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:44.512430 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c2ae6-5913-4159-a7f0-14d9cf5bf58e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:44.517176 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c8329-9109-4301-b8be-e95c4265904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:44.518118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c8329-9109-4301-b8be-e95c4265904f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:44.518118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c8329-9109-4301-b8be-e95c4265904f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:44.518663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c8329-9109-4301-b8be-e95c4265904f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:44.518959 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c8329-9109-4301-b8be-e95c4265904f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:44.520576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c8329-9109-4301-b8be-e95c4265904f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:44.532435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1289/2533] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:44.537654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a088f89-9c68-4844-ac63-e2d322c7ee60 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:44.547789 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a088f89-9c68-4844-ac63-e2d322c7ee60 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:44.553108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db1ec7-0d50-406a-82b7-5000e0c5f834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:44.553703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db1ec7-0d50-406a-82b7-5000e0c5f834 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:44.553979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db1ec7-0d50-406a-82b7-5000e0c5f834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:44.554249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db1ec7-0d50-406a-82b7-5000e0c5f834 admin admin] PATH_INFO: `/v3/projects/4559940b0c544472a4ea908bbee8d240/users/e9afe6a084544b5bbe794ed8b0b0e345/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:44.570272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db1ec7-0d50-406a-82b7-5000e0c5f834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4559940b0c544472a4ea908bbee8d240, user_id=e9afe6a084544b5bbe794ed8b0b0e345, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:44.573218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db1ec7-0d50-406a-82b7-5000e0c5f834 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:44.592025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1245/2534] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:32:44 2022] PUT /identity/v3/projects/4559940b0c544472a4ea908bbee8d240/users/e9afe6a084544b5bbe794ed8b0b0e345/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:44.596318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c8329-9109-4301-b8be-e95c4265904f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:44.608227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c8329-9109-4301-b8be-e95c4265904f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:44.667948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc35067-7bbc-4f99-a272-eea2f09b065e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:44.668642 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc35067-7bbc-4f99-a272-eea2f09b065e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:44.668869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc35067-7bbc-4f99-a272-eea2f09b065e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:44.669143 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc35067-7bbc-4f99-a272-eea2f09b065e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:44.669779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc35067-7bbc-4f99-a272-eea2f09b065e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:44.671652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc35067-7bbc-4f99-a272-eea2f09b065e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:44.682010 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1290/2535] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:44.686162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db1ec7-0d50-406a-82b7-5000e0c5f834 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:44.697368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db1ec7-0d50-406a-82b7-5000e0c5f834 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:44.702027 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86879528-3542-4400-a4c0-5b20ed90a81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:44.702671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879528-3542-4400-a4c0-5b20ed90a81d admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:44.702950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879528-3542-4400-a4c0-5b20ed90a81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:44.703220 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879528-3542-4400-a4c0-5b20ed90a81d admin admin] PATH_INFO: `/v3/projects/4559940b0c544472a4ea908bbee8d240/users/e9afe6a084544b5bbe794ed8b0b0e345/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:44.705164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86879528-3542-4400-a4c0-5b20ed90a81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4559940b0c544472a4ea908bbee8d240, user_id=e9afe6a084544b5bbe794ed8b0b0e345, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:44.707788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86879528-3542-4400-a4c0-5b20ed90a81d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:44.717918 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1246/2536] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:32:44 2022] PUT /identity/v3/projects/4559940b0c544472a4ea908bbee8d240/users/e9afe6a084544b5bbe794ed8b0b0e345/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:44.728211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b060-19be-4bec-88f3-9f91c2e8dda5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:44.728495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b060-19be-4bec-88f3-9f91c2e8dda5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:44.728787 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b060-19be-4bec-88f3-9f91c2e8dda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:44.757311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5af3b060-19be-4bec-88f3-9f91c2e8dda5 None None] MFA Rules not processed for user `e9afe6a084544b5bbe794ed8b0b0e345`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:44.758554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5af3b060-19be-4bec-88f3-9f91c2e8dda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:44.776446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:44.827662 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1291/2537] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:44.842366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86879528-3542-4400-a4c0-5b20ed90a81d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:44.844197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-86879528-3542-4400-a4c0-5b20ed90a81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:44.902345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86879528-3542-4400-a4c0-5b20ed90a81d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:44.906026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b35ca-b08b-4e37-bc24-c44a48670ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:44.906627 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b35ca-b08b-4e37-bc24-c44a48670ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:44.906908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b35ca-b08b-4e37-bc24-c44a48670ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:44.907183 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b35ca-b08b-4e37-bc24-c44a48670ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:44.916045 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b35ca-b08b-4e37-bc24-c44a48670ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:44.917509 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b35ca-b08b-4e37-bc24-c44a48670ce2 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:44.926807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1247/2538] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:44 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:32:45.002943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b060-19be-4bec-88f3-9f91c2e8dda5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:45.012955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b060-19be-4bec-88f3-9f91c2e8dda5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:45.016548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748b73c-8b14-4415-b024-a45e8b15309d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:45.017192 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748b73c-8b14-4415-b024-a45e8b15309d service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:45.017468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748b73c-8b14-4415-b024-a45e8b15309d service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:45.017734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748b73c-8b14-4415-b024-a45e8b15309d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:45.076829 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748b73c-8b14-4415-b024-a45e8b15309d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:45.078300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748b73c-8b14-4415-b024-a45e8b15309d service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:45.087566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1292/2539] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:45 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:32:49.166233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b35ca-b08b-4e37-bc24-c44a48670ce2 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:49.227967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b35ca-b08b-4e37-bc24-c44a48670ce2 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:49.232522 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981c62a-afd5-4b34-ba51-4585001a28e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:49.233273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981c62a-afd5-4b34-ba51-4585001a28e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:49.233558 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981c62a-afd5-4b34-ba51-4585001a28e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:49.233827 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981c62a-afd5-4b34-ba51-4585001a28e1 admin admin] PATH_INFO: `/v3/users/9bbf6251d1e14bbeb5c9a5e9b10122cc` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:49.234971 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981c62a-afd5-4b34-ba51-4585001a28e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bbf6251d1e14bbeb5c9a5e9b10122cc)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:49.236916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981c62a-afd5-4b34-ba51-4585001a28e1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:49.282709 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b981c62a-afd5-4b34-ba51-4585001a28e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bbf6251d1e14bbeb5c9a5e9b10122cc'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:49.283291 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b981c62a-afd5-4b34-ba51-4585001a28e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bbf6251d1e14bbeb5c9a5e9b10122cc'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:49.283894 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b981c62a-afd5-4b34-ba51-4585001a28e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bbf6251d1e14bbeb5c9a5e9b10122cc'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:49.290716 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b981c62a-afd5-4b34-ba51-4585001a28e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bbf6251d1e14bbeb5c9a5e9b10122cc'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:49.291817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:49.304971 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b981c62a-afd5-4b34-ba51-4585001a28e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bbf6251d1e14bbeb5c9a5e9b10122cc'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:49.317373 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1248/2540] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:32:49 2022] DELETE /identity/v3/users/9bbf6251d1e14bbeb5c9a5e9b10122cc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:49.322719 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d423f1b-0d89-4361-b17a-7dcfbff19748 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:49.323261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d423f1b-0d89-4361-b17a-7dcfbff19748 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:49.323261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d423f1b-0d89-4361-b17a-7dcfbff19748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:49.342349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2d423f1b-0d89-4361-b17a-7dcfbff19748 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:49.343546 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2d423f1b-0d89-4361-b17a-7dcfbff19748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:49.401163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1293/2541] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:49.410831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981c62a-afd5-4b34-ba51-4585001a28e1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:49.412287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b981c62a-afd5-4b34-ba51-4585001a28e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:49.469702 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981c62a-afd5-4b34-ba51-4585001a28e1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:49.473488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c702ee3-e13a-4aeb-b376-e82f68133819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:49.474095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c702ee3-e13a-4aeb-b376-e82f68133819 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:49.474683 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c702ee3-e13a-4aeb-b376-e82f68133819 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:49.475007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c702ee3-e13a-4aeb-b376-e82f68133819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:49.485204 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c702ee3-e13a-4aeb-b376-e82f68133819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:49.486632 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c702ee3-e13a-4aeb-b376-e82f68133819 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:49.496943 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1249/2542] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:32:49.769423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d423f1b-0d89-4361-b17a-7dcfbff19748 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:49.770851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2d423f1b-0d89-4361-b17a-7dcfbff19748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:49.782810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d423f1b-0d89-4361-b17a-7dcfbff19748 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:49.787836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:49.788550 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:49.788940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:49.789215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] PATH_INFO: `/v3/projects/19b2f21cf85b4672983e5de3af807343` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:49.790364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b2f21cf85b4672983e5de3af807343)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:49.792309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:49.840159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b2f21cf85b4672983e5de3af807343', 'request_id': 'req-e4fedad0-f934-4910-b03f-dd9a68314efe'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:49.841363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:49.850055 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b2f21cf85b4672983e5de3af807343', 'request_id': 'req-e4fedad0-f934-4910-b03f-dd9a68314efe'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:49.859164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b2f21cf85b4672983e5de3af807343', 'request_id': 'req-e4fedad0-f934-4910-b03f-dd9a68314efe'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:49.871874 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] The token cache is being invalidate because project 19b2f21cf85b4672983e5de3af807343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:32:49.872158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:49.872888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:49.874376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1294/2543] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:32:49 2022] DELETE /identity/v3/projects/19b2f21cf85b4672983e5de3af807343 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:49.878503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c702ee3-e13a-4aeb-b376-e82f68133819 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:49.889207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c702ee3-e13a-4aeb-b376-e82f68133819 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:49.945925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a07afc-b674-4731-8ef3-365d6eb0049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:49.946659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a07afc-b674-4731-8ef3-365d6eb0049e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:49.946829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a07afc-b674-4731-8ef3-365d6eb0049e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:49.947354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a07afc-b674-4731-8ef3-365d6eb0049e admin admin] PATH_INFO: `/v3/users/e9afe6a084544b5bbe794ed8b0b0e345` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:49.948475 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a07afc-b674-4731-8ef3-365d6eb0049e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9afe6a084544b5bbe794ed8b0b0e345)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:49.950433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a07afc-b674-4731-8ef3-365d6eb0049e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:49.999159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-06a07afc-b674-4731-8ef3-365d6eb0049e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9afe6a084544b5bbe794ed8b0b0e345'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:49.999814 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-06a07afc-b674-4731-8ef3-365d6eb0049e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9afe6a084544b5bbe794ed8b0b0e345'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:50.000424 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-06a07afc-b674-4731-8ef3-365d6eb0049e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9afe6a084544b5bbe794ed8b0b0e345'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:50.008189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-06a07afc-b674-4731-8ef3-365d6eb0049e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9afe6a084544b5bbe794ed8b0b0e345'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:50.021132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-06a07afc-b674-4731-8ef3-365d6eb0049e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9afe6a084544b5bbe794ed8b0b0e345'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:50.024876 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:50.037293 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1250/2544] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:32:49 2022] DELETE /identity/v3/users/e9afe6a084544b5bbe794ed8b0b0e345 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:50.313999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:50.315478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:50.332194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fedad0-f934-4910-b03f-dd9a68314efe admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:50.389992 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:50.390594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:50.390874 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:50.391147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0 admin admin] PATH_INFO: `/v3/projects/4559940b0c544472a4ea908bbee8d240` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:50.392259 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4559940b0c544472a4ea908bbee8d240)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:50.394201 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:50.442325 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4559940b0c544472a4ea908bbee8d240', 'request_id': 'req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:50.448560 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4559940b0c544472a4ea908bbee8d240', 'request_id': 'req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:50.456256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4559940b0c544472a4ea908bbee8d240', 'request_id': 'req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:50.468324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0 admin admin] The token cache is being invalidate because project 4559940b0c544472a4ea908bbee8d240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:32:50.468614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:50.469288 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a9e9d2f-575e-43c1-a7d2-f2826cd18ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:50.470776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1295/2545] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:32:50 2022] DELETE /identity/v3/projects/4559940b0c544472a4ea908bbee8d240 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:50.476213 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2478a8-7937-405f-9169-c481eae8ac2c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:50.476704 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2478a8-7937-405f-9169-c481eae8ac2c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:50.476818 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2478a8-7937-405f-9169-c481eae8ac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:50.496208 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1f2478a8-7937-405f-9169-c481eae8ac2c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:50.497663 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1f2478a8-7937-405f-9169-c481eae8ac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:50.560923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1251/2546] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:50.568940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49e1e9-4861-4aa5-b346-3ce94e3be217 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:50.569224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49e1e9-4861-4aa5-b346-3ce94e3be217 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:50.569501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49e1e9-4861-4aa5-b346-3ce94e3be217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:50.589883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7a49e1e9-4861-4aa5-b346-3ce94e3be217 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:50.591088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7a49e1e9-4861-4aa5-b346-3ce94e3be217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:50.599045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1296/2547] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:50.604189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2478a8-7937-405f-9169-c481eae8ac2c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:50.614083 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2478a8-7937-405f-9169-c481eae8ac2c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:50.619415 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eec729-eead-4b84-94c9-b3d918fad32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:50.620036 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eec729-eead-4b84-94c9-b3d918fad32b admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:50.620314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eec729-eead-4b84-94c9-b3d918fad32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:50.620582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eec729-eead-4b84-94c9-b3d918fad32b admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:50.621260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eec729-eead-4b84-94c9-b3d918fad32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:32:50.621560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eec729-eead-4b84-94c9-b3d918fad32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:50.623193 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eec729-eead-4b84-94c9-b3d918fad32b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:50.635453 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1252/2548] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:32:50.639747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49e1e9-4861-4aa5-b346-3ce94e3be217 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:50.649835 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49e1e9-4861-4aa5-b346-3ce94e3be217 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:50.654301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a261d-e9c2-43a9-899c-13357e5ce94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:50.654911 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a261d-e9c2-43a9-899c-13357e5ce94b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:50.655184 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a261d-e9c2-43a9-899c-13357e5ce94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:50.655448 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a261d-e9c2-43a9-899c-13357e5ce94b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:50.656074 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a261d-e9c2-43a9-899c-13357e5ce94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:50.657977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a261d-e9c2-43a9-899c-13357e5ce94b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:50.686173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1297/2549] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:32:50 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:32:50.690412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eec729-eead-4b84-94c9-b3d918fad32b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:50.700959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eec729-eead-4b84-94c9-b3d918fad32b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:50.758268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aef0cf-736c-4f43-a9cc-1d48ec13dc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:50.758872 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef0cf-736c-4f43-a9cc-1d48ec13dc55 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:50.759148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef0cf-736c-4f43-a9cc-1d48ec13dc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:50.759413 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef0cf-736c-4f43-a9cc-1d48ec13dc55 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:50.760042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aef0cf-736c-4f43-a9cc-1d48ec13dc55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:50.761981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aef0cf-736c-4f43-a9cc-1d48ec13dc55 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:50.783625 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1253/2550] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:32:50 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:32:50.787789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a261d-e9c2-43a9-899c-13357e5ce94b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:50.798007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a261d-e9c2-43a9-899c-13357e5ce94b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:50.802735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d6793-a20a-4d44-b7fe-6c3a5317bd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:50.803863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d6793-a20a-4d44-b7fe-6c3a5317bd8c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:50.804140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d6793-a20a-4d44-b7fe-6c3a5317bd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:50.804406 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d6793-a20a-4d44-b7fe-6c3a5317bd8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:50.805065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d6793-a20a-4d44-b7fe-6c3a5317bd8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:50.806639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d6793-a20a-4d44-b7fe-6c3a5317bd8c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:50.816725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1298/2551] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:50.821273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aef0cf-736c-4f43-a9cc-1d48ec13dc55 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:50.831484 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aef0cf-736c-4f43-a9cc-1d48ec13dc55 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:50.836528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ed082-cb28-4d61-8d10-2512466909d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:50.837146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ed082-cb28-4d61-8d10-2512466909d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:50.837421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ed082-cb28-4d61-8d10-2512466909d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:50.837690 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ed082-cb28-4d61-8d10-2512466909d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:50.838344 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ed082-cb28-4d61-8d10-2512466909d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:50.839902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ed082-cb28-4d61-8d10-2512466909d4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:50.850811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1254/2552] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:50.858510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d6793-a20a-4d44-b7fe-6c3a5317bd8c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:50.869105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d6793-a20a-4d44-b7fe-6c3a5317bd8c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:50.873691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d924cb2-4888-4577-bc7e-8f20c9ab678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:50.874338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d924cb2-4888-4577-bc7e-8f20c9ab678c admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:50.874620 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d924cb2-4888-4577-bc7e-8f20c9ab678c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:50.874899 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d924cb2-4888-4577-bc7e-8f20c9ab678c admin admin] PATH_INFO: `/v3/projects/156cd6eba3b4477d8f215e263b7bb918/users/e0e8b4cb874b491cbef9fb140656997a/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:50.889362 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d924cb2-4888-4577-bc7e-8f20c9ab678c admin admin] RBAC: Authorizing `identity:create_grant(project_id=156cd6eba3b4477d8f215e263b7bb918, user_id=e0e8b4cb874b491cbef9fb140656997a, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:50.892037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d924cb2-4888-4577-bc7e-8f20c9ab678c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:50.904867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1299/2553] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:32:50 2022] PUT /identity/v3/projects/156cd6eba3b4477d8f215e263b7bb918/users/e0e8b4cb874b491cbef9fb140656997a/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:50.917570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f37c98-7ef1-4743-a7d7-9b4739499bd1 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:50.917961 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f37c98-7ef1-4743-a7d7-9b4739499bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:50.918120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f37c98-7ef1-4743-a7d7-9b4739499bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:50.950577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-87f37c98-7ef1-4743-a7d7-9b4739499bd1 None None] MFA Rules not processed for user `e0e8b4cb874b491cbef9fb140656997a`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:50.951808 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-87f37c98-7ef1-4743-a7d7-9b4739499bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:51.004488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:51.023383 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1255/2554] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:51.028109 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d924cb2-4888-4577-bc7e-8f20c9ab678c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:51.034703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:51.101297 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d924cb2-4888-4577-bc7e-8f20c9ab678c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:51.105965 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5294bc-9730-43c0-aa16-69f043ac6b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:51.106563 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5294bc-9730-43c0-aa16-69f043ac6b51 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:51.106837 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5294bc-9730-43c0-aa16-69f043ac6b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:51.107105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5294bc-9730-43c0-aa16-69f043ac6b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:51.107727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5294bc-9730-43c0-aa16-69f043ac6b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:51.109631 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5294bc-9730-43c0-aa16-69f043ac6b51 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:51.135882 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1300/2555] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:32:51 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:32:51.139996 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f37c98-7ef1-4743-a7d7-9b4739499bd1 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:51.151368 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f37c98-7ef1-4743-a7d7-9b4739499bd1 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:51.207972 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5231c5-85fd-4452-9754-73a0f707aa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:51.208495 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5231c5-85fd-4452-9754-73a0f707aa38 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:51.208820 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5231c5-85fd-4452-9754-73a0f707aa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:51.209094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5231c5-85fd-4452-9754-73a0f707aa38 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:51.210340 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5231c5-85fd-4452-9754-73a0f707aa38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:51.212257 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5231c5-85fd-4452-9754-73a0f707aa38 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:51.233189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1256/2556] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:32:51 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:32:51.237335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5294bc-9730-43c0-aa16-69f043ac6b51 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:51.247954 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5294bc-9730-43c0-aa16-69f043ac6b51 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:51.252496 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de41f8-21e7-4dec-ab63-60b85cf8c69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:51.253132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de41f8-21e7-4dec-ab63-60b85cf8c69a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:51.253409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de41f8-21e7-4dec-ab63-60b85cf8c69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:51.253678 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de41f8-21e7-4dec-ab63-60b85cf8c69a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:51.254311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de41f8-21e7-4dec-ab63-60b85cf8c69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:51.255877 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de41f8-21e7-4dec-ab63-60b85cf8c69a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:51.266891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1301/2557] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:51.270945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5231c5-85fd-4452-9754-73a0f707aa38 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:51.280875 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5231c5-85fd-4452-9754-73a0f707aa38 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:51.285390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92c080-a2dd-4cfc-981b-3a4853717478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:51.286028 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c080-a2dd-4cfc-981b-3a4853717478 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:51.286303 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c080-a2dd-4cfc-981b-3a4853717478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:51.286572 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c080-a2dd-4cfc-981b-3a4853717478 admin admin] PATH_INFO: `/v3/projects/db36f178b5bc41679e28a244bdc1b653/users/e3f92d4a197a470495ea5c8d0881fb6a/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:51.301245 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92c080-a2dd-4cfc-981b-3a4853717478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db36f178b5bc41679e28a244bdc1b653, user_id=e3f92d4a197a470495ea5c8d0881fb6a, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:51.304528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92c080-a2dd-4cfc-981b-3a4853717478 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:51.317180 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1257/2558] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:32:51 2022] PUT /identity/v3/projects/db36f178b5bc41679e28a244bdc1b653/users/e3f92d4a197a470495ea5c8d0881fb6a/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:51.321674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de41f8-21e7-4dec-ab63-60b85cf8c69a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:51.331696 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de41f8-21e7-4dec-ab63-60b85cf8c69a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:51.387789 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7537002-ff22-4ec4-bb20-ccfeaedec5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:51.388435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7537002-ff22-4ec4-bb20-ccfeaedec5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:51.388645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7537002-ff22-4ec4-bb20-ccfeaedec5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:51.388944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7537002-ff22-4ec4-bb20-ccfeaedec5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:51.389571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7537002-ff22-4ec4-bb20-ccfeaedec5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:51.391138 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7537002-ff22-4ec4-bb20-ccfeaedec5b6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:51.400870 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1302/2559] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:51.405081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92c080-a2dd-4cfc-981b-3a4853717478 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:51.415411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92c080-a2dd-4cfc-981b-3a4853717478 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:51.420039 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fef62-805a-4252-8fc4-86eb628a35e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:51.420739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fef62-805a-4252-8fc4-86eb628a35e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:51.421023 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fef62-805a-4252-8fc4-86eb628a35e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:51.421296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fef62-805a-4252-8fc4-86eb628a35e7 admin admin] PATH_INFO: `/v3/projects/db36f178b5bc41679e28a244bdc1b653/users/e3f92d4a197a470495ea5c8d0881fb6a/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:51.423225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fef62-805a-4252-8fc4-86eb628a35e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db36f178b5bc41679e28a244bdc1b653, user_id=e3f92d4a197a470495ea5c8d0881fb6a, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:51.425933 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fef62-805a-4252-8fc4-86eb628a35e7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:51.436680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1258/2560] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:32:51 2022] PUT /identity/v3/projects/db36f178b5bc41679e28a244bdc1b653/users/e3f92d4a197a470495ea5c8d0881fb6a/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:51.447640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e297a61-8947-4b0d-af15-149c9ee4de87 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:51.447928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e297a61-8947-4b0d-af15-149c9ee4de87 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:51.448204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e297a61-8947-4b0d-af15-149c9ee4de87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:51.475328 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3e297a61-8947-4b0d-af15-149c9ee4de87 None None] MFA Rules not processed for user `e3f92d4a197a470495ea5c8d0881fb6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:51.476472 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3e297a61-8947-4b0d-af15-149c9ee4de87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:51.540741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:51.544512 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1303/2561] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:51.556904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fef62-805a-4252-8fc4-86eb628a35e7 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:51.558712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-022fef62-805a-4252-8fc4-86eb628a35e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:51.618134 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fef62-805a-4252-8fc4-86eb628a35e7 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:51.621930 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da98f9-1842-43b5-82a3-3408d466ceee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:51.622528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da98f9-1842-43b5-82a3-3408d466ceee service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:51.622804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da98f9-1842-43b5-82a3-3408d466ceee service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:51.623093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da98f9-1842-43b5-82a3-3408d466ceee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:51.632298 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da98f9-1842-43b5-82a3-3408d466ceee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:51.633848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da98f9-1842-43b5-82a3-3408d466ceee service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:51.643484 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1259/2562] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:32:51.717775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e297a61-8947-4b0d-af15-149c9ee4de87 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:51.728123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e297a61-8947-4b0d-af15-149c9ee4de87 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:51.731779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6bebb-8bca-4b3f-b8d7-edb52cff5816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:51.732419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6bebb-8bca-4b3f-b8d7-edb52cff5816 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:51.732711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6bebb-8bca-4b3f-b8d7-edb52cff5816 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:51.733021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6bebb-8bca-4b3f-b8d7-edb52cff5816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:51.790217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6bebb-8bca-4b3f-b8d7-edb52cff5816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:51.791649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6bebb-8bca-4b3f-b8d7-edb52cff5816 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:51.801506 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1304/2563] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:32:52.067385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da98f9-1842-43b5-82a3-3408d466ceee service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:52.113595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:52.130454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da98f9-1842-43b5-82a3-3408d466ceee service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:52.135717 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bdd86-92d9-45d2-83a2-e4cd1c227ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:52.136341 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bdd86-92d9-45d2-83a2-e4cd1c227ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:52.136614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bdd86-92d9-45d2-83a2-e4cd1c227ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:52.136909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bdd86-92d9-45d2-83a2-e4cd1c227ade admin admin] PATH_INFO: `/v3/users/e0e8b4cb874b491cbef9fb140656997a` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:52.138210 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bdd86-92d9-45d2-83a2-e4cd1c227ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e8b4cb874b491cbef9fb140656997a)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:52.140318 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bdd86-92d9-45d2-83a2-e4cd1c227ade admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:52.188540 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-422bdd86-92d9-45d2-83a2-e4cd1c227ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e8b4cb874b491cbef9fb140656997a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.189226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-422bdd86-92d9-45d2-83a2-e4cd1c227ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e8b4cb874b491cbef9fb140656997a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.189820 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-422bdd86-92d9-45d2-83a2-e4cd1c227ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e8b4cb874b491cbef9fb140656997a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.197617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-422bdd86-92d9-45d2-83a2-e4cd1c227ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e8b4cb874b491cbef9fb140656997a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.209968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-422bdd86-92d9-45d2-83a2-e4cd1c227ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e8b4cb874b491cbef9fb140656997a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.222765 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1260/2564] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:32:52 2022] DELETE /identity/v3/users/e0e8b4cb874b491cbef9fb140656997a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:52.227462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d440c-e86d-4f3a-a613-4491546c9ad7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:52.227748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d440c-e86d-4f3a-a613-4491546c9ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:52.228023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d440c-e86d-4f3a-a613-4491546c9ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:52.248233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a87d440c-e86d-4f3a-a613-4491546c9ad7 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:52.249473 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a87d440c-e86d-4f3a-a613-4491546c9ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:52.308028 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1305/2565] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:32:52.317677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bdd86-92d9-45d2-83a2-e4cd1c227ade admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:52.319723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-422bdd86-92d9-45d2-83a2-e4cd1c227ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:52.377815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bdd86-92d9-45d2-83a2-e4cd1c227ade admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:52.381480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbef15d-8fa0-49cc-a2ee-c51f831be75c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:52.382082 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbef15d-8fa0-49cc-a2ee-c51f831be75c service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:52.382362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbef15d-8fa0-49cc-a2ee-c51f831be75c service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:52.382633 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbef15d-8fa0-49cc-a2ee-c51f831be75c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:52.391743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbef15d-8fa0-49cc-a2ee-c51f831be75c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:52.393284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbef15d-8fa0-49cc-a2ee-c51f831be75c service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:52.402661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1261/2566] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:32:52.678783 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d440c-e86d-4f3a-a613-4491546c9ad7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:52.680665 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a87d440c-e86d-4f3a-a613-4491546c9ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:52.693594 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d440c-e86d-4f3a-a613-4491546c9ad7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:52.699060 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:52.699866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:52.700143 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:52.700442 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] PATH_INFO: `/v3/projects/156cd6eba3b4477d8f215e263b7bb918` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:52.701849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=156cd6eba3b4477d8f215e263b7bb918)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:52.704037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:52.783827 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '156cd6eba3b4477d8f215e263b7bb918', 'request_id': 'req-5101c93a-e6d4-48f5-9e7f-0812570134dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.790441 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '156cd6eba3b4477d8f215e263b7bb918', 'request_id': 'req-5101c93a-e6d4-48f5-9e7f-0812570134dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.801044 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '156cd6eba3b4477d8f215e263b7bb918', 'request_id': 'req-5101c93a-e6d4-48f5-9e7f-0812570134dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.816372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] The token cache is being invalidate because project 156cd6eba3b4477d8f215e263b7bb918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:32:52.816864 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.817604 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.821700 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1306/2567] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:32:52 2022] DELETE /identity/v3/projects/156cd6eba3b4477d8f215e263b7bb918 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:52.826059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbef15d-8fa0-49cc-a2ee-c51f831be75c service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:52.837123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbef15d-8fa0-49cc-a2ee-c51f831be75c service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:52.900925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b850f68-b6a4-4aa4-a3fe-a73d266c1a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:52.901554 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850f68-b6a4-4aa4-a3fe-a73d266c1a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:52.901832 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850f68-b6a4-4aa4-a3fe-a73d266c1a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:52.902099 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850f68-b6a4-4aa4-a3fe-a73d266c1a5d admin admin] PATH_INFO: `/v3/users/e3f92d4a197a470495ea5c8d0881fb6a` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:52.903199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b850f68-b6a4-4aa4-a3fe-a73d266c1a5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f92d4a197a470495ea5c8d0881fb6a)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:52.905226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b850f68-b6a4-4aa4-a3fe-a73d266c1a5d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:52.915762 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:52.952916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b850f68-b6a4-4aa4-a3fe-a73d266c1a5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f92d4a197a470495ea5c8d0881fb6a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.953560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b850f68-b6a4-4aa4-a3fe-a73d266c1a5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f92d4a197a470495ea5c8d0881fb6a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.954164 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b850f68-b6a4-4aa4-a3fe-a73d266c1a5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f92d4a197a470495ea5c8d0881fb6a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.962106 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b850f68-b6a4-4aa4-a3fe-a73d266c1a5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f92d4a197a470495ea5c8d0881fb6a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.974721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5b850f68-b6a4-4aa4-a3fe-a73d266c1a5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f92d4a197a470495ea5c8d0881fb6a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:52.988264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1262/2568] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:32:52 2022] DELETE /identity/v3/users/e3f92d4a197a470495ea5c8d0881fb6a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:53.273317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:53.274863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:53.290678 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101c93a-e6d4-48f5-9e7f-0812570134dc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:53.315018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:53.364427 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af19b3a-4c59-4485-bca4-34dbb5ff0027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:53.365087 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af19b3a-4c59-4485-bca4-34dbb5ff0027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:53.365365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af19b3a-4c59-4485-bca4-34dbb5ff0027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:53.365669 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af19b3a-4c59-4485-bca4-34dbb5ff0027 admin admin] PATH_INFO: `/v3/projects/db36f178b5bc41679e28a244bdc1b653` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:53.366799 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af19b3a-4c59-4485-bca4-34dbb5ff0027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db36f178b5bc41679e28a244bdc1b653)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:53.368715 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af19b3a-4c59-4485-bca4-34dbb5ff0027 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:53.415668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5af19b3a-4c59-4485-bca4-34dbb5ff0027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db36f178b5bc41679e28a244bdc1b653', 'request_id': 'req-5af19b3a-4c59-4485-bca4-34dbb5ff0027'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:53.421435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5af19b3a-4c59-4485-bca4-34dbb5ff0027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db36f178b5bc41679e28a244bdc1b653', 'request_id': 'req-5af19b3a-4c59-4485-bca4-34dbb5ff0027'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:53.428817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5af19b3a-4c59-4485-bca4-34dbb5ff0027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db36f178b5bc41679e28a244bdc1b653', 'request_id': 'req-5af19b3a-4c59-4485-bca4-34dbb5ff0027'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:53.441021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5af19b3a-4c59-4485-bca4-34dbb5ff0027 admin admin] The token cache is being invalidate because project db36f178b5bc41679e28a244bdc1b653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:32:53.441307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5af19b3a-4c59-4485-bca4-34dbb5ff0027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:53.441944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5af19b3a-4c59-4485-bca4-34dbb5ff0027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:32:53.443515 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1307/2569] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:32:53 2022] DELETE /identity/v3/projects/db36f178b5bc41679e28a244bdc1b653 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:53.449292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f229bf3-047b-4f07-b6e5-5efb7c713d47 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:53.449669 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f229bf3-047b-4f07-b6e5-5efb7c713d47 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:53.449949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f229bf3-047b-4f07-b6e5-5efb7c713d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:53.474967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9f229bf3-047b-4f07-b6e5-5efb7c713d47 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:53.476453 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9f229bf3-047b-4f07-b6e5-5efb7c713d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:53.536411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1263/2570] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:53.545571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a243c-9e10-4d40-858a-191bd10cd198 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:53.545854 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a243c-9e10-4d40-858a-191bd10cd198 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:53.546126 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a243c-9e10-4d40-858a-191bd10cd198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:53.567655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-507a243c-9e10-4d40-858a-191bd10cd198 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:53.569590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-507a243c-9e10-4d40-858a-191bd10cd198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:53.577995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1308/2571] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:53.582309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f229bf3-047b-4f07-b6e5-5efb7c713d47 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:53.592221 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f229bf3-047b-4f07-b6e5-5efb7c713d47 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:53.596838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad9729-f1df-4313-9e68-dfd5c749115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:53.597442 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9729-f1df-4313-9e68-dfd5c749115f admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:53.597724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9729-f1df-4313-9e68-dfd5c749115f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:53.597996 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9729-f1df-4313-9e68-dfd5c749115f admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:53.598640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad9729-f1df-4313-9e68-dfd5c749115f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:32:53.598942 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad9729-f1df-4313-9e68-dfd5c749115f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:53.600533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad9729-f1df-4313-9e68-dfd5c749115f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:53.612377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1264/2572] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:32:53.618869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a243c-9e10-4d40-858a-191bd10cd198 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:53.629167 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a243c-9e10-4d40-858a-191bd10cd198 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:53.635056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb3b7-9a6f-450a-9578-e0718b76efed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:53.635819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb3b7-9a6f-450a-9578-e0718b76efed admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:53.636093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb3b7-9a6f-450a-9578-e0718b76efed admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:53.636361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb3b7-9a6f-450a-9578-e0718b76efed admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:53.637134 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cb3b7-9a6f-450a-9578-e0718b76efed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:53.639088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cb3b7-9a6f-450a-9578-e0718b76efed admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:53.669480 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1309/2573] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:32:53 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:32:53.675253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad9729-f1df-4313-9e68-dfd5c749115f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:53.686447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad9729-f1df-4313-9e68-dfd5c749115f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:53.751096 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90339b-f833-41fd-a0f1-344f0349625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:53.751704 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90339b-f833-41fd-a0f1-344f0349625a admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:53.751980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90339b-f833-41fd-a0f1-344f0349625a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:53.752246 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90339b-f833-41fd-a0f1-344f0349625a admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:53.752916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90339b-f833-41fd-a0f1-344f0349625a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:53.754929 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90339b-f833-41fd-a0f1-344f0349625a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:53.784250 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1265/2574] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:32:53 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:32:53.790141 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb3b7-9a6f-450a-9578-e0718b76efed admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:53.806987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb3b7-9a6f-450a-9578-e0718b76efed admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:53.816611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b791a-ff85-4ed6-8dc7-ad67d66bb3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:53.821856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b791a-ff85-4ed6-8dc7-ad67d66bb3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:53.822354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b791a-ff85-4ed6-8dc7-ad67d66bb3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:53.822628 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b791a-ff85-4ed6-8dc7-ad67d66bb3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:53.823336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b791a-ff85-4ed6-8dc7-ad67d66bb3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:53.824986 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b791a-ff85-4ed6-8dc7-ad67d66bb3d2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:53.841572 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1310/2575] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:32:53.852587 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90339b-f833-41fd-a0f1-344f0349625a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:53.853433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:53.857620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90339b-f833-41fd-a0f1-344f0349625a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:53.864514 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e3a73-82df-4576-84b8-eedc1809ecfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:53.865225 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3a73-82df-4576-84b8-eedc1809ecfa admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:53.865732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3a73-82df-4576-84b8-eedc1809ecfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:53.866817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3a73-82df-4576-84b8-eedc1809ecfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:53.867577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e3a73-82df-4576-84b8-eedc1809ecfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:53.869478 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e3a73-82df-4576-84b8-eedc1809ecfa admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:53.881997 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1266/2576] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:53.886472 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b791a-ff85-4ed6-8dc7-ad67d66bb3d2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:53.897612 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b791a-ff85-4ed6-8dc7-ad67d66bb3d2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:53.902459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfc34f-6e1d-4604-a540-e2515c573220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:53.903233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfc34f-6e1d-4604-a540-e2515c573220 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:53.903611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfc34f-6e1d-4604-a540-e2515c573220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:53.904007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfc34f-6e1d-4604-a540-e2515c573220 admin admin] PATH_INFO: `/v3/projects/bb94909a31d94954a6b3790406ae0e14/users/fd7bdc96d5864560b20a0fe4354f7239/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:53.921273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfc34f-6e1d-4604-a540-e2515c573220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb94909a31d94954a6b3790406ae0e14, user_id=fd7bdc96d5864560b20a0fe4354f7239, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:53.925653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfc34f-6e1d-4604-a540-e2515c573220 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:53.942572 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1311/2577] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:32:53 2022] PUT /identity/v3/projects/bb94909a31d94954a6b3790406ae0e14/users/fd7bdc96d5864560b20a0fe4354f7239/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:53.953935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125fb6f-ec75-449b-afe5-3d65ffa7ae84 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:53.954214 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125fb6f-ec75-449b-afe5-3d65ffa7ae84 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:53.954486 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125fb6f-ec75-449b-afe5-3d65ffa7ae84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:53.984434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0125fb6f-ec75-449b-afe5-3d65ffa7ae84 None None] MFA Rules not processed for user `fd7bdc96d5864560b20a0fe4354f7239`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:53.985992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0125fb6f-ec75-449b-afe5-3d65ffa7ae84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:54.064310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1267/2578] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:54.069432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfc34f-6e1d-4604-a540-e2515c573220 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:54.126535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:54.147849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfc34f-6e1d-4604-a540-e2515c573220 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:54.152723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f087e0-fb17-4231-8ec9-74eb018c0b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:54.153326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f087e0-fb17-4231-8ec9-74eb018c0b0e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:54.153598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f087e0-fb17-4231-8ec9-74eb018c0b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:54.153867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f087e0-fb17-4231-8ec9-74eb018c0b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:54.154497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f087e0-fb17-4231-8ec9-74eb018c0b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:54.156393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f087e0-fb17-4231-8ec9-74eb018c0b0e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:54.198928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1312/2579] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:32:54 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:32:54.204001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125fb6f-ec75-449b-afe5-3d65ffa7ae84 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:54.218598 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125fb6f-ec75-449b-afe5-3d65ffa7ae84 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:54.320161 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5095e-84e9-43bb-bf03-e56855535b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:54.320807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5095e-84e9-43bb-bf03-e56855535b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:54.321085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5095e-84e9-43bb-bf03-e56855535b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:54.321364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5095e-84e9-43bb-bf03-e56855535b78 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:54.322001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5095e-84e9-43bb-bf03-e56855535b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:54.324289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5095e-84e9-43bb-bf03-e56855535b78 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:54.348298 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1268/2580] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:32:54 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:32:54.352413 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f087e0-fb17-4231-8ec9-74eb018c0b0e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:54.363461 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f087e0-fb17-4231-8ec9-74eb018c0b0e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:54.369409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893e766-cd45-4013-8597-5b50d3f981ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:54.370026 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893e766-cd45-4013-8597-5b50d3f981ce admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:54.370304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893e766-cd45-4013-8597-5b50d3f981ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:54.370577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893e766-cd45-4013-8597-5b50d3f981ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:54.371240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893e766-cd45-4013-8597-5b50d3f981ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:54.372863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893e766-cd45-4013-8597-5b50d3f981ce admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:54.384859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1313/2581] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:54.389127 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5095e-84e9-43bb-bf03-e56855535b78 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:54.400644 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5095e-84e9-43bb-bf03-e56855535b78 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:54.405674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec0418-5cf5-47e4-8445-aa20cea2d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:54.406294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec0418-5cf5-47e4-8445-aa20cea2d630 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:54.406664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec0418-5cf5-47e4-8445-aa20cea2d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:54.406963 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec0418-5cf5-47e4-8445-aa20cea2d630 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:54.407618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec0418-5cf5-47e4-8445-aa20cea2d630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:54.409269 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec0418-5cf5-47e4-8445-aa20cea2d630 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:54.420414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1269/2582] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:54.424923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893e766-cd45-4013-8597-5b50d3f981ce admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:54.436651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893e766-cd45-4013-8597-5b50d3f981ce admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:54.441958 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b73967-2d9a-4e5f-af70-5e54191ae9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:54.442658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b73967-2d9a-4e5f-af70-5e54191ae9db admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:54.442931 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b73967-2d9a-4e5f-af70-5e54191ae9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:54.443204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b73967-2d9a-4e5f-af70-5e54191ae9db admin admin] PATH_INFO: `/v3/projects/1e7de0c969964507a6edc7c00cbdcf0f/users/74e1a3e7f316467c8893093721cab822/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:54.465516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b73967-2d9a-4e5f-af70-5e54191ae9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7de0c969964507a6edc7c00cbdcf0f, user_id=74e1a3e7f316467c8893093721cab822, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:54.468736 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b73967-2d9a-4e5f-af70-5e54191ae9db admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:54.483345 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1314/2583] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:32:54 2022] PUT /identity/v3/projects/1e7de0c969964507a6edc7c00cbdcf0f/users/74e1a3e7f316467c8893093721cab822/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:54.494833 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665226a2-0016-4e6a-89cc-b01fdc087695 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:54.495231 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665226a2-0016-4e6a-89cc-b01fdc087695 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:54.495610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665226a2-0016-4e6a-89cc-b01fdc087695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:54.525840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-665226a2-0016-4e6a-89cc-b01fdc087695 None None] MFA Rules not processed for user `74e1a3e7f316467c8893093721cab822`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:54.527063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-665226a2-0016-4e6a-89cc-b01fdc087695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:54.578931 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:54.598697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1270/2584] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:54.604083 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b73967-2d9a-4e5f-af70-5e54191ae9db admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:54.669941 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b73967-2d9a-4e5f-af70-5e54191ae9db admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:54.674560 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728a9c9-bb2a-4dca-aa39-0ecac5753d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:54.675160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728a9c9-bb2a-4dca-aa39-0ecac5753d60 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:54.675428 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728a9c9-bb2a-4dca-aa39-0ecac5753d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:54.675693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728a9c9-bb2a-4dca-aa39-0ecac5753d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:54.676324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728a9c9-bb2a-4dca-aa39-0ecac5753d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:54.678770 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728a9c9-bb2a-4dca-aa39-0ecac5753d60 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:54.706294 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1315/2585] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:32:54 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:32:54.710645 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665226a2-0016-4e6a-89cc-b01fdc087695 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:54.721838 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665226a2-0016-4e6a-89cc-b01fdc087695 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:54.780541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26f9ae-6acd-45d3-9c60-f05696da5d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:54.781189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26f9ae-6acd-45d3-9c60-f05696da5d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:54.781471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26f9ae-6acd-45d3-9c60-f05696da5d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:54.781768 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26f9ae-6acd-45d3-9c60-f05696da5d7d admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:54.782398 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26f9ae-6acd-45d3-9c60-f05696da5d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:54.784330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26f9ae-6acd-45d3-9c60-f05696da5d7d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:54.807948 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1271/2586] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:32:54 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:32:54.811947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728a9c9-bb2a-4dca-aa39-0ecac5753d60 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:54.822904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728a9c9-bb2a-4dca-aa39-0ecac5753d60 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:54.827673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89fc07-6a25-470a-8dad-1d7d78e5a41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:54.828273 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89fc07-6a25-470a-8dad-1d7d78e5a41e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:54.828557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89fc07-6a25-470a-8dad-1d7d78e5a41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:54.828860 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89fc07-6a25-470a-8dad-1d7d78e5a41e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:54.829553 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89fc07-6a25-470a-8dad-1d7d78e5a41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:54.831118 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89fc07-6a25-470a-8dad-1d7d78e5a41e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:54.841904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1316/2587] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:54.846338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26f9ae-6acd-45d3-9c60-f05696da5d7d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:54.856892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26f9ae-6acd-45d3-9c60-f05696da5d7d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:54.861536 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36d4e6-d01b-4826-a175-ce41790d36d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:54.862186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d4e6-d01b-4826-a175-ce41790d36d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:54.862495 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d4e6-d01b-4826-a175-ce41790d36d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:54.862784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d4e6-d01b-4826-a175-ce41790d36d1 admin admin] PATH_INFO: `/v3/projects/ad1b2703d4724587baba0b91d53de25d/users/562d83faa0ff4bb0890cc5a0c6d23eec/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:54.879947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36d4e6-d01b-4826-a175-ce41790d36d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1b2703d4724587baba0b91d53de25d, user_id=562d83faa0ff4bb0890cc5a0c6d23eec, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:54.882583 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36d4e6-d01b-4826-a175-ce41790d36d1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:54.895486 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1272/2588] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:32:54 2022] PUT /identity/v3/projects/ad1b2703d4724587baba0b91d53de25d/users/562d83faa0ff4bb0890cc5a0c6d23eec/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:54.899461 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89fc07-6a25-470a-8dad-1d7d78e5a41e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:54.909507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89fc07-6a25-470a-8dad-1d7d78e5a41e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:54.969856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f87ead-a62f-454f-9a5f-35cee9e3862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:54.970464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f87ead-a62f-454f-9a5f-35cee9e3862d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:54.970743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f87ead-a62f-454f-9a5f-35cee9e3862d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:54.971021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f87ead-a62f-454f-9a5f-35cee9e3862d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:54.971659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f87ead-a62f-454f-9a5f-35cee9e3862d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:54.973346 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f87ead-a62f-454f-9a5f-35cee9e3862d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:54.983748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1317/2589] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:32:54.987994 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36d4e6-d01b-4826-a175-ce41790d36d1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:54.998462 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36d4e6-d01b-4826-a175-ce41790d36d1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:55.003473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cc8d0-31e9-489d-a8bf-f9a84c489b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:55.004124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc8d0-31e9-489d-a8bf-f9a84c489b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:55.004401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc8d0-31e9-489d-a8bf-f9a84c489b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:55.004671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc8d0-31e9-489d-a8bf-f9a84c489b13 admin admin] PATH_INFO: `/v3/projects/ad1b2703d4724587baba0b91d53de25d/users/562d83faa0ff4bb0890cc5a0c6d23eec/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:55.006643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cc8d0-31e9-489d-a8bf-f9a84c489b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1b2703d4724587baba0b91d53de25d, user_id=562d83faa0ff4bb0890cc5a0c6d23eec, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:55.009276 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cc8d0-31e9-489d-a8bf-f9a84c489b13 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:55.019796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1273/2590] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:32:54 2022] PUT /identity/v3/projects/ad1b2703d4724587baba0b91d53de25d/users/562d83faa0ff4bb0890cc5a0c6d23eec/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:32:55.033226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d91c53-4cc0-4a56-844b-dc091edba26e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:55.033564 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d91c53-4cc0-4a56-844b-dc091edba26e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:55.033873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d91c53-4cc0-4a56-844b-dc091edba26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:55.058975 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:55.071372 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-19d91c53-4cc0-4a56-844b-dc091edba26e None None] MFA Rules not processed for user `562d83faa0ff4bb0890cc5a0c6d23eec`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:32:55.072911 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-19d91c53-4cc0-4a56-844b-dc091edba26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:55.263077 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1318/2591] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:32:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:32:55.274845 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cc8d0-31e9-489d-a8bf-f9a84c489b13 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:55.276527 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ea0cc8d0-31e9-489d-a8bf-f9a84c489b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:32:55.335650 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cc8d0-31e9-489d-a8bf-f9a84c489b13 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:55.339264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd34080-b119-436c-8fd1-f0bb93c0d29d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:55.339851 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd34080-b119-436c-8fd1-f0bb93c0d29d service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:55.340130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd34080-b119-436c-8fd1-f0bb93c0d29d service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:55.340399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd34080-b119-436c-8fd1-f0bb93c0d29d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:55.398674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd34080-b119-436c-8fd1-f0bb93c0d29d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:55.400338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd34080-b119-436c-8fd1-f0bb93c0d29d service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:55.404751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:32:55.414153 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1274/2592] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:32:56.956925 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d91c53-4cc0-4a56-844b-dc091edba26e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:56.969156 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d91c53-4cc0-4a56-844b-dc091edba26e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:56.973085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e614a-c16d-444a-9da7-ef07ec62213c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:56.973682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e614a-c16d-444a-9da7-ef07ec62213c service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:56.973958 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e614a-c16d-444a-9da7-ef07ec62213c service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:56.974227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e614a-c16d-444a-9da7-ef07ec62213c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:57.030435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e614a-c16d-444a-9da7-ef07ec62213c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:57.031848 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e614a-c16d-444a-9da7-ef07ec62213c service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:57.040556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1319/2593] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:32:57.602954 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd34080-b119-436c-8fd1-f0bb93c0d29d service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:32:57.611577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd34080-b119-436c-8fd1-f0bb93c0d29d service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:32:57.615200 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b925b2-2b3e-4ba3-850d-42f44621b5ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:32:57.616403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b925b2-2b3e-4ba3-850d-42f44621b5ec service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:32:57.616680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b925b2-2b3e-4ba3-850d-42f44621b5ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:32:57.617059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b925b2-2b3e-4ba3-850d-42f44621b5ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:32:57.627790 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b925b2-2b3e-4ba3-850d-42f44621b5ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:32:57.629443 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b925b2-2b3e-4ba3-850d-42f44621b5ec service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:32:57.639610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1275/2594] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:32:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:01.551337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e614a-c16d-444a-9da7-ef07ec62213c service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:01.629388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e614a-c16d-444a-9da7-ef07ec62213c service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:01.635873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e121c1a-604d-4bf1-9168-fad2482083e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:01.635873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121c1a-604d-4bf1-9168-fad2482083e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:01.635873 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121c1a-604d-4bf1-9168-fad2482083e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:01.636249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121c1a-604d-4bf1-9168-fad2482083e4 admin admin] PATH_INFO: `/v3/users/fd7bdc96d5864560b20a0fe4354f7239` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:01.642867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e121c1a-604d-4bf1-9168-fad2482083e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7bdc96d5864560b20a0fe4354f7239)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:01.642867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e121c1a-604d-4bf1-9168-fad2482083e4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:01.689008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:01.714308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4e121c1a-604d-4bf1-9168-fad2482083e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7bdc96d5864560b20a0fe4354f7239'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:01.715423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4e121c1a-604d-4bf1-9168-fad2482083e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7bdc96d5864560b20a0fe4354f7239'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:01.740196 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4e121c1a-604d-4bf1-9168-fad2482083e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7bdc96d5864560b20a0fe4354f7239'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:01.757044 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4e121c1a-604d-4bf1-9168-fad2482083e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7bdc96d5864560b20a0fe4354f7239'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:01.758336 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4e121c1a-604d-4bf1-9168-fad2482083e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7bdc96d5864560b20a0fe4354f7239'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:01.786716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1320/2595] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:01 2022] DELETE /identity/v3/users/fd7bdc96d5864560b20a0fe4354f7239 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:01.794815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364ee5a-1e4f-42bc-a7c3-a605ba655d0f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:01.797131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364ee5a-1e4f-42bc-a7c3-a605ba655d0f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:01.798063 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364ee5a-1e4f-42bc-a7c3-a605ba655d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:01.835271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e364ee5a-1e4f-42bc-a7c3-a605ba655d0f None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:01.836680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e364ee5a-1e4f-42bc-a7c3-a605ba655d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:01.912410 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1276/2596] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:01.925146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e121c1a-604d-4bf1-9168-fad2482083e4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:01.927640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4e121c1a-604d-4bf1-9168-fad2482083e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:01.988608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e121c1a-604d-4bf1-9168-fad2482083e4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:01.993007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffea82-faf3-4312-8b6e-899a07784d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:01.993624 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffea82-faf3-4312-8b6e-899a07784d27 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:01.993900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffea82-faf3-4312-8b6e-899a07784d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:01.994172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffea82-faf3-4312-8b6e-899a07784d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:02.004525 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffea82-faf3-4312-8b6e-899a07784d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:02.006028 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffea82-faf3-4312-8b6e-899a07784d27 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:02.017011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1321/2597] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:02.296928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364ee5a-1e4f-42bc-a7c3-a605ba655d0f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:02.298517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e364ee5a-1e4f-42bc-a7c3-a605ba655d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:02.312706 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364ee5a-1e4f-42bc-a7c3-a605ba655d0f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:02.317791 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:02.318499 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:02.319321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:02.319605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] PATH_INFO: `/v3/projects/bb94909a31d94954a6b3790406ae0e14` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:02.321396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb94909a31d94954a6b3790406ae0e14)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:02.323602 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:02.370413 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb94909a31d94954a6b3790406ae0e14', 'request_id': 'req-fc268b79-bbf5-493e-97c7-47a2d9a30feb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:02.376560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb94909a31d94954a6b3790406ae0e14', 'request_id': 'req-fc268b79-bbf5-493e-97c7-47a2d9a30feb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:02.382733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb94909a31d94954a6b3790406ae0e14', 'request_id': 'req-fc268b79-bbf5-493e-97c7-47a2d9a30feb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:02.394704 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] The token cache is being invalidate because project bb94909a31d94954a6b3790406ae0e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:02.394988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:02.395604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:02.397696 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1277/2598] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:02 2022] DELETE /identity/v3/projects/bb94909a31d94954a6b3790406ae0e14 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:02.401724 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffea82-faf3-4312-8b6e-899a07784d27 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:02.411027 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffea82-faf3-4312-8b6e-899a07784d27 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:02.466788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee33c1-0dca-4be7-ae89-b5d0175d426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:02.467417 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee33c1-0dca-4be7-ae89-b5d0175d426a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:02.467693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee33c1-0dca-4be7-ae89-b5d0175d426a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:02.467962 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee33c1-0dca-4be7-ae89-b5d0175d426a admin admin] PATH_INFO: `/v3/users/74e1a3e7f316467c8893093721cab822` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:02.469092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee33c1-0dca-4be7-ae89-b5d0175d426a admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e1a3e7f316467c8893093721cab822)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:02.470977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee33c1-0dca-4be7-ae89-b5d0175d426a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:02.520750 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-65ee33c1-0dca-4be7-ae89-b5d0175d426a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e1a3e7f316467c8893093721cab822'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:02.521417 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-65ee33c1-0dca-4be7-ae89-b5d0175d426a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e1a3e7f316467c8893093721cab822'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:02.528576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:02.534660 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-65ee33c1-0dca-4be7-ae89-b5d0175d426a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e1a3e7f316467c8893093721cab822'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:02.542215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-65ee33c1-0dca-4be7-ae89-b5d0175d426a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e1a3e7f316467c8893093721cab822'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:02.542908 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-65ee33c1-0dca-4be7-ae89-b5d0175d426a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e1a3e7f316467c8893093721cab822'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:02.555729 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1322/2599] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:02 2022] DELETE /identity/v3/users/74e1a3e7f316467c8893093721cab822 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:02.837552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:02.839177 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:02.853628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268b79-bbf5-493e-97c7-47a2d9a30feb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:02.922569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:02.923458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:02.923729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:02.923985 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] PATH_INFO: `/v3/projects/1e7de0c969964507a6edc7c00cbdcf0f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:02.925297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e7de0c969964507a6edc7c00cbdcf0f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:02.927214 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:02.945229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:02.988703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e7de0c969964507a6edc7c00cbdcf0f', 'request_id': 'req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:02.995940 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e7de0c969964507a6edc7c00cbdcf0f', 'request_id': 'req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:03.002560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e7de0c969964507a6edc7c00cbdcf0f', 'request_id': 'req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:03.018595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] The token cache is being invalidate because project 1e7de0c969964507a6edc7c00cbdcf0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:03.018913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:03.019564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:03.021428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1278/2600] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:02 2022] DELETE /identity/v3/projects/1e7de0c969964507a6edc7c00cbdcf0f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:03.027216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee33c1-0dca-4be7-ae89-b5d0175d426a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:03.029687 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-65ee33c1-0dca-4be7-ae89-b5d0175d426a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:03.045453 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee33c1-0dca-4be7-ae89-b5d0175d426a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:03.125284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67df58c-f28c-4067-8df1-ffedf93c3903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:03.126030 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67df58c-f28c-4067-8df1-ffedf93c3903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:03.126376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67df58c-f28c-4067-8df1-ffedf93c3903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:03.126773 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67df58c-f28c-4067-8df1-ffedf93c3903 admin admin] PATH_INFO: `/v3/users/562d83faa0ff4bb0890cc5a0c6d23eec` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:03.129440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67df58c-f28c-4067-8df1-ffedf93c3903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562d83faa0ff4bb0890cc5a0c6d23eec)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:03.132303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67df58c-f28c-4067-8df1-ffedf93c3903 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:03.182173 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a67df58c-f28c-4067-8df1-ffedf93c3903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562d83faa0ff4bb0890cc5a0c6d23eec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:03.182936 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a67df58c-f28c-4067-8df1-ffedf93c3903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562d83faa0ff4bb0890cc5a0c6d23eec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:03.196411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a67df58c-f28c-4067-8df1-ffedf93c3903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562d83faa0ff4bb0890cc5a0c6d23eec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:03.204370 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a67df58c-f28c-4067-8df1-ffedf93c3903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562d83faa0ff4bb0890cc5a0c6d23eec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:03.205115 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a67df58c-f28c-4067-8df1-ffedf93c3903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562d83faa0ff4bb0890cc5a0c6d23eec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:03.218689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1323/2601] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:03 2022] DELETE /identity/v3/users/562d83faa0ff4bb0890cc5a0c6d23eec => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:03.502190 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:03.503840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:03.525920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6367bef-3874-4f1e-a1d1-5f3b7f1f005d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:03.601567 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36139e6-3a2d-45e6-a115-8fcb661dc884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:03.602207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36139e6-3a2d-45e6-a115-8fcb661dc884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:03.602481 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36139e6-3a2d-45e6-a115-8fcb661dc884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:03.602752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36139e6-3a2d-45e6-a115-8fcb661dc884 admin admin] PATH_INFO: `/v3/projects/ad1b2703d4724587baba0b91d53de25d` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:03.603887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36139e6-3a2d-45e6-a115-8fcb661dc884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1b2703d4724587baba0b91d53de25d)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:03.605823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36139e6-3a2d-45e6-a115-8fcb661dc884 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:03.655634 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c36139e6-3a2d-45e6-a115-8fcb661dc884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1b2703d4724587baba0b91d53de25d', 'request_id': 'req-c36139e6-3a2d-45e6-a115-8fcb661dc884'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:03.662752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c36139e6-3a2d-45e6-a115-8fcb661dc884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1b2703d4724587baba0b91d53de25d', 'request_id': 'req-c36139e6-3a2d-45e6-a115-8fcb661dc884'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:03.668572 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c36139e6-3a2d-45e6-a115-8fcb661dc884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1b2703d4724587baba0b91d53de25d', 'request_id': 'req-c36139e6-3a2d-45e6-a115-8fcb661dc884'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:03.682729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c36139e6-3a2d-45e6-a115-8fcb661dc884 admin admin] The token cache is being invalidate because project ad1b2703d4724587baba0b91d53de25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:03.683027 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c36139e6-3a2d-45e6-a115-8fcb661dc884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:03.683807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c36139e6-3a2d-45e6-a115-8fcb661dc884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:03.685770 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1279/2602] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:03 2022] DELETE /identity/v3/projects/ad1b2703d4724587baba0b91d53de25d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:03.691022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b7ac7-3b45-428c-b36c-5422978e6a4d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:03.691832 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b7ac7-3b45-428c-b36c-5422978e6a4d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:03.691832 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b7ac7-3b45-428c-b36c-5422978e6a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:03.714525 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f15b7ac7-3b45-428c-b36c-5422978e6a4d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:03.715744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f15b7ac7-3b45-428c-b36c-5422978e6a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:03.762813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:03.776411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1324/2603] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:03.784167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192937e5-d352-4ca1-81c0-1311a905957f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:03.784475 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192937e5-d352-4ca1-81c0-1311a905957f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:03.784794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192937e5-d352-4ca1-81c0-1311a905957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:03.806605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-192937e5-d352-4ca1-81c0-1311a905957f None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:03.808226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-192937e5-d352-4ca1-81c0-1311a905957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:03.816730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1280/2604] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:03.821800 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b7ac7-3b45-428c-b36c-5422978e6a4d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:03.832473 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b7ac7-3b45-428c-b36c-5422978e6a4d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:03.837947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d58eb-9df9-4162-8581-79de7a3c51ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:03.838563 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d58eb-9df9-4162-8581-79de7a3c51ef admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:03.838855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d58eb-9df9-4162-8581-79de7a3c51ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:03.839106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d58eb-9df9-4162-8581-79de7a3c51ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:03.839798 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d58eb-9df9-4162-8581-79de7a3c51ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:03.840099 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d58eb-9df9-4162-8581-79de7a3c51ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:03.841892 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d58eb-9df9-4162-8581-79de7a3c51ef admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:03.854743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1325/2605] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:33:03.859684 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192937e5-d352-4ca1-81c0-1311a905957f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:03.870120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192937e5-d352-4ca1-81c0-1311a905957f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:03.876178 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc88c9f-c0ed-42a9-bf29-4047e53ad80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:03.876818 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc88c9f-c0ed-42a9-bf29-4047e53ad80f admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:03.877100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc88c9f-c0ed-42a9-bf29-4047e53ad80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:03.877370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc88c9f-c0ed-42a9-bf29-4047e53ad80f admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:03.877995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc88c9f-c0ed-42a9-bf29-4047e53ad80f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:03.879899 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc88c9f-c0ed-42a9-bf29-4047e53ad80f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:03.904115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:03.911870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1281/2606] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:03 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:03.916204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d58eb-9df9-4162-8581-79de7a3c51ef admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:03.927351 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d58eb-9df9-4162-8581-79de7a3c51ef admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:03.985640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6b333-543d-4aa5-bbbd-5d227705e19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:03.986150 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6b333-543d-4aa5-bbbd-5d227705e19f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:03.986428 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6b333-543d-4aa5-bbbd-5d227705e19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:03.986698 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6b333-543d-4aa5-bbbd-5d227705e19f admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:03.987309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6b333-543d-4aa5-bbbd-5d227705e19f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:03.989229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6b333-543d-4aa5-bbbd-5d227705e19f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:04.012767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1326/2607] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:03 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:04.017187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc88c9f-c0ed-42a9-bf29-4047e53ad80f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:04.027726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc88c9f-c0ed-42a9-bf29-4047e53ad80f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:04.032660 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e09e73-8dbc-4a90-a9c1-a49c94c288e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:04.033306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e09e73-8dbc-4a90-a9c1-a49c94c288e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:04.033591 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e09e73-8dbc-4a90-a9c1-a49c94c288e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:04.033853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e09e73-8dbc-4a90-a9c1-a49c94c288e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:04.034494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e09e73-8dbc-4a90-a9c1-a49c94c288e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:04.036146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e09e73-8dbc-4a90-a9c1-a49c94c288e8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:04.046851 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1282/2608] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:04.051242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6b333-543d-4aa5-bbbd-5d227705e19f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:04.062323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6b333-543d-4aa5-bbbd-5d227705e19f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:04.067243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4fb7a-506a-441f-94d5-52642474e055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:04.067887 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4fb7a-506a-441f-94d5-52642474e055 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:04.068161 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4fb7a-506a-441f-94d5-52642474e055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:04.068539 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4fb7a-506a-441f-94d5-52642474e055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:04.069758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4fb7a-506a-441f-94d5-52642474e055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:04.071363 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4fb7a-506a-441f-94d5-52642474e055 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:04.082993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1327/2609] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:04.087305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e09e73-8dbc-4a90-a9c1-a49c94c288e8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:04.097666 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e09e73-8dbc-4a90-a9c1-a49c94c288e8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:04.103649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3c526-48b9-441e-8d09-1555091de97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:04.104363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3c526-48b9-441e-8d09-1555091de97a admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:04.104639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3c526-48b9-441e-8d09-1555091de97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:04.104955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3c526-48b9-441e-8d09-1555091de97a admin admin] PATH_INFO: `/v3/projects/717f428b2ce84918a5f4db42fdfa73b6/users/2e1b7151b48846c4bc1fcfd527ba1fb9/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:04.120361 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3c526-48b9-441e-8d09-1555091de97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=717f428b2ce84918a5f4db42fdfa73b6, user_id=2e1b7151b48846c4bc1fcfd527ba1fb9, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:04.123126 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3c526-48b9-441e-8d09-1555091de97a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:04.136446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1283/2610] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:04 2022] PUT /identity/v3/projects/717f428b2ce84918a5f4db42fdfa73b6/users/2e1b7151b48846c4bc1fcfd527ba1fb9/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:04.147618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c0897-93a7-4fff-b293-4dc8f96df6c9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:04.147989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c0897-93a7-4fff-b293-4dc8f96df6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:04.148264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c0897-93a7-4fff-b293-4dc8f96df6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:04.176092 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-066c0897-93a7-4fff-b293-4dc8f96df6c9 None None] MFA Rules not processed for user `2e1b7151b48846c4bc1fcfd527ba1fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:04.177390 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-066c0897-93a7-4fff-b293-4dc8f96df6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:04.241568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1328/2611] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:04.252720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3c526-48b9-441e-8d09-1555091de97a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:04.254436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-66f3c526-48b9-441e-8d09-1555091de97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:04.311268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3c526-48b9-441e-8d09-1555091de97a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:04.314980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acc717-744d-492d-b36e-505feb89c6ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:04.315590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acc717-744d-492d-b36e-505feb89c6ff service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:04.315868 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acc717-744d-492d-b36e-505feb89c6ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:04.316138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acc717-744d-492d-b36e-505feb89c6ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:04.325499 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acc717-744d-492d-b36e-505feb89c6ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:04.326924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acc717-744d-492d-b36e-505feb89c6ff service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:04.335864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1284/2612] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:33:04.360866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c0897-93a7-4fff-b293-4dc8f96df6c9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:04.408100 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:04.422686 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c0897-93a7-4fff-b293-4dc8f96df6c9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:04.427247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feabad5-62d8-4996-8964-75c0ca3da2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:04.428486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feabad5-62d8-4996-8964-75c0ca3da2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:04.428781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feabad5-62d8-4996-8964-75c0ca3da2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:04.429057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feabad5-62d8-4996-8964-75c0ca3da2fa admin admin] PATH_INFO: `/v3/users/2e1b7151b48846c4bc1fcfd527ba1fb9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:04.430168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feabad5-62d8-4996-8964-75c0ca3da2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1b7151b48846c4bc1fcfd527ba1fb9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:04.432051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feabad5-62d8-4996-8964-75c0ca3da2fa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:04.482783 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6feabad5-62d8-4996-8964-75c0ca3da2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1b7151b48846c4bc1fcfd527ba1fb9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:04.483555 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6feabad5-62d8-4996-8964-75c0ca3da2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1b7151b48846c4bc1fcfd527ba1fb9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:04.495893 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6feabad5-62d8-4996-8964-75c0ca3da2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1b7151b48846c4bc1fcfd527ba1fb9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:04.502711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6feabad5-62d8-4996-8964-75c0ca3da2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1b7151b48846c4bc1fcfd527ba1fb9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:04.503393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6feabad5-62d8-4996-8964-75c0ca3da2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1b7151b48846c4bc1fcfd527ba1fb9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:04.516010 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1329/2613] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:04 2022] DELETE /identity/v3/users/2e1b7151b48846c4bc1fcfd527ba1fb9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:04.520843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabf1ae-02d2-4577-808a-2a743e98462f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:04.521207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabf1ae-02d2-4577-808a-2a743e98462f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:04.521489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabf1ae-02d2-4577-808a-2a743e98462f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:04.546255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-efabf1ae-02d2-4577-808a-2a743e98462f None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:04.546255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-efabf1ae-02d2-4577-808a-2a743e98462f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:04.604045 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1285/2614] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:04.613751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feabad5-62d8-4996-8964-75c0ca3da2fa admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:04.615132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6feabad5-62d8-4996-8964-75c0ca3da2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:04.671174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feabad5-62d8-4996-8964-75c0ca3da2fa admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:04.674791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5c53d-905d-4b9c-8e42-2257be5766dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:04.675377 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5c53d-905d-4b9c-8e42-2257be5766dd service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:04.675649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5c53d-905d-4b9c-8e42-2257be5766dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:04.675916 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5c53d-905d-4b9c-8e42-2257be5766dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:04.685247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5c53d-905d-4b9c-8e42-2257be5766dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:04.686637 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5c53d-905d-4b9c-8e42-2257be5766dd service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:04.695813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1330/2615] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:05.004607 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabf1ae-02d2-4577-808a-2a743e98462f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:05.007724 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-efabf1ae-02d2-4577-808a-2a743e98462f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:05.024299 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabf1ae-02d2-4577-808a-2a743e98462f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:05.029290 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca052f-572b-4110-828c-f93cc2de34cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:05.029924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca052f-572b-4110-828c-f93cc2de34cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:05.030199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca052f-572b-4110-828c-f93cc2de34cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:05.030473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca052f-572b-4110-828c-f93cc2de34cb admin admin] PATH_INFO: `/v3/projects/717f428b2ce84918a5f4db42fdfa73b6` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:05.031682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca052f-572b-4110-828c-f93cc2de34cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=717f428b2ce84918a5f4db42fdfa73b6)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:05.033496 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca052f-572b-4110-828c-f93cc2de34cb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:05.085506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-adca052f-572b-4110-828c-f93cc2de34cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717f428b2ce84918a5f4db42fdfa73b6', 'request_id': 'req-adca052f-572b-4110-828c-f93cc2de34cb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:05.092347 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-adca052f-572b-4110-828c-f93cc2de34cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717f428b2ce84918a5f4db42fdfa73b6', 'request_id': 'req-adca052f-572b-4110-828c-f93cc2de34cb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:05.099051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-adca052f-572b-4110-828c-f93cc2de34cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717f428b2ce84918a5f4db42fdfa73b6', 'request_id': 'req-adca052f-572b-4110-828c-f93cc2de34cb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:05.101402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:05.117643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-adca052f-572b-4110-828c-f93cc2de34cb admin admin] The token cache is being invalidate because project 717f428b2ce84918a5f4db42fdfa73b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:05.117988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-adca052f-572b-4110-828c-f93cc2de34cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:05.118749 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-adca052f-572b-4110-828c-f93cc2de34cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:05.120374 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1286/2616] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:05 2022] DELETE /identity/v3/projects/717f428b2ce84918a5f4db42fdfa73b6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:05.133324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abcf55-712c-414d-b8f9-497fd5bc1e07 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:05.133661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abcf55-712c-414d-b8f9-497fd5bc1e07 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:05.134629 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abcf55-712c-414d-b8f9-497fd5bc1e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:05.164868 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b5abcf55-712c-414d-b8f9-497fd5bc1e07 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:05.166079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b5abcf55-712c-414d-b8f9-497fd5bc1e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:05.225393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1331/2617] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:05.233062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a7c50-e567-425f-801f-ea83c2db658a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:05.233350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a7c50-e567-425f-801f-ea83c2db658a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:05.233622 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a7c50-e567-425f-801f-ea83c2db658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:05.253728 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-140a7c50-e567-425f-801f-ea83c2db658a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:05.254975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-140a7c50-e567-425f-801f-ea83c2db658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:05.262904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1287/2618] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:05.267413 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abcf55-712c-414d-b8f9-497fd5bc1e07 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:05.277169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abcf55-712c-414d-b8f9-497fd5bc1e07 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:05.281783 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec5596-24b8-45ee-a85c-4712dc83ec51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:05.282371 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec5596-24b8-45ee-a85c-4712dc83ec51 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:05.282649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec5596-24b8-45ee-a85c-4712dc83ec51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:05.282920 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec5596-24b8-45ee-a85c-4712dc83ec51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:05.283565 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec5596-24b8-45ee-a85c-4712dc83ec51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:05.283863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec5596-24b8-45ee-a85c-4712dc83ec51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:05.285495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec5596-24b8-45ee-a85c-4712dc83ec51 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:05.292871 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:05.298994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1332/2619] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:33:05.304080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a7c50-e567-425f-801f-ea83c2db658a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:05.313399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a7c50-e567-425f-801f-ea83c2db658a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:05.318070 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46360ab-8266-4099-a113-3ec0ef8b02b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:05.318660 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46360ab-8266-4099-a113-3ec0ef8b02b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:05.318941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46360ab-8266-4099-a113-3ec0ef8b02b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:05.319214 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46360ab-8266-4099-a113-3ec0ef8b02b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:05.319875 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46360ab-8266-4099-a113-3ec0ef8b02b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:05.321810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46360ab-8266-4099-a113-3ec0ef8b02b3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:05.348477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1288/2620] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:05 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:05.353583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec5596-24b8-45ee-a85c-4712dc83ec51 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:05.363627 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec5596-24b8-45ee-a85c-4712dc83ec51 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:05.418513 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39e456-65fb-4857-b39b-60c08266c18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:05.419106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39e456-65fb-4857-b39b-60c08266c18b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:05.419379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39e456-65fb-4857-b39b-60c08266c18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:05.419644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39e456-65fb-4857-b39b-60c08266c18b admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:05.420263 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39e456-65fb-4857-b39b-60c08266c18b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:05.422175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39e456-65fb-4857-b39b-60c08266c18b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:05.443307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1333/2621] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:05 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:05.447779 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46360ab-8266-4099-a113-3ec0ef8b02b3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:05.458843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46360ab-8266-4099-a113-3ec0ef8b02b3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:05.463815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745cc91-42ed-498f-ae02-69b348ba3d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:05.464418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745cc91-42ed-498f-ae02-69b348ba3d7c admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:05.464723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745cc91-42ed-498f-ae02-69b348ba3d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:05.465002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745cc91-42ed-498f-ae02-69b348ba3d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:05.465643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745cc91-42ed-498f-ae02-69b348ba3d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:05.467226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745cc91-42ed-498f-ae02-69b348ba3d7c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:05.477834 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1289/2622] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:05.481904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39e456-65fb-4857-b39b-60c08266c18b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:05.491707 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39e456-65fb-4857-b39b-60c08266c18b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:05.496175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e9c46-ccaf-4fc1-b554-75ced33c2b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:05.496786 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e9c46-ccaf-4fc1-b554-75ced33c2b69 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:05.497061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e9c46-ccaf-4fc1-b554-75ced33c2b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:05.497420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e9c46-ccaf-4fc1-b554-75ced33c2b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:05.497939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e9c46-ccaf-4fc1-b554-75ced33c2b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:05.499508 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e9c46-ccaf-4fc1-b554-75ced33c2b69 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:05.510797 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1334/2623] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:05.514924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745cc91-42ed-498f-ae02-69b348ba3d7c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:05.525936 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745cc91-42ed-498f-ae02-69b348ba3d7c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:05.531175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d9608-636e-45dc-8112-ca0fadeace0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:05.531830 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d9608-636e-45dc-8112-ca0fadeace0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:05.532109 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d9608-636e-45dc-8112-ca0fadeace0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:05.532382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d9608-636e-45dc-8112-ca0fadeace0b admin admin] PATH_INFO: `/v3/projects/883e6567776d472189f399b5548acc4c/users/a43a87036d66437eb64ea58231e41845/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:05.548145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d9608-636e-45dc-8112-ca0fadeace0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=883e6567776d472189f399b5548acc4c, user_id=a43a87036d66437eb64ea58231e41845, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:05.550843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d9608-636e-45dc-8112-ca0fadeace0b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:05.563785 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1290/2624] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:05 2022] PUT /identity/v3/projects/883e6567776d472189f399b5548acc4c/users/a43a87036d66437eb64ea58231e41845/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:05.569194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611dc2-7f57-4647-ad68-924a8b765c44 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:05.569476 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611dc2-7f57-4647-ad68-924a8b765c44 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:05.569745 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611dc2-7f57-4647-ad68-924a8b765c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:05.588816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-86611dc2-7f57-4647-ad68-924a8b765c44 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:05.589990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-86611dc2-7f57-4647-ad68-924a8b765c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:05.645630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1335/2625] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:05.656234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d9608-636e-45dc-8112-ca0fadeace0b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:05.658001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4e0d9608-636e-45dc-8112-ca0fadeace0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:05.715107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d9608-636e-45dc-8112-ca0fadeace0b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:05.718793 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87421b-dfe1-49b2-a10c-9146e0fa04f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:05.719394 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87421b-dfe1-49b2-a10c-9146e0fa04f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:05.719703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87421b-dfe1-49b2-a10c-9146e0fa04f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:05.719955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87421b-dfe1-49b2-a10c-9146e0fa04f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:05.729523 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87421b-dfe1-49b2-a10c-9146e0fa04f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:05.730941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87421b-dfe1-49b2-a10c-9146e0fa04f1 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:05.740354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1291/2626] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:06.419146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1e46f-01ce-435e-a3e0-10c64ee730a6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:06.419691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1e46f-01ce-435e-a3e0-10c64ee730a6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:06.419691 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1e46f-01ce-435e-a3e0-10c64ee730a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:06.457803 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cdb1e46f-01ce-435e-a3e0-10c64ee730a6 None None] MFA Rules not processed for user `a43a87036d66437eb64ea58231e41845`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:06.459528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cdb1e46f-01ce-435e-a3e0-10c64ee730a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:06.528605 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1336/2627] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:06.539571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87421b-dfe1-49b2-a10c-9146e0fa04f1 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:06.541222 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ea87421b-dfe1-49b2-a10c-9146e0fa04f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:06.600922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87421b-dfe1-49b2-a10c-9146e0fa04f1 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:06.604516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67bd6f-453a-4d22-8347-15b58dd526f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:06.605157 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67bd6f-453a-4d22-8347-15b58dd526f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:06.605423 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67bd6f-453a-4d22-8347-15b58dd526f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:06.605698 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67bd6f-453a-4d22-8347-15b58dd526f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:06.614163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67bd6f-453a-4d22-8347-15b58dd526f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:06.616250 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67bd6f-453a-4d22-8347-15b58dd526f2 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:06.625193 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1292/2628] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:07.336748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1e46f-01ce-435e-a3e0-10c64ee730a6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:07.346315 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1e46f-01ce-435e-a3e0-10c64ee730a6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:07.350556 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c50c2-737c-4990-add3-02f4f455e898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:07.351162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c50c2-737c-4990-add3-02f4f455e898 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:07.351439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c50c2-737c-4990-add3-02f4f455e898 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:07.351708 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c50c2-737c-4990-add3-02f4f455e898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:07.353459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ff1c50c2-737c-4990-add3-02f4f455e898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:07.361879 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:07.367355 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c50c2-737c-4990-add3-02f4f455e898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:07.368919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c50c2-737c-4990-add3-02f4f455e898 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:07.378766 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1337/2629] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:08.051011 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9723a1-a8ed-43a6-8095-7ddb768a7b32 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:08.051599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9723a1-a8ed-43a6-8095-7ddb768a7b32 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:08.051599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9723a1-a8ed-43a6-8095-7ddb768a7b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:08.073171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-df9723a1-a8ed-43a6-8095-7ddb768a7b32 None None] MFA Rules not processed for user `a43a87036d66437eb64ea58231e41845`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:08.074327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-df9723a1-a8ed-43a6-8095-7ddb768a7b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:08.081446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1293/2630] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:11.418540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c50c2-737c-4990-add3-02f4f455e898 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:11.420523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ff1c50c2-737c-4990-add3-02f4f455e898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:11.434747 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c50c2-737c-4990-add3-02f4f455e898 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:11.439635 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024aca22-7d55-4a26-9a33-08bc408abea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:11.440266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024aca22-7d55-4a26-9a33-08bc408abea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:11.440543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024aca22-7d55-4a26-9a33-08bc408abea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:11.440860 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024aca22-7d55-4a26-9a33-08bc408abea5 admin admin] PATH_INFO: `/v3/users/b6093246f53b4dcb961f47aea99fb1bd` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:11.442697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024aca22-7d55-4a26-9a33-08bc408abea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6093246f53b4dcb961f47aea99fb1bd)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:11.443998 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024aca22-7d55-4a26-9a33-08bc408abea5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:11.494646 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-024aca22-7d55-4a26-9a33-08bc408abea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6093246f53b4dcb961f47aea99fb1bd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:11.495355 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-024aca22-7d55-4a26-9a33-08bc408abea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6093246f53b4dcb961f47aea99fb1bd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:11.508143 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-024aca22-7d55-4a26-9a33-08bc408abea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6093246f53b4dcb961f47aea99fb1bd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:11.515121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-024aca22-7d55-4a26-9a33-08bc408abea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6093246f53b4dcb961f47aea99fb1bd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:11.515948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-024aca22-7d55-4a26-9a33-08bc408abea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6093246f53b4dcb961f47aea99fb1bd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:11.529850 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1338/2631] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:11 2022] DELETE /identity/v3/users/b6093246f53b4dcb961f47aea99fb1bd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:11.724056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9723a1-a8ed-43a6-8095-7ddb768a7b32 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:11.737830 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9723a1-a8ed-43a6-8095-7ddb768a7b32 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:11.772105 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:11.809064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3070fc-ca05-464d-b280-95171433a755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:11.809737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3070fc-ca05-464d-b280-95171433a755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:11.810100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3070fc-ca05-464d-b280-95171433a755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:11.810495 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3070fc-ca05-464d-b280-95171433a755 admin admin] PATH_INFO: `/v3/projects/9a10997d04244abf89426279131ae960` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:11.812110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3070fc-ca05-464d-b280-95171433a755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a10997d04244abf89426279131ae960)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:11.813895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3070fc-ca05-464d-b280-95171433a755 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:11.873009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4d3070fc-ca05-464d-b280-95171433a755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a10997d04244abf89426279131ae960', 'request_id': 'req-4d3070fc-ca05-464d-b280-95171433a755'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:11.882757 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4d3070fc-ca05-464d-b280-95171433a755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a10997d04244abf89426279131ae960', 'request_id': 'req-4d3070fc-ca05-464d-b280-95171433a755'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:11.889430 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4d3070fc-ca05-464d-b280-95171433a755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a10997d04244abf89426279131ae960', 'request_id': 'req-4d3070fc-ca05-464d-b280-95171433a755'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:11.906433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4d3070fc-ca05-464d-b280-95171433a755 admin admin] The token cache is being invalidate because project 9a10997d04244abf89426279131ae960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:11.906810 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4d3070fc-ca05-464d-b280-95171433a755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:11.909208 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4d3070fc-ca05-464d-b280-95171433a755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:11.910913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1294/2632] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:11 2022] DELETE /identity/v3/projects/9a10997d04244abf89426279131ae960 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:11.916407 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de37d99-9ef0-4b8d-8397-92b40c072101 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:11.916721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de37d99-9ef0-4b8d-8397-92b40c072101 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:11.917006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de37d99-9ef0-4b8d-8397-92b40c072101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:11.937360 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3de37d99-9ef0-4b8d-8397-92b40c072101 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:11.938779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3de37d99-9ef0-4b8d-8397-92b40c072101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:12.019391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1339/2633] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:12.021242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe7d4e-9301-4625-9d28-c38e0ff9d90a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:12.021746 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe7d4e-9301-4625-9d28-c38e0ff9d90a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:12.022158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe7d4e-9301-4625-9d28-c38e0ff9d90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:12.043990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-49fe7d4e-9301-4625-9d28-c38e0ff9d90a None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:12.045439 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-49fe7d4e-9301-4625-9d28-c38e0ff9d90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:12.055052 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1295/2634] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:12.060960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de37d99-9ef0-4b8d-8397-92b40c072101 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:12.073331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de37d99-9ef0-4b8d-8397-92b40c072101 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:12.080943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96003199-c44f-4b53-b438-f16201fcd15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:12.081494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96003199-c44f-4b53-b438-f16201fcd15a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:12.081869 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96003199-c44f-4b53-b438-f16201fcd15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:12.082142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96003199-c44f-4b53-b438-f16201fcd15a admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:12.083545 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96003199-c44f-4b53-b438-f16201fcd15a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:12.084050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96003199-c44f-4b53-b438-f16201fcd15a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:12.086318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96003199-c44f-4b53-b438-f16201fcd15a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:12.102928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1340/2635] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:33:12.107731 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe7d4e-9301-4625-9d28-c38e0ff9d90a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:12.127189 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe7d4e-9301-4625-9d28-c38e0ff9d90a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:12.132305 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d40e42-2f39-4015-a85e-d73209a320f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:12.133044 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d40e42-2f39-4015-a85e-d73209a320f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:12.133392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d40e42-2f39-4015-a85e-d73209a320f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:12.133729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d40e42-2f39-4015-a85e-d73209a320f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:12.134450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d40e42-2f39-4015-a85e-d73209a320f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:12.136407 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d40e42-2f39-4015-a85e-d73209a320f4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:12.172639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1296/2636] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:12 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:12.174220 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96003199-c44f-4b53-b438-f16201fcd15a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:12.185285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96003199-c44f-4b53-b438-f16201fcd15a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:12.237257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:12.248341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d79d9-2454-45b5-9d57-69b914e63e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:12.249007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d79d9-2454-45b5-9d57-69b914e63e4d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:12.249284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d79d9-2454-45b5-9d57-69b914e63e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:12.249559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d79d9-2454-45b5-9d57-69b914e63e4d admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:12.250231 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d79d9-2454-45b5-9d57-69b914e63e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:12.252246 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d79d9-2454-45b5-9d57-69b914e63e4d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:12.276221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1341/2637] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:12 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:12.280564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d40e42-2f39-4015-a85e-d73209a320f4 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:12.291961 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d40e42-2f39-4015-a85e-d73209a320f4 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:12.296813 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b3032-9cad-4463-ba89-8cea763e63e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:12.297449 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3032-9cad-4463-ba89-8cea763e63e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:12.297801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3032-9cad-4463-ba89-8cea763e63e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:12.298141 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3032-9cad-4463-ba89-8cea763e63e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:12.299002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b3032-9cad-4463-ba89-8cea763e63e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:12.300559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b3032-9cad-4463-ba89-8cea763e63e3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:12.314471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1297/2638] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:12.316227 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d79d9-2454-45b5-9d57-69b914e63e4d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:12.326577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d79d9-2454-45b5-9d57-69b914e63e4d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:12.331445 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc241c-f981-46d4-b58c-56f60574485f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:12.331990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc241c-f981-46d4-b58c-56f60574485f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:12.332267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc241c-f981-46d4-b58c-56f60574485f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:12.332535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc241c-f981-46d4-b58c-56f60574485f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:12.333228 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc241c-f981-46d4-b58c-56f60574485f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:12.335441 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc241c-f981-46d4-b58c-56f60574485f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:12.346909 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1342/2639] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:12.351502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b3032-9cad-4463-ba89-8cea763e63e3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:12.361569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b3032-9cad-4463-ba89-8cea763e63e3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:12.366954 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958eff1-c590-4e6e-81c3-f2cfb34578af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:12.367618 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958eff1-c590-4e6e-81c3-f2cfb34578af admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:12.367897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958eff1-c590-4e6e-81c3-f2cfb34578af admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:12.368170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958eff1-c590-4e6e-81c3-f2cfb34578af admin admin] PATH_INFO: `/v3/projects/5155035f9b3a4247bedfe73c6bffde76/users/44546be76f7a4bd6b7614b98644f046a/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:12.384137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958eff1-c590-4e6e-81c3-f2cfb34578af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5155035f9b3a4247bedfe73c6bffde76, user_id=44546be76f7a4bd6b7614b98644f046a, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:12.386842 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958eff1-c590-4e6e-81c3-f2cfb34578af admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:12.401371 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1298/2640] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:12 2022] PUT /identity/v3/projects/5155035f9b3a4247bedfe73c6bffde76/users/44546be76f7a4bd6b7614b98644f046a/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:12.411540 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c0cb0-7624-4600-b3c8-d9c43c84a01e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:12.411825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c0cb0-7624-4600-b3c8-d9c43c84a01e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:12.412775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c0cb0-7624-4600-b3c8-d9c43c84a01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:12.440369 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6b5c0cb0-7624-4600-b3c8-d9c43c84a01e None None] MFA Rules not processed for user `44546be76f7a4bd6b7614b98644f046a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:12.441794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6b5c0cb0-7624-4600-b3c8-d9c43c84a01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:12.522253 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1343/2641] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:12.533468 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958eff1-c590-4e6e-81c3-f2cfb34578af admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:12.535752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9958eff1-c590-4e6e-81c3-f2cfb34578af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:12.591690 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:12.616066 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958eff1-c590-4e6e-81c3-f2cfb34578af admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:12.622412 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedf3d2-2b3c-4dfb-9e4b-69a826e4d31c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:12.623022 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedf3d2-2b3c-4dfb-9e4b-69a826e4d31c service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:12.623295 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedf3d2-2b3c-4dfb-9e4b-69a826e4d31c service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:12.623566 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedf3d2-2b3c-4dfb-9e4b-69a826e4d31c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:12.632241 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedf3d2-2b3c-4dfb-9e4b-69a826e4d31c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:12.633843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedf3d2-2b3c-4dfb-9e4b-69a826e4d31c service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:12.643033 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1299/2642] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:12.872978 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c0cb0-7624-4600-b3c8-d9c43c84a01e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:12.936331 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c0cb0-7624-4600-b3c8-d9c43c84a01e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:12.940799 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04488a-bbb5-416e-896e-39d46196c159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:12.941423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04488a-bbb5-416e-896e-39d46196c159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:12.941698 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04488a-bbb5-416e-896e-39d46196c159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:12.941965 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04488a-bbb5-416e-896e-39d46196c159 admin admin] PATH_INFO: `/v3/users/44546be76f7a4bd6b7614b98644f046a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:12.943075 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04488a-bbb5-416e-896e-39d46196c159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44546be76f7a4bd6b7614b98644f046a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:12.945155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04488a-bbb5-416e-896e-39d46196c159 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:12.996856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a04488a-bbb5-416e-896e-39d46196c159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44546be76f7a4bd6b7614b98644f046a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:12.997525 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a04488a-bbb5-416e-896e-39d46196c159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44546be76f7a4bd6b7614b98644f046a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:13.009031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:13.010587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a04488a-bbb5-416e-896e-39d46196c159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44546be76f7a4bd6b7614b98644f046a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:13.019321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a04488a-bbb5-416e-896e-39d46196c159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44546be76f7a4bd6b7614b98644f046a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:13.020109 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a04488a-bbb5-416e-896e-39d46196c159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44546be76f7a4bd6b7614b98644f046a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:13.033284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1344/2643] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:12 2022] DELETE /identity/v3/users/44546be76f7a4bd6b7614b98644f046a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:13.038610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72866a8a-5959-4d7a-8210-37275b806a57 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:13.039140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72866a8a-5959-4d7a-8210-37275b806a57 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:13.039140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72866a8a-5959-4d7a-8210-37275b806a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:13.059224 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-72866a8a-5959-4d7a-8210-37275b806a57 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:13.060499 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-72866a8a-5959-4d7a-8210-37275b806a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:13.122409 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1300/2644] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:13.132943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04488a-bbb5-416e-896e-39d46196c159 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:13.134344 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8a04488a-bbb5-416e-896e-39d46196c159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:13.201056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04488a-bbb5-416e-896e-39d46196c159 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:13.204774 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db38dba-ba21-430e-9388-7e88994cbf08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:13.205382 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db38dba-ba21-430e-9388-7e88994cbf08 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:13.205658 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db38dba-ba21-430e-9388-7e88994cbf08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:13.205927 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db38dba-ba21-430e-9388-7e88994cbf08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:13.217295 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db38dba-ba21-430e-9388-7e88994cbf08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:13.218836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db38dba-ba21-430e-9388-7e88994cbf08 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:13.229760 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1345/2645] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:13.613680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72866a8a-5959-4d7a-8210-37275b806a57 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:13.614799 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-72866a8a-5959-4d7a-8210-37275b806a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:13.628973 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72866a8a-5959-4d7a-8210-37275b806a57 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:13.634303 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af590-d61d-4a58-afa8-28c7fc9f3fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:13.635816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af590-d61d-4a58-afa8-28c7fc9f3fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:13.636098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af590-d61d-4a58-afa8-28c7fc9f3fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:13.636494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af590-d61d-4a58-afa8-28c7fc9f3fe5 admin admin] PATH_INFO: `/v3/projects/5155035f9b3a4247bedfe73c6bffde76` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:13.637546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298af590-d61d-4a58-afa8-28c7fc9f3fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5155035f9b3a4247bedfe73c6bffde76)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:13.639452 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298af590-d61d-4a58-afa8-28c7fc9f3fe5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:13.688201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-298af590-d61d-4a58-afa8-28c7fc9f3fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5155035f9b3a4247bedfe73c6bffde76', 'request_id': 'req-298af590-d61d-4a58-afa8-28c7fc9f3fe5'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:13.695435 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-298af590-d61d-4a58-afa8-28c7fc9f3fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5155035f9b3a4247bedfe73c6bffde76', 'request_id': 'req-298af590-d61d-4a58-afa8-28c7fc9f3fe5'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:13.701759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-298af590-d61d-4a58-afa8-28c7fc9f3fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5155035f9b3a4247bedfe73c6bffde76', 'request_id': 'req-298af590-d61d-4a58-afa8-28c7fc9f3fe5'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:13.717350 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-298af590-d61d-4a58-afa8-28c7fc9f3fe5 admin admin] The token cache is being invalidate because project 5155035f9b3a4247bedfe73c6bffde76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:13.717648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-298af590-d61d-4a58-afa8-28c7fc9f3fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:13.718325 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-298af590-d61d-4a58-afa8-28c7fc9f3fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:13.720314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1301/2646] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:13 2022] DELETE /identity/v3/projects/5155035f9b3a4247bedfe73c6bffde76 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:13.724948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298efcc5-fd6c-4cbd-b0b9-cee72688d459 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:13.725526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298efcc5-fd6c-4cbd-b0b9-cee72688d459 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:13.725526 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298efcc5-fd6c-4cbd-b0b9-cee72688d459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:13.746077 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-298efcc5-fd6c-4cbd-b0b9-cee72688d459 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:13.747268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-298efcc5-fd6c-4cbd-b0b9-cee72688d459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:13.824634 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1346/2647] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:13.835475 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fd2cf-1d2f-4f1d-8c6c-68e8883fd5cf None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:13.836018 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fd2cf-1d2f-4f1d-8c6c-68e8883fd5cf None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:13.838630 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fd2cf-1d2f-4f1d-8c6c-68e8883fd5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:13.864219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0d1fd2cf-1d2f-4f1d-8c6c-68e8883fd5cf None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:13.865976 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0d1fd2cf-1d2f-4f1d-8c6c-68e8883fd5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:13.876519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1302/2648] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:13.881710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298efcc5-fd6c-4cbd-b0b9-cee72688d459 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:13.891608 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298efcc5-fd6c-4cbd-b0b9-cee72688d459 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:13.896226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e0ec2-90bc-4848-a8b9-a5579a6a8120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:13.896930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e0ec2-90bc-4848-a8b9-a5579a6a8120 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:13.897212 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e0ec2-90bc-4848-a8b9-a5579a6a8120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:13.897502 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e0ec2-90bc-4848-a8b9-a5579a6a8120 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:13.898271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e0ec2-90bc-4848-a8b9-a5579a6a8120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:13.898576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e0ec2-90bc-4848-a8b9-a5579a6a8120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:13.900170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e0ec2-90bc-4848-a8b9-a5579a6a8120 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:13.912452 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1347/2649] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:33:13.916967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fd2cf-1d2f-4f1d-8c6c-68e8883fd5cf None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:13.926337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fd2cf-1d2f-4f1d-8c6c-68e8883fd5cf None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:13.931821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79984729-3771-4e10-a320-0d0800082410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:13.932479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79984729-3771-4e10-a320-0d0800082410 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:13.932790 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79984729-3771-4e10-a320-0d0800082410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:13.933064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79984729-3771-4e10-a320-0d0800082410 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:13.933732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79984729-3771-4e10-a320-0d0800082410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:13.935658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79984729-3771-4e10-a320-0d0800082410 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:13.963855 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1303/2650] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:13 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:13.968163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e0ec2-90bc-4848-a8b9-a5579a6a8120 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:13.977983 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e0ec2-90bc-4848-a8b9-a5579a6a8120 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:14.036751 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fbed5-16af-4315-87d1-d93e7e3048ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:14.037960 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fbed5-16af-4315-87d1-d93e7e3048ab admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:14.038241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fbed5-16af-4315-87d1-d93e7e3048ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:14.038514 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fbed5-16af-4315-87d1-d93e7e3048ab admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:14.039154 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fbed5-16af-4315-87d1-d93e7e3048ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:14.041089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fbed5-16af-4315-87d1-d93e7e3048ab admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:14.058142 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:14.065387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1348/2651] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:13 2022] POST /identity/v3/users => generated 279 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:14.070142 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79984729-3771-4e10-a320-0d0800082410 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:14.081038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79984729-3771-4e10-a320-0d0800082410 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:14.086251 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdd491-b205-46d6-9f08-1f7ade34cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:14.086841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdd491-b205-46d6-9f08-1f7ade34cfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:14.087118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdd491-b205-46d6-9f08-1f7ade34cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:14.087386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdd491-b205-46d6-9f08-1f7ade34cfb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:14.088016 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdd491-b205-46d6-9f08-1f7ade34cfb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:14.089624 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdd491-b205-46d6-9f08-1f7ade34cfb6 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:14.099529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1304/2652] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:14.104009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fbed5-16af-4315-87d1-d93e7e3048ab admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:14.113893 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fbed5-16af-4315-87d1-d93e7e3048ab admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:14.118466 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689305e3-4d41-4079-8b47-c340c94e08f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:14.118987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689305e3-4d41-4079-8b47-c340c94e08f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:14.119260 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689305e3-4d41-4079-8b47-c340c94e08f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:14.119528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689305e3-4d41-4079-8b47-c340c94e08f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:14.120156 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689305e3-4d41-4079-8b47-c340c94e08f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:14.121772 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689305e3-4d41-4079-8b47-c340c94e08f7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:14.134039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1349/2653] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:33:14.139284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdd491-b205-46d6-9f08-1f7ade34cfb6 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:14.151455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdd491-b205-46d6-9f08-1f7ade34cfb6 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:14.156208 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b2046-74f9-41fa-8017-c81f8ad14fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:14.156924 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b2046-74f9-41fa-8017-c81f8ad14fae admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:14.157198 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b2046-74f9-41fa-8017-c81f8ad14fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:14.157462 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b2046-74f9-41fa-8017-c81f8ad14fae admin admin] PATH_INFO: `/v3/projects/6a15c66282dd4d5597b04d8e84a0f05d/users/acf40a5e1e944d1999ebffbb1a80a0ad/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:14.173684 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b2046-74f9-41fa-8017-c81f8ad14fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a15c66282dd4d5597b04d8e84a0f05d, user_id=acf40a5e1e944d1999ebffbb1a80a0ad, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:14.176549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b2046-74f9-41fa-8017-c81f8ad14fae admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:14.184593 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:14.190690 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1305/2654] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:14 2022] PUT /identity/v3/projects/6a15c66282dd4d5597b04d8e84a0f05d/users/acf40a5e1e944d1999ebffbb1a80a0ad/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:14.202330 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225eeab-b651-4fc2-b99a-f34e70905aa1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:14.203396 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225eeab-b651-4fc2-b99a-f34e70905aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:14.203396 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225eeab-b651-4fc2-b99a-f34e70905aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:14.231457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3225eeab-b651-4fc2-b99a-f34e70905aa1 None None] MFA Rules not processed for user `acf40a5e1e944d1999ebffbb1a80a0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:14.232678 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3225eeab-b651-4fc2-b99a-f34e70905aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:14.299070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1350/2655] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:14.304281 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b2046-74f9-41fa-8017-c81f8ad14fae admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:14.366234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b2046-74f9-41fa-8017-c81f8ad14fae admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:14.371732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15159031-621c-4440-aaff-0c8bc22d4164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:14.372335 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15159031-621c-4440-aaff-0c8bc22d4164 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:14.372614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15159031-621c-4440-aaff-0c8bc22d4164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:14.372911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15159031-621c-4440-aaff-0c8bc22d4164 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:14.373538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15159031-621c-4440-aaff-0c8bc22d4164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:14.375438 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15159031-621c-4440-aaff-0c8bc22d4164 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:14.403003 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1306/2656] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:14 2022] POST /identity/v3/projects => generated 355 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:14.406848 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225eeab-b651-4fc2-b99a-f34e70905aa1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:14.418147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225eeab-b651-4fc2-b99a-f34e70905aa1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:14.478648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd35ed-0c95-437d-ad2b-6e470e56fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:14.479263 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd35ed-0c95-437d-ad2b-6e470e56fc91 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:14.479543 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd35ed-0c95-437d-ad2b-6e470e56fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:14.479816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd35ed-0c95-437d-ad2b-6e470e56fc91 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:14.480460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd35ed-0c95-437d-ad2b-6e470e56fc91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:14.482405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd35ed-0c95-437d-ad2b-6e470e56fc91 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:14.503461 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1351/2657] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:14 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:14.507577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15159031-621c-4440-aaff-0c8bc22d4164 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:14.518006 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15159031-621c-4440-aaff-0c8bc22d4164 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:14.523170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ef5ad-a763-47ba-9028-9a74727256f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:14.523767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ef5ad-a763-47ba-9028-9a74727256f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:14.524041 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ef5ad-a763-47ba-9028-9a74727256f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:14.524306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ef5ad-a763-47ba-9028-9a74727256f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:14.524988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ef5ad-a763-47ba-9028-9a74727256f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:14.526566 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ef5ad-a763-47ba-9028-9a74727256f8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:14.537989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1307/2658] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:14.542685 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd35ed-0c95-437d-ad2b-6e470e56fc91 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:14.552759 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd35ed-0c95-437d-ad2b-6e470e56fc91 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:14.557388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7852f-9f21-48b8-91ea-fe6cdedc5962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:14.558175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7852f-9f21-48b8-91ea-fe6cdedc5962 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:14.558323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7852f-9f21-48b8-91ea-fe6cdedc5962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:14.558579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7852f-9f21-48b8-91ea-fe6cdedc5962 admin admin] PATH_INFO: `/v3/projects/0579cd5ec4f94a2eacdb34f85646d86b/users/ab55e433ca5a4cc9ae6ef85f59d8ca43/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:14.573440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7852f-9f21-48b8-91ea-fe6cdedc5962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0579cd5ec4f94a2eacdb34f85646d86b, user_id=ab55e433ca5a4cc9ae6ef85f59d8ca43, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:14.576079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7852f-9f21-48b8-91ea-fe6cdedc5962 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:14.589409 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1352/2659] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:14 2022] PUT /identity/v3/projects/0579cd5ec4f94a2eacdb34f85646d86b/users/ab55e433ca5a4cc9ae6ef85f59d8ca43/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:14.593353 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ef5ad-a763-47ba-9028-9a74727256f8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:14.604246 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ef5ad-a763-47ba-9028-9a74727256f8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:14.661112 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5426472-9245-45f8-ae35-4beb4385e028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:14.661745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5426472-9245-45f8-ae35-4beb4385e028 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:14.662047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5426472-9245-45f8-ae35-4beb4385e028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:14.662316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5426472-9245-45f8-ae35-4beb4385e028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:14.662954 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5426472-9245-45f8-ae35-4beb4385e028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:14.664578 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5426472-9245-45f8-ae35-4beb4385e028 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:14.675896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1308/2660] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:14.680950 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7852f-9f21-48b8-91ea-fe6cdedc5962 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:14.691238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7852f-9f21-48b8-91ea-fe6cdedc5962 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:14.696749 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645714c-b3ee-406a-9ea2-ef74624ac44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:14.697641 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645714c-b3ee-406a-9ea2-ef74624ac44a admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:14.697918 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645714c-b3ee-406a-9ea2-ef74624ac44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:14.698186 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645714c-b3ee-406a-9ea2-ef74624ac44a admin admin] PATH_INFO: `/v3/projects/0579cd5ec4f94a2eacdb34f85646d86b/users/ab55e433ca5a4cc9ae6ef85f59d8ca43/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:14.700157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645714c-b3ee-406a-9ea2-ef74624ac44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0579cd5ec4f94a2eacdb34f85646d86b, user_id=ab55e433ca5a4cc9ae6ef85f59d8ca43, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:14.702792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645714c-b3ee-406a-9ea2-ef74624ac44a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:14.713759 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1353/2661] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:14 2022] PUT /identity/v3/projects/0579cd5ec4f94a2eacdb34f85646d86b/users/ab55e433ca5a4cc9ae6ef85f59d8ca43/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:14.727411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5671bc4-a6b1-4180-a067-b656ac1cfeae None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:14.727701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5671bc4-a6b1-4180-a067-b656ac1cfeae None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:14.727973 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5671bc4-a6b1-4180-a067-b656ac1cfeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:14.758055 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b5671bc4-a6b1-4180-a067-b656ac1cfeae None None] MFA Rules not processed for user `ab55e433ca5a4cc9ae6ef85f59d8ca43`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:14.759283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b5671bc4-a6b1-4180-a067-b656ac1cfeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:14.824068 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:14.836131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1309/2662] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:14.847279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645714c-b3ee-406a-9ea2-ef74624ac44a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:14.849030 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9645714c-b3ee-406a-9ea2-ef74624ac44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:14.885602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:14.914511 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645714c-b3ee-406a-9ea2-ef74624ac44a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:14.918234 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa88ddd-9e3c-4d75-9987-b2086ff4985b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:14.918833 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa88ddd-9e3c-4d75-9987-b2086ff4985b service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:14.919111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa88ddd-9e3c-4d75-9987-b2086ff4985b service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:14.919378 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa88ddd-9e3c-4d75-9987-b2086ff4985b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:14.937446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa88ddd-9e3c-4d75-9987-b2086ff4985b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:14.937446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa88ddd-9e3c-4d75-9987-b2086ff4985b service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:14.941676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1354/2663] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:15.020150 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5671bc4-a6b1-4180-a067-b656ac1cfeae None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:15.031994 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5671bc4-a6b1-4180-a067-b656ac1cfeae None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:15.036253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeadfb5-e356-4bf6-95c0-5eec19cf81e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:15.037420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeadfb5-e356-4bf6-95c0-5eec19cf81e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:15.037711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeadfb5-e356-4bf6-95c0-5eec19cf81e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:15.038007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeadfb5-e356-4bf6-95c0-5eec19cf81e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:15.106567 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeadfb5-e356-4bf6-95c0-5eec19cf81e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:15.108087 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeadfb5-e356-4bf6-95c0-5eec19cf81e9 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:15.118017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1310/2664] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:19.393919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa88ddd-9e3c-4d75-9987-b2086ff4985b service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:19.395641 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4fa88ddd-9e3c-4d75-9987-b2086ff4985b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:19.477086 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa88ddd-9e3c-4d75-9987-b2086ff4985b service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:19.482011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf436-6eac-4d89-a81d-03b327603ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:19.482679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf436-6eac-4d89-a81d-03b327603ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:19.484801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf436-6eac-4d89-a81d-03b327603ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:19.484801 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf436-6eac-4d89-a81d-03b327603ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:19.489511 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c4daf436-6eac-4d89-a81d-03b327603ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:19.593349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4daf436-6eac-4d89-a81d-03b327603ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:19.594994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4daf436-6eac-4d89-a81d-03b327603ff0 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:19.607013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1355/2665] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:33:23.808605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeadfb5-e356-4bf6-95c0-5eec19cf81e9 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:23.810050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2eeadfb5-e356-4bf6-95c0-5eec19cf81e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:23.822019 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeadfb5-e356-4bf6-95c0-5eec19cf81e9 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:23.825982 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd34a1f-8da5-4583-b481-24b0a4903fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:23.826566 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd34a1f-8da5-4583-b481-24b0a4903fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:23.826840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd34a1f-8da5-4583-b481-24b0a4903fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:23.827104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd34a1f-8da5-4583-b481-24b0a4903fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:23.828927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8bd34a1f-8da5-4583-b481-24b0a4903fe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:23.897093 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd34a1f-8da5-4583-b481-24b0a4903fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:23.898534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd34a1f-8da5-4583-b481-24b0a4903fe3 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:23.908704 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1311/2666] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:27.336922 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf436-6eac-4d89-a81d-03b327603ff0 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:27.339071 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c4daf436-6eac-4d89-a81d-03b327603ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:27.353343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf436-6eac-4d89-a81d-03b327603ff0 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:27.357894 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88316ba-459a-4073-bccd-3be3bb17eba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:27.358532 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88316ba-459a-4073-bccd-3be3bb17eba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:27.358837 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88316ba-459a-4073-bccd-3be3bb17eba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:27.359132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88316ba-459a-4073-bccd-3be3bb17eba3 admin admin] PATH_INFO: `/v3/users/d6b48a9e72564cefb5a4865d944a9a5e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:27.376219 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88316ba-459a-4073-bccd-3be3bb17eba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b48a9e72564cefb5a4865d944a9a5e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:27.378266 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88316ba-459a-4073-bccd-3be3bb17eba3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:27.439457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a88316ba-459a-4073-bccd-3be3bb17eba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b48a9e72564cefb5a4865d944a9a5e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:27.440160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a88316ba-459a-4073-bccd-3be3bb17eba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b48a9e72564cefb5a4865d944a9a5e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:27.460076 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a88316ba-459a-4073-bccd-3be3bb17eba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b48a9e72564cefb5a4865d944a9a5e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:27.463228 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:27.474703 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a88316ba-459a-4073-bccd-3be3bb17eba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b48a9e72564cefb5a4865d944a9a5e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:27.476020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a88316ba-459a-4073-bccd-3be3bb17eba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b48a9e72564cefb5a4865d944a9a5e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:27.495400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1356/2667] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:27 2022] DELETE /identity/v3/users/d6b48a9e72564cefb5a4865d944a9a5e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:27.700629 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd34a1f-8da5-4583-b481-24b0a4903fe3 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:27.714223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd34a1f-8da5-4583-b481-24b0a4903fe3 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:27.782870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaadb60-f2ef-49cc-a322-828297d25469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:27.783515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaadb60-f2ef-49cc-a322-828297d25469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:27.783796 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaadb60-f2ef-49cc-a322-828297d25469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:27.784071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaadb60-f2ef-49cc-a322-828297d25469 admin admin] PATH_INFO: `/v3/projects/e000d6b64cdc45a0bd071905e4aafc30` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:27.797640 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaadb60-f2ef-49cc-a322-828297d25469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e000d6b64cdc45a0bd071905e4aafc30)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:27.801447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaadb60-f2ef-49cc-a322-828297d25469 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:27.829993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:27.859369 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ceaadb60-f2ef-49cc-a322-828297d25469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e000d6b64cdc45a0bd071905e4aafc30', 'request_id': 'req-ceaadb60-f2ef-49cc-a322-828297d25469'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:27.866856 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ceaadb60-f2ef-49cc-a322-828297d25469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e000d6b64cdc45a0bd071905e4aafc30', 'request_id': 'req-ceaadb60-f2ef-49cc-a322-828297d25469'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:27.875131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ceaadb60-f2ef-49cc-a322-828297d25469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e000d6b64cdc45a0bd071905e4aafc30', 'request_id': 'req-ceaadb60-f2ef-49cc-a322-828297d25469'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:27.890043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ceaadb60-f2ef-49cc-a322-828297d25469 admin admin] The token cache is being invalidate because project e000d6b64cdc45a0bd071905e4aafc30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:27.890375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ceaadb60-f2ef-49cc-a322-828297d25469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:27.891367 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ceaadb60-f2ef-49cc-a322-828297d25469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:27.892937 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1312/2668] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:27 2022] DELETE /identity/v3/projects/e000d6b64cdc45a0bd071905e4aafc30 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:27.898418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85318b2-8b5f-4138-bc43-02f1136424d8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:27.898704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85318b2-8b5f-4138-bc43-02f1136424d8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:27.898979 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85318b2-8b5f-4138-bc43-02f1136424d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:27.920109 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e85318b2-8b5f-4138-bc43-02f1136424d8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:27.921345 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e85318b2-8b5f-4138-bc43-02f1136424d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:27.984326 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1357/2669] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:27.992429 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a08332-04b2-40f3-a145-19842b1f6906 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:27.992745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a08332-04b2-40f3-a145-19842b1f6906 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:27.993022 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a08332-04b2-40f3-a145-19842b1f6906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:28.012720 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-71a08332-04b2-40f3-a145-19842b1f6906 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:28.013945 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-71a08332-04b2-40f3-a145-19842b1f6906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:28.022777 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1313/2670] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:28.027088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85318b2-8b5f-4138-bc43-02f1136424d8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:28.039106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85318b2-8b5f-4138-bc43-02f1136424d8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:28.043426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80308-06eb-42dd-9b11-81ae8a8874cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:28.044035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80308-06eb-42dd-9b11-81ae8a8874cd admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:28.044309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80308-06eb-42dd-9b11-81ae8a8874cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:28.044574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80308-06eb-42dd-9b11-81ae8a8874cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:28.045440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80308-06eb-42dd-9b11-81ae8a8874cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:28.045825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80308-06eb-42dd-9b11-81ae8a8874cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:28.047411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80308-06eb-42dd-9b11-81ae8a8874cd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:28.060144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1358/2671] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:33:28.065902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a08332-04b2-40f3-a145-19842b1f6906 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:28.076414 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a08332-04b2-40f3-a145-19842b1f6906 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:28.081187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2f0eb-aa6d-49d0-b232-5477acfcb8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:28.081797 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2f0eb-aa6d-49d0-b232-5477acfcb8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:28.082078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2f0eb-aa6d-49d0-b232-5477acfcb8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:28.082349 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2f0eb-aa6d-49d0-b232-5477acfcb8a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:28.082981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2f0eb-aa6d-49d0-b232-5477acfcb8a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:28.084964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2f0eb-aa6d-49d0-b232-5477acfcb8a4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:28.113922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1314/2672] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:28 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:28.120279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80308-06eb-42dd-9b11-81ae8a8874cd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:28.131125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80308-06eb-42dd-9b11-81ae8a8874cd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:28.189224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4b087-c0b4-42b1-a67d-c26ea321a14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:28.189830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4b087-c0b4-42b1-a67d-c26ea321a14d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:28.190106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4b087-c0b4-42b1-a67d-c26ea321a14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:28.190373 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4b087-c0b4-42b1-a67d-c26ea321a14d admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:28.191064 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4b087-c0b4-42b1-a67d-c26ea321a14d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:28.193687 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4b087-c0b4-42b1-a67d-c26ea321a14d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:28.216996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1359/2673] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:28 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:28.221328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2f0eb-aa6d-49d0-b232-5477acfcb8a4 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:28.233480 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2f0eb-aa6d-49d0-b232-5477acfcb8a4 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:28.238187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdbae0-a04b-4339-b87c-fcdc1830aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:28.238784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdbae0-a04b-4339-b87c-fcdc1830aaee admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:28.239059 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdbae0-a04b-4339-b87c-fcdc1830aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:28.239333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdbae0-a04b-4339-b87c-fcdc1830aaee admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:28.240595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdbae0-a04b-4339-b87c-fcdc1830aaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:28.242253 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdbae0-a04b-4339-b87c-fcdc1830aaee admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:28.256450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1315/2674] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:28.260731 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4b087-c0b4-42b1-a67d-c26ea321a14d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:28.270999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4b087-c0b4-42b1-a67d-c26ea321a14d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:28.277084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079d2c8-a046-4f13-8acd-55b573d6ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:28.277710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079d2c8-a046-4f13-8acd-55b573d6ad9e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:28.277993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079d2c8-a046-4f13-8acd-55b573d6ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:28.278265 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079d2c8-a046-4f13-8acd-55b573d6ad9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:28.278911 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079d2c8-a046-4f13-8acd-55b573d6ad9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:28.280507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079d2c8-a046-4f13-8acd-55b573d6ad9e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:28.292443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1360/2675] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:28.296719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdbae0-a04b-4339-b87c-fcdc1830aaee admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:28.307337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdbae0-a04b-4339-b87c-fcdc1830aaee admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:28.312289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aed4c-f939-4331-9929-9a9c997797f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:28.312998 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aed4c-f939-4331-9929-9a9c997797f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:28.313277 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aed4c-f939-4331-9929-9a9c997797f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:28.313552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aed4c-f939-4331-9929-9a9c997797f8 admin admin] PATH_INFO: `/v3/projects/53a6dda79b154408a86bed272996d165/users/17315244cf3c479b9f5f9e73a60e3195/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:28.330352 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599aed4c-f939-4331-9929-9a9c997797f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a6dda79b154408a86bed272996d165, user_id=17315244cf3c479b9f5f9e73a60e3195, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:28.333064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599aed4c-f939-4331-9929-9a9c997797f8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:28.346403 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1316/2676] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:28 2022] PUT /identity/v3/projects/53a6dda79b154408a86bed272996d165/users/17315244cf3c479b9f5f9e73a60e3195/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:28.358541 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bcf40-df0e-481f-b4ec-92f8cf13d992 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:28.359122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bcf40-df0e-481f-b4ec-92f8cf13d992 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:28.359122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bcf40-df0e-481f-b4ec-92f8cf13d992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:28.387144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b57bcf40-df0e-481f-b4ec-92f8cf13d992 None None] MFA Rules not processed for user `17315244cf3c479b9f5f9e73a60e3195`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:28.388431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b57bcf40-df0e-481f-b4ec-92f8cf13d992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:28.419639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:28.457821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1361/2677] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:28.470633 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aed4c-f939-4331-9929-9a9c997797f8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:28.472511 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-599aed4c-f939-4331-9929-9a9c997797f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:28.550489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aed4c-f939-4331-9929-9a9c997797f8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:28.555064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f71d57-d8e1-4484-a065-2fe200a0f07c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:28.555683 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f71d57-d8e1-4484-a065-2fe200a0f07c service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:28.555959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f71d57-d8e1-4484-a065-2fe200a0f07c service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:28.556228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f71d57-d8e1-4484-a065-2fe200a0f07c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:28.564712 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f71d57-d8e1-4484-a065-2fe200a0f07c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:28.566307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f71d57-d8e1-4484-a065-2fe200a0f07c service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:28.575837 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1317/2678] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:28.597934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bcf40-df0e-481f-b4ec-92f8cf13d992 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:28.599457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b57bcf40-df0e-481f-b4ec-92f8cf13d992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:28.656048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bcf40-df0e-481f-b4ec-92f8cf13d992 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:28.660286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c8d17-83b2-4cf5-b923-7a1b8f0409f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:28.661020 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8d17-83b2-4cf5-b923-7a1b8f0409f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:28.661298 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8d17-83b2-4cf5-b923-7a1b8f0409f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:28.661598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8d17-83b2-4cf5-b923-7a1b8f0409f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:28.663435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8e8c8d17-83b2-4cf5-b923-7a1b8f0409f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:28.678605 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c8d17-83b2-4cf5-b923-7a1b8f0409f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:28.680536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c8d17-83b2-4cf5-b923-7a1b8f0409f6 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:28.693574 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1362/2679] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:30.534330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f71d57-d8e1-4484-a065-2fe200a0f07c service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:30.536091 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-03f71d57-d8e1-4484-a065-2fe200a0f07c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:30.571875 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:30.608726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f71d57-d8e1-4484-a065-2fe200a0f07c service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:30.613396 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bdb17-83d4-47d5-876f-8c56ced8f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:30.614019 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bdb17-83d4-47d5-876f-8c56ced8f58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:30.614297 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bdb17-83d4-47d5-876f-8c56ced8f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:30.614613 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bdb17-83d4-47d5-876f-8c56ced8f58f admin admin] PATH_INFO: `/v3/users/acf40a5e1e944d1999ebffbb1a80a0ad` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:30.615747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bdb17-83d4-47d5-876f-8c56ced8f58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf40a5e1e944d1999ebffbb1a80a0ad)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:30.618524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bdb17-83d4-47d5-876f-8c56ced8f58f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:30.666500 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-800bdb17-83d4-47d5-876f-8c56ced8f58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf40a5e1e944d1999ebffbb1a80a0ad'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:30.667080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-800bdb17-83d4-47d5-876f-8c56ced8f58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf40a5e1e944d1999ebffbb1a80a0ad'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:30.667732 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-800bdb17-83d4-47d5-876f-8c56ced8f58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf40a5e1e944d1999ebffbb1a80a0ad'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:30.674969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-800bdb17-83d4-47d5-876f-8c56ced8f58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf40a5e1e944d1999ebffbb1a80a0ad'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:30.687405 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-800bdb17-83d4-47d5-876f-8c56ced8f58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf40a5e1e944d1999ebffbb1a80a0ad'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:30.700138 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1318/2680] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:30 2022] DELETE /identity/v3/users/acf40a5e1e944d1999ebffbb1a80a0ad => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:30.704660 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554dd52-8897-4151-aff1-c1a7a9b0bbea None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:30.705177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554dd52-8897-4151-aff1-c1a7a9b0bbea None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:30.705311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554dd52-8897-4151-aff1-c1a7a9b0bbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:30.724265 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6554dd52-8897-4151-aff1-c1a7a9b0bbea None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:30.726022 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6554dd52-8897-4151-aff1-c1a7a9b0bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:30.787347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1363/2681] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:30.797777 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bdb17-83d4-47d5-876f-8c56ced8f58f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:30.799211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-800bdb17-83d4-47d5-876f-8c56ced8f58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:30.859316 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bdb17-83d4-47d5-876f-8c56ced8f58f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:30.863028 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21a765-77ab-4525-8542-9d8f80f47a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:30.863635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21a765-77ab-4525-8542-9d8f80f47a87 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:30.863914 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21a765-77ab-4525-8542-9d8f80f47a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:30.864191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21a765-77ab-4525-8542-9d8f80f47a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:30.873693 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21a765-77ab-4525-8542-9d8f80f47a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:30.875155 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21a765-77ab-4525-8542-9d8f80f47a87 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:30.885429 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1319/2682] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:31.175611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554dd52-8897-4151-aff1-c1a7a9b0bbea None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:31.177217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6554dd52-8897-4151-aff1-c1a7a9b0bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:31.194771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554dd52-8897-4151-aff1-c1a7a9b0bbea None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:31.201144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:31.202146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:31.202448 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:31.202717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] PATH_INFO: `/v3/projects/6a15c66282dd4d5597b04d8e84a0f05d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:31.204056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a15c66282dd4d5597b04d8e84a0f05d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:31.206030 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:31.264353 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a15c66282dd4d5597b04d8e84a0f05d', 'request_id': 'req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.270272 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a15c66282dd4d5597b04d8e84a0f05d', 'request_id': 'req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.277835 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a15c66282dd4d5597b04d8e84a0f05d', 'request_id': 'req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.285272 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:31.291112 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] The token cache is being invalidate because project 6a15c66282dd4d5597b04d8e84a0f05d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:31.291423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.292217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.294269 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1364/2683] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:31 2022] DELETE /identity/v3/projects/6a15c66282dd4d5597b04d8e84a0f05d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:31.298272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21a765-77ab-4525-8542-9d8f80f47a87 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:31.308788 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21a765-77ab-4525-8542-9d8f80f47a87 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:31.358046 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:31.371926 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25ef94-004a-49d7-b254-40880d1d8e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:31.372562 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25ef94-004a-49d7-b254-40880d1d8e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:31.372866 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25ef94-004a-49d7-b254-40880d1d8e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:31.373139 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25ef94-004a-49d7-b254-40880d1d8e3e admin admin] PATH_INFO: `/v3/users/ab55e433ca5a4cc9ae6ef85f59d8ca43` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:31.374309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25ef94-004a-49d7-b254-40880d1d8e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab55e433ca5a4cc9ae6ef85f59d8ca43)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:31.376211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25ef94-004a-49d7-b254-40880d1d8e3e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:31.425874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2e25ef94-004a-49d7-b254-40880d1d8e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab55e433ca5a4cc9ae6ef85f59d8ca43'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.426534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2e25ef94-004a-49d7-b254-40880d1d8e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab55e433ca5a4cc9ae6ef85f59d8ca43'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.427144 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2e25ef94-004a-49d7-b254-40880d1d8e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab55e433ca5a4cc9ae6ef85f59d8ca43'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.434632 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2e25ef94-004a-49d7-b254-40880d1d8e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab55e433ca5a4cc9ae6ef85f59d8ca43'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.446782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-2e25ef94-004a-49d7-b254-40880d1d8e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab55e433ca5a4cc9ae6ef85f59d8ca43'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.467172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1320/2684] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:31 2022] DELETE /identity/v3/users/ab55e433ca5a4cc9ae6ef85f59d8ca43 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:31.518680 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:31.518680 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:31.532198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ff11d-b534-4ca3-bffc-6cfccdce8102 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:31.609933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ed099-83a0-4e00-ab3f-1f0d6c609fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:31.610461 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ed099-83a0-4e00-ab3f-1f0d6c609fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:31.610735 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ed099-83a0-4e00-ab3f-1f0d6c609fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:31.611002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ed099-83a0-4e00-ab3f-1f0d6c609fe5 admin admin] PATH_INFO: `/v3/users/17315244cf3c479b9f5f9e73a60e3195` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:31.612164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ed099-83a0-4e00-ab3f-1f0d6c609fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17315244cf3c479b9f5f9e73a60e3195)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:31.614084 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ed099-83a0-4e00-ab3f-1f0d6c609fe5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:31.668707 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d99ed099-83a0-4e00-ab3f-1f0d6c609fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17315244cf3c479b9f5f9e73a60e3195'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.669419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d99ed099-83a0-4e00-ab3f-1f0d6c609fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17315244cf3c479b9f5f9e73a60e3195'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.682357 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d99ed099-83a0-4e00-ab3f-1f0d6c609fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17315244cf3c479b9f5f9e73a60e3195'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.689492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d99ed099-83a0-4e00-ab3f-1f0d6c609fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17315244cf3c479b9f5f9e73a60e3195'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.690195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d99ed099-83a0-4e00-ab3f-1f0d6c609fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17315244cf3c479b9f5f9e73a60e3195'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.709183 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1365/2685] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:31 2022] DELETE /identity/v3/users/17315244cf3c479b9f5f9e73a60e3195 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:31.714114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03ddc7-196f-436a-8d66-abd63e90d131 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:31.714583 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03ddc7-196f-436a-8d66-abd63e90d131 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:31.714684 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03ddc7-196f-436a-8d66-abd63e90d131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:31.735541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ff03ddc7-196f-436a-8d66-abd63e90d131 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:31.736670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ff03ddc7-196f-436a-8d66-abd63e90d131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:31.772271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ed099-83a0-4e00-ab3f-1f0d6c609fe5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:31.773762 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d99ed099-83a0-4e00-ab3f-1f0d6c609fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:31.811448 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1321/2686] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:31.821686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03ddc7-196f-436a-8d66-abd63e90d131 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:31.823547 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ff03ddc7-196f-436a-8d66-abd63e90d131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:31.850050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ed099-83a0-4e00-ab3f-1f0d6c609fe5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:31.854891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ecba0-e08a-4f41-9534-9205370e63eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:31.855549 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ecba0-e08a-4f41-9534-9205370e63eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:31.855831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ecba0-e08a-4f41-9534-9205370e63eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:31.856110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ecba0-e08a-4f41-9534-9205370e63eb admin admin] PATH_INFO: `/v3/projects/0579cd5ec4f94a2eacdb34f85646d86b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:31.857277 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ecba0-e08a-4f41-9534-9205370e63eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0579cd5ec4f94a2eacdb34f85646d86b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:31.859162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ecba0-e08a-4f41-9534-9205370e63eb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:31.883224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:31.890504 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03ddc7-196f-436a-8d66-abd63e90d131 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:31.894387 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5eba1-213e-4177-a767-4e036226bf60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:31.895038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5eba1-213e-4177-a767-4e036226bf60 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:31.895392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5eba1-213e-4177-a767-4e036226bf60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:31.895582 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5eba1-213e-4177-a767-4e036226bf60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:31.905770 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5eba1-213e-4177-a767-4e036226bf60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:31.907229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5eba1-213e-4177-a767-4e036226bf60 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:31.916321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-889ecba0-e08a-4f41-9534-9205370e63eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0579cd5ec4f94a2eacdb34f85646d86b', 'request_id': 'req-889ecba0-e08a-4f41-9534-9205370e63eb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.920752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1322/2687] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:31.923507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-889ecba0-e08a-4f41-9534-9205370e63eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0579cd5ec4f94a2eacdb34f85646d86b', 'request_id': 'req-889ecba0-e08a-4f41-9534-9205370e63eb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.934483 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-889ecba0-e08a-4f41-9534-9205370e63eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0579cd5ec4f94a2eacdb34f85646d86b', 'request_id': 'req-889ecba0-e08a-4f41-9534-9205370e63eb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.949249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-889ecba0-e08a-4f41-9534-9205370e63eb admin admin] The token cache is being invalidate because project 0579cd5ec4f94a2eacdb34f85646d86b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:31.949710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-889ecba0-e08a-4f41-9534-9205370e63eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.950395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-889ecba0-e08a-4f41-9534-9205370e63eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:31.951972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1366/2688] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:31 2022] DELETE /identity/v3/projects/0579cd5ec4f94a2eacdb34f85646d86b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:31.958099 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd9bf9-53ce-42d8-a024-ee288c6361a0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:31.958392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd9bf9-53ce-42d8-a024-ee288c6361a0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:31.958689 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd9bf9-53ce-42d8-a024-ee288c6361a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:31.979974 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-bddd9bf9-53ce-42d8-a024-ee288c6361a0 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:31.981278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bddd9bf9-53ce-42d8-a024-ee288c6361a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:31.991362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:32.053421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1323/2689] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:32.062306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a39a-0017-4943-86c9-3b99050166de None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.062664 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a39a-0017-4943-86c9-3b99050166de None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.062921 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a39a-0017-4943-86c9-3b99050166de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.096133 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e8d8a39a-0017-4943-86c9-3b99050166de None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:32.097817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e8d8a39a-0017-4943-86c9-3b99050166de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:32.105740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1367/2690] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:32.110066 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd9bf9-53ce-42d8-a024-ee288c6361a0 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.124848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd9bf9-53ce-42d8-a024-ee288c6361a0 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.129861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0c618-d43c-4e40-b772-1c00fa2223d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.130475 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0c618-d43c-4e40-b772-1c00fa2223d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.130754 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0c618-d43c-4e40-b772-1c00fa2223d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.131026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0c618-d43c-4e40-b772-1c00fa2223d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.132229 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0c618-d43c-4e40-b772-1c00fa2223d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:32.132539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0c618-d43c-4e40-b772-1c00fa2223d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.134193 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0c618-d43c-4e40-b772-1c00fa2223d2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.153057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1324/2691] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:33:32.157621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8a39a-0017-4943-86c9-3b99050166de None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.167140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8a39a-0017-4943-86c9-3b99050166de None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.171968 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e90d1b-bbd8-4898-856d-9dfaa9efda77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.172597 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e90d1b-bbd8-4898-856d-9dfaa9efda77 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.172903 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e90d1b-bbd8-4898-856d-9dfaa9efda77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.173174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e90d1b-bbd8-4898-856d-9dfaa9efda77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.173805 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e90d1b-bbd8-4898-856d-9dfaa9efda77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.175695 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e90d1b-bbd8-4898-856d-9dfaa9efda77 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.209610 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1368/2692] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:32 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:32.216677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0c618-d43c-4e40-b772-1c00fa2223d2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.230526 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0c618-d43c-4e40-b772-1c00fa2223d2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.233088 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e90d1b-bbd8-4898-856d-9dfaa9efda77 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.235250 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e0e90d1b-bbd8-4898-856d-9dfaa9efda77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:32.320282 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dc722-f7bc-4b10-af0f-55672b4eea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.320988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dc722-f7bc-4b10-af0f-55672b4eea6e admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.321266 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dc722-f7bc-4b10-af0f-55672b4eea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.321540 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dc722-f7bc-4b10-af0f-55672b4eea6e admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.322596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dc722-f7bc-4b10-af0f-55672b4eea6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.325065 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dc722-f7bc-4b10-af0f-55672b4eea6e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.333507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e90d1b-bbd8-4898-856d-9dfaa9efda77 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.340548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.341288 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.341657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.342008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d admin admin] PATH_INFO: `/v3/projects/53a6dda79b154408a86bed272996d165` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.343268 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a6dda79b154408a86bed272996d165)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.345196 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.347907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1325/2693] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:32 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:32.352767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dc722-f7bc-4b10-af0f-55672b4eea6e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.362678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dc722-f7bc-4b10-af0f-55672b4eea6e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.367390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356e5f3-d238-4cda-91f2-354b168901ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.367980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356e5f3-d238-4cda-91f2-354b168901ba admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.368260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356e5f3-d238-4cda-91f2-354b168901ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.368530 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356e5f3-d238-4cda-91f2-354b168901ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.369200 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356e5f3-d238-4cda-91f2-354b168901ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.370794 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356e5f3-d238-4cda-91f2-354b168901ba admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.386683 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1326/2694] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:33:32.391127 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356e5f3-d238-4cda-91f2-354b168901ba admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.399419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a6dda79b154408a86bed272996d165', 'request_id': 'req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:32.402224 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356e5f3-d238-4cda-91f2-354b168901ba admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.408304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a6dda79b154408a86bed272996d165', 'request_id': 'req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:32.417688 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a6dda79b154408a86bed272996d165', 'request_id': 'req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:32.429446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d admin admin] The token cache is being invalidate because project 53a6dda79b154408a86bed272996d165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:32.429723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:32.430375 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7e084eeb-40f8-4c8b-93fd-2b1c01db053d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:32.431871 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1369/2695] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:32 2022] DELETE /identity/v3/projects/53a6dda79b154408a86bed272996d165 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:32.436505 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7439b85-eb4c-4439-9eda-01b46132b3bc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.436820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7439b85-eb4c-4439-9eda-01b46132b3bc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.437096 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7439b85-eb4c-4439-9eda-01b46132b3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.457005 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b7439b85-eb4c-4439-9eda-01b46132b3bc None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:32.458217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b7439b85-eb4c-4439-9eda-01b46132b3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:32.463293 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:32.477186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd971ea-8552-4321-a035-aaf90d0973be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.477831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd971ea-8552-4321-a035-aaf90d0973be admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.478098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd971ea-8552-4321-a035-aaf90d0973be admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.478369 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd971ea-8552-4321-a035-aaf90d0973be admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.479047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd971ea-8552-4321-a035-aaf90d0973be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.480674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd971ea-8552-4321-a035-aaf90d0973be admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.494845 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1327/2696] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:32.495551 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd971ea-8552-4321-a035-aaf90d0973be admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.497437 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2fd971ea-8552-4321-a035-aaf90d0973be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:32.510791 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd971ea-8552-4321-a035-aaf90d0973be admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.518062 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f14dd-ecd3-406b-aa0b-578b474a6daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.518737 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f14dd-ecd3-406b-aa0b-578b474a6daf admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.519058 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f14dd-ecd3-406b-aa0b-578b474a6daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.519319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f14dd-ecd3-406b-aa0b-578b474a6daf admin admin] PATH_INFO: `/v3/projects/5f37e1ada6804794b7680c0b903f9abd/users/29b80046ddbf43c598fa3cc6cdf5d7c7/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.530319 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1370/2697] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:32.533642 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:32.536941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f14dd-ecd3-406b-aa0b-578b474a6daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f37e1ada6804794b7680c0b903f9abd, user_id=29b80046ddbf43c598fa3cc6cdf5d7c7, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.540023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28a22b-f7ca-4d5e-b07c-83127c3faf96 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.540268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f14dd-ecd3-406b-aa0b-578b474a6daf admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.540401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28a22b-f7ca-4d5e-b07c-83127c3faf96 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.540568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28a22b-f7ca-4d5e-b07c-83127c3faf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.555559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1328/2698] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:32 2022] PUT /identity/v3/projects/5f37e1ada6804794b7680c0b903f9abd/users/29b80046ddbf43c598fa3cc6cdf5d7c7/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:32.563011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-de28a22b-f7ca-4d5e-b07c-83127c3faf96 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:32.565051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-de28a22b-f7ca-4d5e-b07c-83127c3faf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:32.565751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb66ad5-1b59-427d-b7c9-4b7a24eace88 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.566110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb66ad5-1b59-427d-b7c9-4b7a24eace88 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.566318 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb66ad5-1b59-427d-b7c9-4b7a24eace88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.596384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1fb66ad5-1b59-427d-b7c9-4b7a24eace88 None None] MFA Rules not processed for user `29b80046ddbf43c598fa3cc6cdf5d7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:32.597655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1fb66ad5-1b59-427d-b7c9-4b7a24eace88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:32.636106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1371/2699] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:32.640242 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28a22b-f7ca-4d5e-b07c-83127c3faf96 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.649392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28a22b-f7ca-4d5e-b07c-83127c3faf96 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.654579 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012f7c0-f8fc-4b7d-9a16-8d9bc039acd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.655249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f7c0-f8fc-4b7d-9a16-8d9bc039acd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.655606 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f7c0-f8fc-4b7d-9a16-8d9bc039acd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.655900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f7c0-f8fc-4b7d-9a16-8d9bc039acd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.656571 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012f7c0-f8fc-4b7d-9a16-8d9bc039acd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:32.656977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012f7c0-f8fc-4b7d-9a16-8d9bc039acd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.658641 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012f7c0-f8fc-4b7d-9a16-8d9bc039acd4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.676740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1372/2700] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:33:32.676967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1329/2701] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:32.678159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012f7c0-f8fc-4b7d-9a16-8d9bc039acd4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.678334 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb66ad5-1b59-427d-b7c9-4b7a24eace88 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.689057 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012f7c0-f8fc-4b7d-9a16-8d9bc039acd4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.689961 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb66ad5-1b59-427d-b7c9-4b7a24eace88 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.694240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1d2e5-0cfa-4d83-b677-67d2bafb63b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.694886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1d2e5-0cfa-4d83-b677-67d2bafb63b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.695169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1d2e5-0cfa-4d83-b677-67d2bafb63b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.695301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5e383-cca9-4824-8afc-44277bda2c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.695481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1d2e5-0cfa-4d83-b677-67d2bafb63b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.695856 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e383-cca9-4824-8afc-44277bda2c8b admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.696133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e383-cca9-4824-8afc-44277bda2c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.696283 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1d2e5-0cfa-4d83-b677-67d2bafb63b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.696390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e383-cca9-4824-8afc-44277bda2c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.697034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5e383-cca9-4824-8afc-44277bda2c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.698457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1d2e5-0cfa-4d83-b677-67d2bafb63b7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.699175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5e383-cca9-4824-8afc-44277bda2c8b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.729361 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1373/2702] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:32 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:32.734369 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1330/2703] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:32 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:32.734817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1d2e5-0cfa-4d83-b677-67d2bafb63b7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.735314 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5e383-cca9-4824-8afc-44277bda2c8b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.807797 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5e383-cca9-4824-8afc-44277bda2c8b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.808823 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1d2e5-0cfa-4d83-b677-67d2bafb63b7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.812572 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22744372-a8ff-41cd-8cfb-bd8fd7529cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.813223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22744372-a8ff-41cd-8cfb-bd8fd7529cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.813499 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22744372-a8ff-41cd-8cfb-bd8fd7529cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.813617 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9698329-f307-407a-b690-88babf6879f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.813774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22744372-a8ff-41cd-8cfb-bd8fd7529cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.814124 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9698329-f307-407a-b690-88babf6879f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.814407 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9698329-f307-407a-b690-88babf6879f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.814541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22744372-a8ff-41cd-8cfb-bd8fd7529cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.814679 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9698329-f307-407a-b690-88babf6879f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.815510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9698329-f307-407a-b690-88babf6879f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.816321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22744372-a8ff-41cd-8cfb-bd8fd7529cf5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.817333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9698329-f307-407a-b690-88babf6879f8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.844028 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1331/2705] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:32 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:32.844262 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1374/2705] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:32 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:32.845312 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22744372-a8ff-41cd-8cfb-bd8fd7529cf5 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.845478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9698329-f307-407a-b690-88babf6879f8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.852919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:32.856070 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22744372-a8ff-41cd-8cfb-bd8fd7529cf5 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.856421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9698329-f307-407a-b690-88babf6879f8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.861174 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccce28f-f9a6-47a0-bbd0-0f195433ca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.862013 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccce28f-f9a6-47a0-bbd0-0f195433ca9e admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.862288 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccce28f-f9a6-47a0-bbd0-0f195433ca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.862580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5c815-aebb-484d-9a08-eeb1e43db466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.862706 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccce28f-f9a6-47a0-bbd0-0f195433ca9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.863226 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5c815-aebb-484d-9a08-eeb1e43db466 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.863356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccce28f-f9a6-47a0-bbd0-0f195433ca9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.863507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5c815-aebb-484d-9a08-eeb1e43db466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.863779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5c815-aebb-484d-9a08-eeb1e43db466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.864414 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5c815-aebb-484d-9a08-eeb1e43db466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.865267 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccce28f-f9a6-47a0-bbd0-0f195433ca9e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.866108 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5c815-aebb-484d-9a08-eeb1e43db466 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.877551 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1332/2706] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:33:32.885045 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1375/2707] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:33:32.885218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccce28f-f9a6-47a0-bbd0-0f195433ca9e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.886393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5c815-aebb-484d-9a08-eeb1e43db466 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.893434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccce28f-f9a6-47a0-bbd0-0f195433ca9e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.896071 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5c815-aebb-484d-9a08-eeb1e43db466 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.898175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391a980-7dfb-4730-8f12-2845471bbcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.898858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391a980-7dfb-4730-8f12-2845471bbcf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.899113 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391a980-7dfb-4730-8f12-2845471bbcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.899389 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391a980-7dfb-4730-8f12-2845471bbcf4 admin admin] PATH_INFO: `/v3/projects/b8281b758ec344d1aa700c9c4693bf35/users/69138071cda54a83a7a63d95648e3796/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.900811 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebae780-77b7-41bf-9dd8-2ed983b9f9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.901395 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebae780-77b7-41bf-9dd8-2ed983b9f9cc admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.901849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebae780-77b7-41bf-9dd8-2ed983b9f9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.902139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebae780-77b7-41bf-9dd8-2ed983b9f9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:32.903617 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebae780-77b7-41bf-9dd8-2ed983b9f9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.905216 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebae780-77b7-41bf-9dd8-2ed983b9f9cc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.915395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391a980-7dfb-4730-8f12-2845471bbcf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8281b758ec344d1aa700c9c4693bf35, user_id=69138071cda54a83a7a63d95648e3796, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:32.916298 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1376/2708] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:33:32.918574 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391a980-7dfb-4730-8f12-2845471bbcf4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:32.920322 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebae780-77b7-41bf-9dd8-2ed983b9f9cc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.931403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebae780-77b7-41bf-9dd8-2ed983b9f9cc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:32.932679 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1333/2709] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:32 2022] PUT /identity/v3/projects/b8281b758ec344d1aa700c9c4693bf35/users/69138071cda54a83a7a63d95648e3796/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:32.937255 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391a980-7dfb-4730-8f12-2845471bbcf4 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:32.953501 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:32.995310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a7add-ff9c-4047-a506-2b4a8c6c4f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:32.996006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a7add-ff9c-4047-a506-2b4a8c6c4f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:32.996307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a7add-ff9c-4047-a506-2b4a8c6c4f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:32.996576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a7add-ff9c-4047-a506-2b4a8c6c4f9f admin admin] PATH_INFO: `/v3/projects/7bb07997bc684e518593412a46dc8b52/users/4f87e9933ea74026bb6e4789d442bb06/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:33.004940 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391a980-7dfb-4730-8f12-2845471bbcf4 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:33.010446 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657cbcb-4e9c-4326-9c9a-37624761a25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:33.011467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657cbcb-4e9c-4326-9c9a-37624761a25a admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:33.011668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a7add-ff9c-4047-a506-2b4a8c6c4f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb07997bc684e518593412a46dc8b52, user_id=4f87e9933ea74026bb6e4789d442bb06, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:33.011790 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657cbcb-4e9c-4326-9c9a-37624761a25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:33.012131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657cbcb-4e9c-4326-9c9a-37624761a25a admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:33.012965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657cbcb-4e9c-4326-9c9a-37624761a25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:33.014701 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a7add-ff9c-4047-a506-2b4a8c6c4f9f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:33.015119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657cbcb-4e9c-4326-9c9a-37624761a25a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:33.028272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1334/2710] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:33:33.032262 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657cbcb-4e9c-4326-9c9a-37624761a25a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:33.032988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1377/2711] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:32 2022] PUT /identity/v3/projects/7bb07997bc684e518593412a46dc8b52/users/4f87e9933ea74026bb6e4789d442bb06/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:33.042775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657cbcb-4e9c-4326-9c9a-37624761a25a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:33.043139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6cab-44c9-40b1-9d07-9d38c2f77dac None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:33.043504 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6cab-44c9-40b1-9d07-9d38c2f77dac None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:33.043851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6cab-44c9-40b1-9d07-9d38c2f77dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:33.076467 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3a4d6cab-44c9-40b1-9d07-9d38c2f77dac None None] MFA Rules not processed for user `4f87e9933ea74026bb6e4789d442bb06`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:33.077657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3a4d6cab-44c9-40b1-9d07-9d38c2f77dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:33.107965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f7e82-8eb8-42a0-ac57-1ae3b31bda49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:33.108629 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f7e82-8eb8-42a0-ac57-1ae3b31bda49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:33.108941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f7e82-8eb8-42a0-ac57-1ae3b31bda49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:33.109215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f7e82-8eb8-42a0-ac57-1ae3b31bda49 admin admin] PATH_INFO: `/v3/projects/b8281b758ec344d1aa700c9c4693bf35/users/69138071cda54a83a7a63d95648e3796/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:33.111328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f7e82-8eb8-42a0-ac57-1ae3b31bda49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8281b758ec344d1aa700c9c4693bf35, user_id=69138071cda54a83a7a63d95648e3796, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:33.114233 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f7e82-8eb8-42a0-ac57-1ae3b31bda49 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:33.126219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1335/2712] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:33 2022] PUT /identity/v3/projects/b8281b758ec344d1aa700c9c4693bf35/users/69138071cda54a83a7a63d95648e3796/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:33.138070 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5655a16-515a-44fb-9480-0b40e14815f7 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:33.138622 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5655a16-515a-44fb-9480-0b40e14815f7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:33.138991 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5655a16-515a-44fb-9480-0b40e14815f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:33.145087 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1378/2713] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:33.150379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d6cab-44c9-40b1-9d07-9d38c2f77dac None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:33.162441 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d6cab-44c9-40b1-9d07-9d38c2f77dac None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:33.168803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c5655a16-515a-44fb-9480-0b40e14815f7 None None] MFA Rules not processed for user `69138071cda54a83a7a63d95648e3796`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:33.170032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c5655a16-515a-44fb-9480-0b40e14815f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:33.214429 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:33.222417 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6655a-2f4d-4c13-85de-4bfb9c3162ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:33.223237 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6655a-2f4d-4c13-85de-4bfb9c3162ba admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:33.223525 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6655a-2f4d-4c13-85de-4bfb9c3162ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:33.223794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6655a-2f4d-4c13-85de-4bfb9c3162ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:33.224426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6655a-2f4d-4c13-85de-4bfb9c3162ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:33.227083 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6655a-2f4d-4c13-85de-4bfb9c3162ba admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:33.244286 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1336/2714] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:33.254419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1379/2715] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:33 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:33.255493 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5655a16-515a-44fb-9480-0b40e14815f7 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:33.256941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c5655a16-515a-44fb-9480-0b40e14815f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:33.258240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6655a-2f4d-4c13-85de-4bfb9c3162ba admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:33.289472 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:33.321828 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5655a16-515a-44fb-9480-0b40e14815f7 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:33.328676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6655a-2f4d-4c13-85de-4bfb9c3162ba admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:33.334635 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9e45e-7793-4758-ae40-7a4d826e2639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:33.337401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9e45e-7793-4758-ae40-7a4d826e2639 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:33.337828 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9e45e-7793-4758-ae40-7a4d826e2639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:33.337952 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9e45e-7793-4758-ae40-7a4d826e2639 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:33.338559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9e45e-7793-4758-ae40-7a4d826e2639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:33.340487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9e45e-7793-4758-ae40-7a4d826e2639 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:33.368343 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1380/2716] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:33 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:33.369240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9e45e-7793-4758-ae40-7a4d826e2639 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:33.378979 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9e45e-7793-4758-ae40-7a4d826e2639 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:33.383670 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03410c-2b98-49c2-9c2e-11919a1f57e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:33.384261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03410c-2b98-49c2-9c2e-11919a1f57e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:33.384541 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03410c-2b98-49c2-9c2e-11919a1f57e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:33.384849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03410c-2b98-49c2-9c2e-11919a1f57e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:33.385493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03410c-2b98-49c2-9c2e-11919a1f57e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:33.387252 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03410c-2b98-49c2-9c2e-11919a1f57e8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:33.401739 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1381/2717] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:33:33.401941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464434b-5b8b-4094-a7db-6f3d478fca08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:33.401941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464434b-5b8b-4094-a7db-6f3d478fca08 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:33.401941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464434b-5b8b-4094-a7db-6f3d478fca08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:33.401941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464434b-5b8b-4094-a7db-6f3d478fca08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:33.402993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03410c-2b98-49c2-9c2e-11919a1f57e8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:33.412604 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03410c-2b98-49c2-9c2e-11919a1f57e8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:33.418008 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70614f3d-7701-4899-a251-0a0525595266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:33.418675 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70614f3d-7701-4899-a251-0a0525595266 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:33.418945 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70614f3d-7701-4899-a251-0a0525595266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:33.419213 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70614f3d-7701-4899-a251-0a0525595266 admin admin] PATH_INFO: `/v3/projects/cd054c91888d4b938c233a9c705eb437/users/f036f53c7f1745b39c985e3a29cf7fc2/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:33.434425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70614f3d-7701-4899-a251-0a0525595266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd054c91888d4b938c233a9c705eb437, user_id=f036f53c7f1745b39c985e3a29cf7fc2, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:33.437098 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70614f3d-7701-4899-a251-0a0525595266 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:33.456775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1382/2718] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:33 2022] PUT /identity/v3/projects/cd054c91888d4b938c233a9c705eb437/users/f036f53c7f1745b39c985e3a29cf7fc2/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:33.461332 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70614f3d-7701-4899-a251-0a0525595266 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:33.468004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464434b-5b8b-4094-a7db-6f3d478fca08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:33.469488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464434b-5b8b-4094-a7db-6f3d478fca08 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:33.479192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1337/2719] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:33.533230 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70614f3d-7701-4899-a251-0a0525595266 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:33.538267 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f077d44-352b-4750-9a5e-f4fe2dedc4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:33.538963 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077d44-352b-4750-9a5e-f4fe2dedc4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:33.539232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077d44-352b-4750-9a5e-f4fe2dedc4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:33.539494 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077d44-352b-4750-9a5e-f4fe2dedc4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:33.540158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f077d44-352b-4750-9a5e-f4fe2dedc4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:33.541796 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f077d44-352b-4750-9a5e-f4fe2dedc4c2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:33.552559 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1383/2720] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:33.563495 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464434b-5b8b-4094-a7db-6f3d478fca08 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:33.577307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464434b-5b8b-4094-a7db-6f3d478fca08 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:33.582003 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8b955-28a7-4c64-ace3-0098da743fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:33.582779 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8b955-28a7-4c64-ace3-0098da743fca admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:33.582964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8b955-28a7-4c64-ace3-0098da743fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:33.583220 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8b955-28a7-4c64-ace3-0098da743fca admin admin] PATH_INFO: `/v3/projects/cd054c91888d4b938c233a9c705eb437/users/f036f53c7f1745b39c985e3a29cf7fc2/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:33.585682 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8b955-28a7-4c64-ace3-0098da743fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd054c91888d4b938c233a9c705eb437, user_id=f036f53c7f1745b39c985e3a29cf7fc2, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:33.588525 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8b955-28a7-4c64-ace3-0098da743fca admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:33.604461 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1338/2721] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:33 2022] PUT /identity/v3/projects/cd054c91888d4b938c233a9c705eb437/users/f036f53c7f1745b39c985e3a29cf7fc2/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:33.618048 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d872-9699-4cdd-b3bc-2b8dd3c7c10f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:33.618427 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d872-9699-4cdd-b3bc-2b8dd3c7c10f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:33.618916 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d872-9699-4cdd-b3bc-2b8dd3c7c10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:33.652302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-57d0d872-9699-4cdd-b3bc-2b8dd3c7c10f None None] MFA Rules not processed for user `f036f53c7f1745b39c985e3a29cf7fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:33.653550 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-57d0d872-9699-4cdd-b3bc-2b8dd3c7c10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:33.676939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:33.735689 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1384/2722] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:33.747546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8b955-28a7-4c64-ace3-0098da743fca admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:33.749317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ddf8b955-28a7-4c64-ace3-0098da743fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:33.818612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8b955-28a7-4c64-ace3-0098da743fca admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:33.822878 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c7fc4-7cf9-428c-902f-9b821c0c5482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:33.823494 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c7fc4-7cf9-428c-902f-9b821c0c5482 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:33.823774 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c7fc4-7cf9-428c-902f-9b821c0c5482 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:33.824045 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c7fc4-7cf9-428c-902f-9b821c0c5482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:33.833807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c7fc4-7cf9-428c-902f-9b821c0c5482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:33.835815 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c7fc4-7cf9-428c-902f-9b821c0c5482 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:33.845856 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1339/2723] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:34.050492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d872-9699-4cdd-b3bc-2b8dd3c7c10f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:34.120202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d872-9699-4cdd-b3bc-2b8dd3c7c10f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:34.124748 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99bab0-5514-4cbb-a242-6230b534560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:34.125377 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99bab0-5514-4cbb-a242-6230b534560d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:34.125651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99bab0-5514-4cbb-a242-6230b534560d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:34.125924 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99bab0-5514-4cbb-a242-6230b534560d admin admin] PATH_INFO: `/v3/users/29b80046ddbf43c598fa3cc6cdf5d7c7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:34.127061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99bab0-5514-4cbb-a242-6230b534560d admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b80046ddbf43c598fa3cc6cdf5d7c7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:34.129187 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99bab0-5514-4cbb-a242-6230b534560d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:34.196437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f99bab0-5514-4cbb-a242-6230b534560d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b80046ddbf43c598fa3cc6cdf5d7c7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:34.197184 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f99bab0-5514-4cbb-a242-6230b534560d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b80046ddbf43c598fa3cc6cdf5d7c7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:34.210235 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f99bab0-5514-4cbb-a242-6230b534560d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b80046ddbf43c598fa3cc6cdf5d7c7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:34.217600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f99bab0-5514-4cbb-a242-6230b534560d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b80046ddbf43c598fa3cc6cdf5d7c7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:34.218301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f99bab0-5514-4cbb-a242-6230b534560d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b80046ddbf43c598fa3cc6cdf5d7c7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:34.233165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1385/2724] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:34 2022] DELETE /identity/v3/users/29b80046ddbf43c598fa3cc6cdf5d7c7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:34.238270 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03f4f-ffe7-43db-9665-0ac97f2aa420 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:34.238560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03f4f-ffe7-43db-9665-0ac97f2aa420 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:34.238845 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03f4f-ffe7-43db-9665-0ac97f2aa420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:34.259065 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-73c03f4f-ffe7-43db-9665-0ac97f2aa420 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:34.260296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-73c03f4f-ffe7-43db-9665-0ac97f2aa420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:34.278827 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:34.334509 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1340/2725] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:34.342693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99bab0-5514-4cbb-a242-6230b534560d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:34.344628 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6f99bab0-5514-4cbb-a242-6230b534560d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:34.389622 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:34.426198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99bab0-5514-4cbb-a242-6230b534560d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:34.428034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14c45f-7a06-40c3-aee1-f236da84eedc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:34.429535 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14c45f-7a06-40c3-aee1-f236da84eedc service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:34.430067 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14c45f-7a06-40c3-aee1-f236da84eedc service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:34.430415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14c45f-7a06-40c3-aee1-f236da84eedc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:34.441209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14c45f-7a06-40c3-aee1-f236da84eedc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:34.442737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14c45f-7a06-40c3-aee1-f236da84eedc service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:34.456911 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1386/2726] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:34.764365 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c03f4f-ffe7-43db-9665-0ac97f2aa420 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:34.766537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-73c03f4f-ffe7-43db-9665-0ac97f2aa420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:34.779594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c03f4f-ffe7-43db-9665-0ac97f2aa420 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:34.787419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:34.788829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:34.796089 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:34.796503 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] PATH_INFO: `/v3/projects/5f37e1ada6804794b7680c0b903f9abd` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:34.798393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f37e1ada6804794b7680c0b903f9abd)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:34.800643 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:34.855449 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f37e1ada6804794b7680c0b903f9abd', 'request_id': 'req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:34.862103 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f37e1ada6804794b7680c0b903f9abd', 'request_id': 'req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:34.870581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f37e1ada6804794b7680c0b903f9abd', 'request_id': 'req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:34.888877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] The token cache is being invalidate because project 5f37e1ada6804794b7680c0b903f9abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:34.888877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:34.888877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:34.888877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1341/2727] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:34 2022] DELETE /identity/v3/projects/5f37e1ada6804794b7680c0b903f9abd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:34.891279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14c45f-7a06-40c3-aee1-f236da84eedc service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:34.901706 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14c45f-7a06-40c3-aee1-f236da84eedc service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:34.964037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31f575-1e74-49de-bed0-3695ddb7ce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:34.964677 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31f575-1e74-49de-bed0-3695ddb7ce67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:34.965056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31f575-1e74-49de-bed0-3695ddb7ce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:34.965232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31f575-1e74-49de-bed0-3695ddb7ce67 admin admin] PATH_INFO: `/v3/users/69138071cda54a83a7a63d95648e3796` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:34.966676 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31f575-1e74-49de-bed0-3695ddb7ce67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69138071cda54a83a7a63d95648e3796)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:34.968661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31f575-1e74-49de-bed0-3695ddb7ce67 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:35.020732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e31f575-1e74-49de-bed0-3695ddb7ce67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69138071cda54a83a7a63d95648e3796'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.022478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e31f575-1e74-49de-bed0-3695ddb7ce67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69138071cda54a83a7a63d95648e3796'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.045155 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e31f575-1e74-49de-bed0-3695ddb7ce67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69138071cda54a83a7a63d95648e3796'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.052443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e31f575-1e74-49de-bed0-3695ddb7ce67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69138071cda54a83a7a63d95648e3796'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.053197 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e31f575-1e74-49de-bed0-3695ddb7ce67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69138071cda54a83a7a63d95648e3796'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.071162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1387/2728] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:34 2022] DELETE /identity/v3/users/69138071cda54a83a7a63d95648e3796 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:35.317870 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:35.319902 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:35.332745 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faaa2b-3a4a-4d34-b85a-f29c82a3d8b2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:35.374128 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31f575-1e74-49de-bed0-3695ddb7ce67 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:35.375572 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0e31f575-1e74-49de-bed0-3695ddb7ce67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:35.397888 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e56cb-0d86-482b-9136-891a75026d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:35.398697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e56cb-0d86-482b-9136-891a75026d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:35.399074 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e56cb-0d86-482b-9136-891a75026d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:35.399726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e56cb-0d86-482b-9136-891a75026d77 admin admin] PATH_INFO: `/v3/users/4f87e9933ea74026bb6e4789d442bb06` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:35.402067 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e56cb-0d86-482b-9136-891a75026d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f87e9933ea74026bb6e4789d442bb06)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:35.404619 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e56cb-0d86-482b-9136-891a75026d77 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:35.449520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31f575-1e74-49de-bed0-3695ddb7ce67 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:35.451264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:35.456280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d7557-a56d-40b6-b41e-de37d53fc082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:35.459073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d7557-a56d-40b6-b41e-de37d53fc082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:35.459845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d7557-a56d-40b6-b41e-de37d53fc082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:35.460005 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-772e56cb-0d86-482b-9136-891a75026d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f87e9933ea74026bb6e4789d442bb06'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.460114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d7557-a56d-40b6-b41e-de37d53fc082 admin admin] PATH_INFO: `/v3/projects/b8281b758ec344d1aa700c9c4693bf35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:35.461161 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-772e56cb-0d86-482b-9136-891a75026d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f87e9933ea74026bb6e4789d442bb06'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.461478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d7557-a56d-40b6-b41e-de37d53fc082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8281b758ec344d1aa700c9c4693bf35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:35.462134 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-772e56cb-0d86-482b-9136-891a75026d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f87e9933ea74026bb6e4789d442bb06'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.463722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d7557-a56d-40b6-b41e-de37d53fc082 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:35.467431 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:35.479116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-772e56cb-0d86-482b-9136-891a75026d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f87e9933ea74026bb6e4789d442bb06'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.500730 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-772e56cb-0d86-482b-9136-891a75026d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f87e9933ea74026bb6e4789d442bb06'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.520154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1342/2729] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:35 2022] DELETE /identity/v3/users/4f87e9933ea74026bb6e4789d442bb06 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:35.525088 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559216b3-71b4-438f-8c36-8229ab1ee9cb None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:35.525543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559216b3-71b4-438f-8c36-8229ab1ee9cb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:35.526000 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559216b3-71b4-438f-8c36-8229ab1ee9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:35.536498 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-479d7557-a56d-40b6-b41e-de37d53fc082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8281b758ec344d1aa700c9c4693bf35', 'request_id': 'req-479d7557-a56d-40b6-b41e-de37d53fc082'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.543552 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-479d7557-a56d-40b6-b41e-de37d53fc082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8281b758ec344d1aa700c9c4693bf35', 'request_id': 'req-479d7557-a56d-40b6-b41e-de37d53fc082'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.548804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-559216b3-71b4-438f-8c36-8229ab1ee9cb None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:35.550119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-559216b3-71b4-438f-8c36-8229ab1ee9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:35.551528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-479d7557-a56d-40b6-b41e-de37d53fc082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8281b758ec344d1aa700c9c4693bf35', 'request_id': 'req-479d7557-a56d-40b6-b41e-de37d53fc082'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.564189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-479d7557-a56d-40b6-b41e-de37d53fc082 admin admin] The token cache is being invalidate because project b8281b758ec344d1aa700c9c4693bf35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:35.564568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-479d7557-a56d-40b6-b41e-de37d53fc082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.565311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-479d7557-a56d-40b6-b41e-de37d53fc082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:35.566831 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1388/2730] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:35 2022] DELETE /identity/v3/projects/b8281b758ec344d1aa700c9c4693bf35 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:35.571753 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9630c-9f98-4a22-9918-cb35f552d053 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:35.572117 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9630c-9f98-4a22-9918-cb35f552d053 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:35.572743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9630c-9f98-4a22-9918-cb35f552d053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:35.592743 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-00f9630c-9f98-4a22-9918-cb35f552d053 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:35.594034 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-00f9630c-9f98-4a22-9918-cb35f552d053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:35.612129 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1343/2731] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:35.622683 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559216b3-71b4-438f-8c36-8229ab1ee9cb None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:35.624116 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-559216b3-71b4-438f-8c36-8229ab1ee9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:35.654527 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1389/2732] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:35.662114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26586b8f-6629-44d9-a0d3-ed0aaeee91e4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:35.662392 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26586b8f-6629-44d9-a0d3-ed0aaeee91e4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:35.662656 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26586b8f-6629-44d9-a0d3-ed0aaeee91e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:35.685303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-26586b8f-6629-44d9-a0d3-ed0aaeee91e4 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:35.685555 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559216b3-71b4-438f-8c36-8229ab1ee9cb None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:35.686501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-26586b8f-6629-44d9-a0d3-ed0aaeee91e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:35.689251 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93827eaa-885c-4586-9096-2e7210c4131a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:35.689861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93827eaa-885c-4586-9096-2e7210c4131a service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:35.690143 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93827eaa-885c-4586-9096-2e7210c4131a service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:35.690421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93827eaa-885c-4586-9096-2e7210c4131a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:35.694591 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1390/2733] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:35.699058 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26586b8f-6629-44d9-a0d3-ed0aaeee91e4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:35.700397 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93827eaa-885c-4586-9096-2e7210c4131a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:35.701961 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93827eaa-885c-4586-9096-2e7210c4131a service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:35.708315 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26586b8f-6629-44d9-a0d3-ed0aaeee91e4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:35.712826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1344/2734] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:33:35.713487 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6079b5f-274e-4e16-b3c9-cf24b6667415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:35.714116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6079b5f-274e-4e16-b3c9-cf24b6667415 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:35.714410 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6079b5f-274e-4e16-b3c9-cf24b6667415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:35.714702 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6079b5f-274e-4e16-b3c9-cf24b6667415 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:35.715354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6079b5f-274e-4e16-b3c9-cf24b6667415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:35.715643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6079b5f-274e-4e16-b3c9-cf24b6667415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:35.717243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6079b5f-274e-4e16-b3c9-cf24b6667415 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:35.729836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1391/2735] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:33:35.733877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93827eaa-885c-4586-9096-2e7210c4131a service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:35.743592 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93827eaa-885c-4586-9096-2e7210c4131a service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:35.748553 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c7682-3bf0-44e8-9845-20a667fcae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:35.749686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c7682-3bf0-44e8-9845-20a667fcae02 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:35.749686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c7682-3bf0-44e8-9845-20a667fcae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:35.750050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c7682-3bf0-44e8-9845-20a667fcae02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:35.750744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c7682-3bf0-44e8-9845-20a667fcae02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:35.752777 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c7682-3bf0-44e8-9845-20a667fcae02 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:35.785306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1345/2736] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:35 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:35.786462 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6079b5f-274e-4e16-b3c9-cf24b6667415 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:35.798232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6079b5f-274e-4e16-b3c9-cf24b6667415 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:35.865668 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d2699-f6d3-450a-b05b-8f3526510f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:35.866896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d2699-f6d3-450a-b05b-8f3526510f3e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:35.866896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d2699-f6d3-450a-b05b-8f3526510f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:35.866896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d2699-f6d3-450a-b05b-8f3526510f3e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:35.872285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d2699-f6d3-450a-b05b-8f3526510f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:35.872285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d2699-f6d3-450a-b05b-8f3526510f3e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:35.887948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:35.895233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1392/2737] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:35 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:35.899715 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c7682-3bf0-44e8-9845-20a667fcae02 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:35.909941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c7682-3bf0-44e8-9845-20a667fcae02 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:35.915378 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce59f1-96c2-4c04-ad5a-209feb925ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:35.915989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce59f1-96c2-4c04-ad5a-209feb925ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:35.916268 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce59f1-96c2-4c04-ad5a-209feb925ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:35.916539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce59f1-96c2-4c04-ad5a-209feb925ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:35.917301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce59f1-96c2-4c04-ad5a-209feb925ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:35.918906 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce59f1-96c2-4c04-ad5a-209feb925ba8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:35.930213 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1346/2738] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:35.934177 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d2699-f6d3-450a-b05b-8f3526510f3e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:35.944426 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d2699-f6d3-450a-b05b-8f3526510f3e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:35.949638 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6411950-33c7-4f4d-8193-22c009e906b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:35.950243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6411950-33c7-4f4d-8193-22c009e906b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:35.950517 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6411950-33c7-4f4d-8193-22c009e906b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:35.950787 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6411950-33c7-4f4d-8193-22c009e906b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:35.951432 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6411950-33c7-4f4d-8193-22c009e906b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:35.953158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6411950-33c7-4f4d-8193-22c009e906b7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:35.964950 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1393/2739] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:35.969307 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce59f1-96c2-4c04-ad5a-209feb925ba8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:35.979874 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce59f1-96c2-4c04-ad5a-209feb925ba8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:35.984538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d531835-d87c-4b68-9a52-46467b478775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:35.985234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531835-d87c-4b68-9a52-46467b478775 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:35.985509 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531835-d87c-4b68-9a52-46467b478775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:35.985808 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531835-d87c-4b68-9a52-46467b478775 admin admin] PATH_INFO: `/v3/projects/3d7b7cd856fa47b3bfae601d674807c2/users/e13f8daee531424fa036ea65d0a02016/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.000499 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d531835-d87c-4b68-9a52-46467b478775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7b7cd856fa47b3bfae601d674807c2, user_id=e13f8daee531424fa036ea65d0a02016, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:36.003576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d531835-d87c-4b68-9a52-46467b478775 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:36.014261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6411950-33c7-4f4d-8193-22c009e906b7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:36.016139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f6411950-33c7-4f4d-8193-22c009e906b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:36.019095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1347/2740] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:35 2022] PUT /identity/v3/projects/3d7b7cd856fa47b3bfae601d674807c2/users/e13f8daee531424fa036ea65d0a02016/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:36.030202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6411950-33c7-4f4d-8193-22c009e906b7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:36.033865 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350554ef-7c6b-427f-aa2f-681130f76dc8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:36.034422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350554ef-7c6b-427f-aa2f-681130f76dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:36.034761 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350554ef-7c6b-427f-aa2f-681130f76dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.065523 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:36.070115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-350554ef-7c6b-427f-aa2f-681130f76dc8 None None] MFA Rules not processed for user `e13f8daee531424fa036ea65d0a02016`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:36.072717 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-350554ef-7c6b-427f-aa2f-681130f76dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:36.095531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:36.096166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:36.096443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:36.096740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] PATH_INFO: `/v3/projects/7bb07997bc684e518593412a46dc8b52` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.097903 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb07997bc684e518593412a46dc8b52)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:36.099794 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:36.141911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1348/2741] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:36.146370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350554ef-7c6b-427f-aa2f-681130f76dc8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:36.151870 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb07997bc684e518593412a46dc8b52', 'request_id': 'req-ef16a149-6064-4e05-99f4-be4aa58d9b78'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.157530 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb07997bc684e518593412a46dc8b52', 'request_id': 'req-ef16a149-6064-4e05-99f4-be4aa58d9b78'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.157693 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350554ef-7c6b-427f-aa2f-681130f76dc8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:36.166377 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb07997bc684e518593412a46dc8b52', 'request_id': 'req-ef16a149-6064-4e05-99f4-be4aa58d9b78'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.178424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] The token cache is being invalidate because project 7bb07997bc684e518593412a46dc8b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:36.179288 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.179950 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.181718 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1394/2742] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:36 2022] DELETE /identity/v3/projects/7bb07997bc684e518593412a46dc8b52 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:36.185425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:36.186757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:36.217863 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65d51f-3cb6-42dc-835e-eddd45ec2280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:36.218470 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65d51f-3cb6-42dc-835e-eddd45ec2280 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:36.218749 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65d51f-3cb6-42dc-835e-eddd45ec2280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:36.219019 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65d51f-3cb6-42dc-835e-eddd45ec2280 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.219659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65d51f-3cb6-42dc-835e-eddd45ec2280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:36.221609 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65d51f-3cb6-42dc-835e-eddd45ec2280 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:36.249648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1349/2743] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:36 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:36.253232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16a149-6064-4e05-99f4-be4aa58d9b78 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:36.253462 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65d51f-3cb6-42dc-835e-eddd45ec2280 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:36.255201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ff65d51f-3cb6-42dc-835e-eddd45ec2280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:36.273186 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:36.314082 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dea01f-b274-4197-8705-b39fe1aadaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:36.314711 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dea01f-b274-4197-8705-b39fe1aadaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:36.314987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dea01f-b274-4197-8705-b39fe1aadaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:36.315257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dea01f-b274-4197-8705-b39fe1aadaf5 admin admin] PATH_INFO: `/v3/users/f036f53c7f1745b39c985e3a29cf7fc2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.316388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dea01f-b274-4197-8705-b39fe1aadaf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f036f53c7f1745b39c985e3a29cf7fc2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:36.318438 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dea01f-b274-4197-8705-b39fe1aadaf5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:36.321049 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65d51f-3cb6-42dc-835e-eddd45ec2280 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:36.326107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047a7b8-d692-49db-aa85-d8e14fffbe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:36.326713 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a7b8-d692-49db-aa85-d8e14fffbe76 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:36.327022 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a7b8-d692-49db-aa85-d8e14fffbe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:36.327294 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a7b8-d692-49db-aa85-d8e14fffbe76 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.327959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047a7b8-d692-49db-aa85-d8e14fffbe76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:36.329911 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047a7b8-d692-49db-aa85-d8e14fffbe76 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:36.352565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1350/2744] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:36 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:36.356561 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047a7b8-d692-49db-aa85-d8e14fffbe76 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:36.367047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047a7b8-d692-49db-aa85-d8e14fffbe76 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:36.367520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d0dea01f-b274-4197-8705-b39fe1aadaf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f036f53c7f1745b39c985e3a29cf7fc2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.368333 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d0dea01f-b274-4197-8705-b39fe1aadaf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f036f53c7f1745b39c985e3a29cf7fc2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.372203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70949934-23f8-4ac2-9cb5-fb44e92c35c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:36.372862 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949934-23f8-4ac2-9cb5-fb44e92c35c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:36.373139 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949934-23f8-4ac2-9cb5-fb44e92c35c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:36.373406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949934-23f8-4ac2-9cb5-fb44e92c35c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.374050 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70949934-23f8-4ac2-9cb5-fb44e92c35c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:36.375744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70949934-23f8-4ac2-9cb5-fb44e92c35c8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:36.380377 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d0dea01f-b274-4197-8705-b39fe1aadaf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f036f53c7f1745b39c985e3a29cf7fc2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.386637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1351/2745] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:36.387619 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d0dea01f-b274-4197-8705-b39fe1aadaf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f036f53c7f1745b39c985e3a29cf7fc2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.388350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d0dea01f-b274-4197-8705-b39fe1aadaf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f036f53c7f1745b39c985e3a29cf7fc2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.390694 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70949934-23f8-4ac2-9cb5-fb44e92c35c8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:36.392595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-70949934-23f8-4ac2-9cb5-fb44e92c35c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:36.401927 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1395/2746] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:36 2022] DELETE /identity/v3/users/f036f53c7f1745b39c985e3a29cf7fc2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:36.408617 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70949934-23f8-4ac2-9cb5-fb44e92c35c8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:36.413979 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:36.478590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844c369-a28d-4296-b615-b5cf17997a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:36.479261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844c369-a28d-4296-b615-b5cf17997a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:36.479552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844c369-a28d-4296-b615-b5cf17997a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:36.479819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844c369-a28d-4296-b615-b5cf17997a10 admin admin] PATH_INFO: `/v3/projects/2a40e581775a4e4690a0ae83c77f87c6/users/c1c1d4beb3154df38a09183de3076826/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.496510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844c369-a28d-4296-b615-b5cf17997a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a40e581775a4e4690a0ae83c77f87c6, user_id=c1c1d4beb3154df38a09183de3076826, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:36.499285 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844c369-a28d-4296-b615-b5cf17997a10 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:36.513450 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1352/2747] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:36 2022] PUT /identity/v3/projects/2a40e581775a4e4690a0ae83c77f87c6/users/c1c1d4beb3154df38a09183de3076826/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:36.517618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dea01f-b274-4197-8705-b39fe1aadaf5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:36.530931 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dea01f-b274-4197-8705-b39fe1aadaf5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:36.607663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd3c18-ebf0-4392-b312-8ae426cf4541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:36.608285 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3c18-ebf0-4392-b312-8ae426cf4541 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:36.608570 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3c18-ebf0-4392-b312-8ae426cf4541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:36.608874 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3c18-ebf0-4392-b312-8ae426cf4541 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.609528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd3c18-ebf0-4392-b312-8ae426cf4541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:36.611237 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd3c18-ebf0-4392-b312-8ae426cf4541 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:36.621757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1396/2748] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:36.626117 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844c369-a28d-4296-b615-b5cf17997a10 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:36.636764 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844c369-a28d-4296-b615-b5cf17997a10 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:36.641323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b72c2-d8a6-4141-8906-1eba686fd18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:36.641970 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b72c2-d8a6-4141-8906-1eba686fd18d admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:36.642247 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b72c2-d8a6-4141-8906-1eba686fd18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:36.642517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b72c2-d8a6-4141-8906-1eba686fd18d admin admin] PATH_INFO: `/v3/projects/2a40e581775a4e4690a0ae83c77f87c6/users/c1c1d4beb3154df38a09183de3076826/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.644497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b72c2-d8a6-4141-8906-1eba686fd18d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a40e581775a4e4690a0ae83c77f87c6, user_id=c1c1d4beb3154df38a09183de3076826, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:36.647082 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b72c2-d8a6-4141-8906-1eba686fd18d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:36.658142 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1353/2749] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:36 2022] PUT /identity/v3/projects/2a40e581775a4e4690a0ae83c77f87c6/users/c1c1d4beb3154df38a09183de3076826/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:36.669701 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270e495-4a11-4556-bdbc-e39eda2d83d0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:36.669988 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270e495-4a11-4556-bdbc-e39eda2d83d0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:36.670264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270e495-4a11-4556-bdbc-e39eda2d83d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.699147 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b270e495-4a11-4556-bdbc-e39eda2d83d0 None None] MFA Rules not processed for user `c1c1d4beb3154df38a09183de3076826`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:36.700396 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b270e495-4a11-4556-bdbc-e39eda2d83d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:36.707258 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b72c2-d8a6-4141-8906-1eba686fd18d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:36.709242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-653b72c2-d8a6-4141-8906-1eba686fd18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:36.737412 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:36.781860 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b72c2-d8a6-4141-8906-1eba686fd18d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:36.782202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1397/2750] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:36.786940 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:36.787569 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:36.787895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:36.788672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e admin admin] PATH_INFO: `/v3/projects/cd054c91888d4b938c233a9c705eb437` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.789829 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd054c91888d4b938c233a9c705eb437)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:36.791715 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:36.795133 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270e495-4a11-4556-bdbc-e39eda2d83d0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:36.796520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b270e495-4a11-4556-bdbc-e39eda2d83d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:36.841035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd054c91888d4b938c233a9c705eb437', 'request_id': 'req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.847497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd054c91888d4b938c233a9c705eb437', 'request_id': 'req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.853276 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd054c91888d4b938c233a9c705eb437', 'request_id': 'req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.859859 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270e495-4a11-4556-bdbc-e39eda2d83d0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:36.867826 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e admin admin] The token cache is being invalidate because project cd054c91888d4b938c233a9c705eb437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:36.868120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.868950 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-25ad76ba-b4dd-4dba-bcff-318cdcc45e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:36.870447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1354/2751] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:36 2022] DELETE /identity/v3/projects/cd054c91888d4b938c233a9c705eb437 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:36.875087 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e74cb-428e-4947-bc84-c71c7fe11d98 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:36.875570 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e74cb-428e-4947-bc84-c71c7fe11d98 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:36.875844 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e74cb-428e-4947-bc84-c71c7fe11d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.890975 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:36.897858 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-911e74cb-428e-4947-bc84-c71c7fe11d98 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:36.899895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-911e74cb-428e-4947-bc84-c71c7fe11d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:36.915070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754ea5b-7216-4e86-9e3f-65486995fc9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:36.915709 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754ea5b-7216-4e86-9e3f-65486995fc9c service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:36.915987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754ea5b-7216-4e86-9e3f-65486995fc9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:36.916264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754ea5b-7216-4e86-9e3f-65486995fc9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.918114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0754ea5b-7216-4e86-9e3f-65486995fc9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:36.961896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1355/2752] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:36.969612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cc202-642f-410d-94a4-38d293044ae9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:36.969896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cc202-642f-410d-94a4-38d293044ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:36.970169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cc202-642f-410d-94a4-38d293044ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:36.977478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754ea5b-7216-4e86-9e3f-65486995fc9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:36.978905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754ea5b-7216-4e86-9e3f-65486995fc9c service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:36.987941 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1398/2753] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:33:36.989832 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-6b1cc202-642f-410d-94a4-38d293044ae9 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:36.991071 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6b1cc202-642f-410d-94a4-38d293044ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:36.999171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1356/2754] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:37.003500 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754ea5b-7216-4e86-9e3f-65486995fc9c service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:37.014872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754ea5b-7216-4e86-9e3f-65486995fc9c service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:37.019518 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e96ec-da9f-484e-8b6a-672a39b32ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:37.020113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e96ec-da9f-484e-8b6a-672a39b32ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:37.020391 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e96ec-da9f-484e-8b6a-672a39b32ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:37.020657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e96ec-da9f-484e-8b6a-672a39b32ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:37.021350 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e96ec-da9f-484e-8b6a-672a39b32ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:37.021651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e96ec-da9f-484e-8b6a-672a39b32ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:37.023912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e96ec-da9f-484e-8b6a-672a39b32ea1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:37.036528 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1399/2755] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:33:37.041013 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cc202-642f-410d-94a4-38d293044ae9 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:37.050648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cc202-642f-410d-94a4-38d293044ae9 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:37.055502 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8c789-79ee-40ff-9374-2c1b63483e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:37.056108 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8c789-79ee-40ff-9374-2c1b63483e9f admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:37.056385 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8c789-79ee-40ff-9374-2c1b63483e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:37.056655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8c789-79ee-40ff-9374-2c1b63483e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:37.057320 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8c789-79ee-40ff-9374-2c1b63483e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:37.059556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8c789-79ee-40ff-9374-2c1b63483e9f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:37.104471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1357/2756] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:37 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:37.105710 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e96ec-da9f-484e-8b6a-672a39b32ea1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:37.116467 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e96ec-da9f-484e-8b6a-672a39b32ea1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:37.139696 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:37.188089 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fa544-d43d-4ec8-9d34-1ae9f21895fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:37.188618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fa544-d43d-4ec8-9d34-1ae9f21895fd admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:37.188939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fa544-d43d-4ec8-9d34-1ae9f21895fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:37.189209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fa544-d43d-4ec8-9d34-1ae9f21895fd admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:37.189853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fa544-d43d-4ec8-9d34-1ae9f21895fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:37.191754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fa544-d43d-4ec8-9d34-1ae9f21895fd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:37.218478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1400/2757] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:37 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:37.222697 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8c789-79ee-40ff-9374-2c1b63483e9f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:37.234243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8c789-79ee-40ff-9374-2c1b63483e9f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:37.239680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec8a34-7253-4da9-84c9-0d39247179f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:37.240303 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec8a34-7253-4da9-84c9-0d39247179f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:37.240584 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec8a34-7253-4da9-84c9-0d39247179f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:37.241420 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec8a34-7253-4da9-84c9-0d39247179f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:37.242065 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec8a34-7253-4da9-84c9-0d39247179f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:37.243653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec8a34-7253-4da9-84c9-0d39247179f8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:37.254589 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1358/2758] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:37.259265 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fa544-d43d-4ec8-9d34-1ae9f21895fd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:37.270561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fa544-d43d-4ec8-9d34-1ae9f21895fd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:37.275618 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fd0b2-9748-4b2c-87df-1257f8e3bd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:37.276255 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fd0b2-9748-4b2c-87df-1257f8e3bd90 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:37.276586 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fd0b2-9748-4b2c-87df-1257f8e3bd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:37.277324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fd0b2-9748-4b2c-87df-1257f8e3bd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:37.277542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fd0b2-9748-4b2c-87df-1257f8e3bd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:37.279162 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fd0b2-9748-4b2c-87df-1257f8e3bd90 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:37.294243 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1401/2759] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:37.295515 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec8a34-7253-4da9-84c9-0d39247179f8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:37.307723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec8a34-7253-4da9-84c9-0d39247179f8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:37.313354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020af91-5705-4c8f-b767-92ecd9de2e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:37.314033 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020af91-5705-4c8f-b767-92ecd9de2e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:37.314313 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020af91-5705-4c8f-b767-92ecd9de2e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:37.314580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020af91-5705-4c8f-b767-92ecd9de2e62 admin admin] PATH_INFO: `/v3/projects/bb1cd064bbb44a049020e8d728d4c45a/users/c874666659df47e89cffec68daa2fc44/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:37.340914 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020af91-5705-4c8f-b767-92ecd9de2e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1cd064bbb44a049020e8d728d4c45a, user_id=c874666659df47e89cffec68daa2fc44, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:37.344296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020af91-5705-4c8f-b767-92ecd9de2e62 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:37.360717 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1359/2760] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:37 2022] PUT /identity/v3/projects/bb1cd064bbb44a049020e8d728d4c45a/users/c874666659df47e89cffec68daa2fc44/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:37.371738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f6302-2549-4076-9d03-669a82bafa96 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:37.371738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f6302-2549-4076-9d03-669a82bafa96 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:37.371738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f6302-2549-4076-9d03-669a82bafa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:37.400538 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6e8f6302-2549-4076-9d03-669a82bafa96 None None] MFA Rules not processed for user `c874666659df47e89cffec68daa2fc44`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:37.401800 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6e8f6302-2549-4076-9d03-669a82bafa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:37.473796 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1402/2761] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:37.478333 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020af91-5705-4c8f-b767-92ecd9de2e62 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:37.554909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020af91-5705-4c8f-b767-92ecd9de2e62 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:37.559749 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa48a9-5d51-4669-99de-b3777fdda237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:37.560352 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa48a9-5d51-4669-99de-b3777fdda237 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:37.560637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa48a9-5d51-4669-99de-b3777fdda237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:37.560941 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa48a9-5d51-4669-99de-b3777fdda237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:37.561581 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa48a9-5d51-4669-99de-b3777fdda237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:37.563505 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa48a9-5d51-4669-99de-b3777fdda237 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:37.591208 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1360/2762] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:37 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:37.595503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f6302-2549-4076-9d03-669a82bafa96 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:37.607200 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f6302-2549-4076-9d03-669a82bafa96 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:37.670219 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43bab0-e051-4c44-b1b6-1c6ecd115141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:37.670832 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43bab0-e051-4c44-b1b6-1c6ecd115141 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:37.671111 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43bab0-e051-4c44-b1b6-1c6ecd115141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:37.671379 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43bab0-e051-4c44-b1b6-1c6ecd115141 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:37.672007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43bab0-e051-4c44-b1b6-1c6ecd115141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:37.673940 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43bab0-e051-4c44-b1b6-1c6ecd115141 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:37.697821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1403/2763] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:37 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:37.702343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa48a9-5d51-4669-99de-b3777fdda237 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:37.712809 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa48a9-5d51-4669-99de-b3777fdda237 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:37.717399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b6c3d-1ff8-41da-aa02-e9d60cd63b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:37.717990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b6c3d-1ff8-41da-aa02-e9d60cd63b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:37.718289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b6c3d-1ff8-41da-aa02-e9d60cd63b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:37.718533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b6c3d-1ff8-41da-aa02-e9d60cd63b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:37.719170 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b6c3d-1ff8-41da-aa02-e9d60cd63b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:37.720782 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b6c3d-1ff8-41da-aa02-e9d60cd63b87 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:37.731666 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1361/2764] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:37.735822 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43bab0-e051-4c44-b1b6-1c6ecd115141 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:37.746599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43bab0-e051-4c44-b1b6-1c6ecd115141 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:37.751656 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901a589-5800-424d-93b2-fa809e0e8c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:37.752316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901a589-5800-424d-93b2-fa809e0e8c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:37.752593 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901a589-5800-424d-93b2-fa809e0e8c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:37.752907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901a589-5800-424d-93b2-fa809e0e8c9f admin admin] PATH_INFO: `/v3/projects/d2d66e5c578345849384a54fa1977180/users/796d12566c604bbbb630ef200317eec6/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:37.769062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901a589-5800-424d-93b2-fa809e0e8c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d66e5c578345849384a54fa1977180, user_id=796d12566c604bbbb630ef200317eec6, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:37.771704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901a589-5800-424d-93b2-fa809e0e8c9f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:37.774766 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:37.786628 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1404/2765] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:37 2022] PUT /identity/v3/projects/d2d66e5c578345849384a54fa1977180/users/796d12566c604bbbb630ef200317eec6/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:37.791091 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b6c3d-1ff8-41da-aa02-e9d60cd63b87 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:37.801272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b6c3d-1ff8-41da-aa02-e9d60cd63b87 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:37.814438 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:37.861772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86805f4-3841-40e5-a7e4-095ef8d9d4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:37.862375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86805f4-3841-40e5-a7e4-095ef8d9d4ce admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:37.862652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86805f4-3841-40e5-a7e4-095ef8d9d4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:37.862922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86805f4-3841-40e5-a7e4-095ef8d9d4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:37.863559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86805f4-3841-40e5-a7e4-095ef8d9d4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:37.865187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86805f4-3841-40e5-a7e4-095ef8d9d4ce admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:37.875504 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1362/2766] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:37.879650 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901a589-5800-424d-93b2-fa809e0e8c9f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:37.889865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901a589-5800-424d-93b2-fa809e0e8c9f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:37.894315 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c21cb-2d6c-463a-959b-a695fbed938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:37.894949 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c21cb-2d6c-463a-959b-a695fbed938c admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:37.895317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c21cb-2d6c-463a-959b-a695fbed938c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:37.895490 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c21cb-2d6c-463a-959b-a695fbed938c admin admin] PATH_INFO: `/v3/projects/d2d66e5c578345849384a54fa1977180/users/796d12566c604bbbb630ef200317eec6/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:37.897431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c21cb-2d6c-463a-959b-a695fbed938c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d66e5c578345849384a54fa1977180, user_id=796d12566c604bbbb630ef200317eec6, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:37.900019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c21cb-2d6c-463a-959b-a695fbed938c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:37.910038 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1405/2767] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:37 2022] PUT /identity/v3/projects/d2d66e5c578345849384a54fa1977180/users/796d12566c604bbbb630ef200317eec6/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:37.921658 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983611-41c8-470c-80a8-e757800c2057 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:37.921947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983611-41c8-470c-80a8-e757800c2057 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:37.922227 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983611-41c8-470c-80a8-e757800c2057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:37.950687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-46983611-41c8-470c-80a8-e757800c2057 None None] MFA Rules not processed for user `796d12566c604bbbb630ef200317eec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:37.951893 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-46983611-41c8-470c-80a8-e757800c2057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:38.018639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1363/2768] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:38.031309 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c21cb-2d6c-463a-959b-a695fbed938c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:38.033245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-523c21cb-2d6c-463a-959b-a695fbed938c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:38.093860 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c21cb-2d6c-463a-959b-a695fbed938c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:38.098003 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d6a5d-cb35-4f37-ad51-233994c678da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:38.098614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d6a5d-cb35-4f37-ad51-233994c678da service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:38.098891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d6a5d-cb35-4f37-ad51-233994c678da service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:38.099159 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d6a5d-cb35-4f37-ad51-233994c678da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:38.110512 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d6a5d-cb35-4f37-ad51-233994c678da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:38.111997 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d6a5d-cb35-4f37-ad51-233994c678da service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:38.122172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1406/2769] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:38.435037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983611-41c8-470c-80a8-e757800c2057 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:38.444978 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983611-41c8-470c-80a8-e757800c2057 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:38.451490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459304d-6e89-4b91-9875-a6a40b62bd25 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796d12566c604bbbb630ef200317eec6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d66e5c578345849384a54fa1977180', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:38.452664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459304d-6e89-4b91-9875-a6a40b62bd25 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:38.452664 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459304d-6e89-4b91-9875-a6a40b62bd25 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:38.452909 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459304d-6e89-4b91-9875-a6a40b62bd25 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:38.453393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459304d-6e89-4b91-9875-a6a40b62bd25 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:38.453707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459304d-6e89-4b91-9875-a6a40b62bd25 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:38.455334 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459304d-6e89-4b91-9875-a6a40b62bd25 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:38.468725 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1364/2770] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:33:38.472716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d6a5d-cb35-4f37-ad51-233994c678da service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:38.482480 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d6a5d-cb35-4f37-ad51-233994c678da service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:38.487165 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf03388-de27-4920-aeab-4d705f5f2d1f tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796d12566c604bbbb630ef200317eec6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d66e5c578345849384a54fa1977180', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:38.487866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03388-de27-4920-aeab-4d705f5f2d1f tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:38.488217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03388-de27-4920-aeab-4d705f5f2d1f tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:38.488562 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03388-de27-4920-aeab-4d705f5f2d1f tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:38.489291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf03388-de27-4920-aeab-4d705f5f2d1f tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:38.492087 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf03388-de27-4920-aeab-4d705f5f2d1f tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:38.520482 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1407/2771] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:38 2022] POST /identity/v3/projects => generated 353 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:38.524665 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459304d-6e89-4b91-9875-a6a40b62bd25 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:38.535008 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459304d-6e89-4b91-9875-a6a40b62bd25 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:38.594131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70a352-df05-411e-9abd-35e9a88dc575 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796d12566c604bbbb630ef200317eec6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d66e5c578345849384a54fa1977180', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:38.594734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70a352-df05-411e-9abd-35e9a88dc575 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:38.595012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70a352-df05-411e-9abd-35e9a88dc575 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:38.595309 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70a352-df05-411e-9abd-35e9a88dc575 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:38.595948 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70a352-df05-411e-9abd-35e9a88dc575 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:38.596284 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70a352-df05-411e-9abd-35e9a88dc575 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:38.597912 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70a352-df05-411e-9abd-35e9a88dc575 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:38.611655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1365/2772] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:33:38.651479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf03388-de27-4920-aeab-4d705f5f2d1f tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:38.661971 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf03388-de27-4920-aeab-4d705f5f2d1f tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:38.667400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bec10-1c89-427c-ade3-84dccef62676 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796d12566c604bbbb630ef200317eec6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d66e5c578345849384a54fa1977180', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:38.668211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bec10-1c89-427c-ade3-84dccef62676 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:38.668620 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bec10-1c89-427c-ade3-84dccef62676 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:38.668932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bec10-1c89-427c-ade3-84dccef62676 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] PATH_INFO: `/v3/projects/d4e13a737ed54d1fab05acadd8b550cc` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:38.670096 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bec10-1c89-427c-ade3-84dccef62676 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d4e13a737ed54d1fab05acadd8b550cc)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:38.671989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bec10-1c89-427c-ade3-84dccef62676 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:38.736674 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d80bec10-1c89-427c-ade3-84dccef62676 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4e13a737ed54d1fab05acadd8b550cc', 'request_id': 'req-d80bec10-1c89-427c-ade3-84dccef62676'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:38.744229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d80bec10-1c89-427c-ade3-84dccef62676 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4e13a737ed54d1fab05acadd8b550cc', 'request_id': 'req-d80bec10-1c89-427c-ade3-84dccef62676'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:38.758433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d80bec10-1c89-427c-ade3-84dccef62676 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4e13a737ed54d1fab05acadd8b550cc', 'request_id': 'req-d80bec10-1c89-427c-ade3-84dccef62676'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:38.777416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d80bec10-1c89-427c-ade3-84dccef62676 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] The token cache is being invalidate because project d4e13a737ed54d1fab05acadd8b550cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:38.777416 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d80bec10-1c89-427c-ade3-84dccef62676 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:38.778238 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d80bec10-1c89-427c-ade3-84dccef62676 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:38.781002 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1408/2773] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:38 2022] DELETE /identity/v3/projects/d4e13a737ed54d1fab05acadd8b550cc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:38.982137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70a352-df05-411e-9abd-35e9a88dc575 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:38.983995 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3f70a352-df05-411e-9abd-35e9a88dc575 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:39.005272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:39.049406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70a352-df05-411e-9abd-35e9a88dc575 tempest-VolumeQuotaClassesTest-1712106898 tempest-VolumeQuotaClassesTest-1712106898-project-admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:39.105266 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490b8c0-29b8-427a-8023-e6173012613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:39.105806 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490b8c0-29b8-427a-8023-e6173012613c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:39.106078 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490b8c0-29b8-427a-8023-e6173012613c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:39.106339 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490b8c0-29b8-427a-8023-e6173012613c admin admin] PATH_INFO: `/v3/users/c874666659df47e89cffec68daa2fc44` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:39.107455 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490b8c0-29b8-427a-8023-e6173012613c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c874666659df47e89cffec68daa2fc44)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:39.109382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490b8c0-29b8-427a-8023-e6173012613c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:39.165346 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e490b8c0-29b8-427a-8023-e6173012613c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c874666659df47e89cffec68daa2fc44'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.166004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e490b8c0-29b8-427a-8023-e6173012613c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c874666659df47e89cffec68daa2fc44'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.166688 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e490b8c0-29b8-427a-8023-e6173012613c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c874666659df47e89cffec68daa2fc44'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.173925 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e490b8c0-29b8-427a-8023-e6173012613c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c874666659df47e89cffec68daa2fc44'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.185612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e490b8c0-29b8-427a-8023-e6173012613c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c874666659df47e89cffec68daa2fc44'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.203857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1366/2774] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:38 2022] DELETE /identity/v3/users/c874666659df47e89cffec68daa2fc44 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:39.208770 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc26039-cd95-45dc-b05c-4ed1076e1402 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:39.209310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc26039-cd95-45dc-b05c-4ed1076e1402 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:39.209310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc26039-cd95-45dc-b05c-4ed1076e1402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:39.228705 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0bc26039-cd95-45dc-b05c-4ed1076e1402 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:39.229904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0bc26039-cd95-45dc-b05c-4ed1076e1402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:39.270422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:39.289337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1409/2775] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:39.299276 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490b8c0-29b8-427a-8023-e6173012613c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:39.300701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e490b8c0-29b8-427a-8023-e6173012613c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:39.352987 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:39.359140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490b8c0-29b8-427a-8023-e6173012613c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:39.363463 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b6ba5-f3dd-48d5-89df-09b3f4584143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:39.364077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b6ba5-f3dd-48d5-89df-09b3f4584143 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:39.364401 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b6ba5-f3dd-48d5-89df-09b3f4584143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:39.364892 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b6ba5-f3dd-48d5-89df-09b3f4584143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:39.373901 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b6ba5-f3dd-48d5-89df-09b3f4584143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:39.375330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b6ba5-f3dd-48d5-89df-09b3f4584143 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:39.385199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1367/2776] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:39.658300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc26039-cd95-45dc-b05c-4ed1076e1402 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:39.659896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0bc26039-cd95-45dc-b05c-4ed1076e1402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:39.677345 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc26039-cd95-45dc-b05c-4ed1076e1402 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:39.682650 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:39.683278 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:39.683548 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:39.683813 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] PATH_INFO: `/v3/projects/bb1cd064bbb44a049020e8d728d4c45a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:39.685031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1cd064bbb44a049020e8d728d4c45a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:39.686989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:39.737586 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1cd064bbb44a049020e8d728d4c45a', 'request_id': 'req-902afd3f-6950-4680-9fe7-98fcb7ab338e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.743617 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1cd064bbb44a049020e8d728d4c45a', 'request_id': 'req-902afd3f-6950-4680-9fe7-98fcb7ab338e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.751116 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1cd064bbb44a049020e8d728d4c45a', 'request_id': 'req-902afd3f-6950-4680-9fe7-98fcb7ab338e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.763444 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] The token cache is being invalidate because project bb1cd064bbb44a049020e8d728d4c45a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:39.763732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.764382 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.766090 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1410/2777] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:39 2022] DELETE /identity/v3/projects/bb1cd064bbb44a049020e8d728d4c45a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:39.769916 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b6ba5-f3dd-48d5-89df-09b3f4584143 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:39.779842 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b6ba5-f3dd-48d5-89df-09b3f4584143 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:39.854657 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d946d-4ec4-4ffd-b5f4-2cad31eaace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:39.855299 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d946d-4ec4-4ffd-b5f4-2cad31eaace2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:39.855726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d946d-4ec4-4ffd-b5f4-2cad31eaace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:39.856004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d946d-4ec4-4ffd-b5f4-2cad31eaace2 admin admin] PATH_INFO: `/v3/users/796d12566c604bbbb630ef200317eec6` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:39.857185 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d946d-4ec4-4ffd-b5f4-2cad31eaace2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=796d12566c604bbbb630ef200317eec6)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:39.859132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d946d-4ec4-4ffd-b5f4-2cad31eaace2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:39.908044 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-110d946d-4ec4-4ffd-b5f4-2cad31eaace2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796d12566c604bbbb630ef200317eec6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.908841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-110d946d-4ec4-4ffd-b5f4-2cad31eaace2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796d12566c604bbbb630ef200317eec6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.909488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-110d946d-4ec4-4ffd-b5f4-2cad31eaace2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796d12566c604bbbb630ef200317eec6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.917037 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-110d946d-4ec4-4ffd-b5f4-2cad31eaace2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796d12566c604bbbb630ef200317eec6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.929661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-110d946d-4ec4-4ffd-b5f4-2cad31eaace2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796d12566c604bbbb630ef200317eec6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:39.942862 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1368/2778] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:39 2022] DELETE /identity/v3/users/796d12566c604bbbb630ef200317eec6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:40.253341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:40.254977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:40.270004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902afd3f-6950-4680-9fe7-98fcb7ab338e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:40.328890 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:40.329523 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:40.329803 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:40.330076 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1 admin admin] PATH_INFO: `/v3/projects/d2d66e5c578345849384a54fa1977180` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:40.331194 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d66e5c578345849384a54fa1977180)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:40.333123 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:40.378503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d66e5c578345849384a54fa1977180', 'request_id': 'req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:40.384157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d66e5c578345849384a54fa1977180', 'request_id': 'req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:40.392217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d66e5c578345849384a54fa1977180', 'request_id': 'req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:40.401152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:40.408520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1 admin admin] The token cache is being invalidate because project d2d66e5c578345849384a54fa1977180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:40.408905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:40.409667 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ebf4d986-0c7e-4024-b40f-cfe3bcf4f3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:40.411698 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1411/2779] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:40 2022] DELETE /identity/v3/projects/d2d66e5c578345849384a54fa1977180 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:40.418404 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1dadb-70ba-4d36-a3f6-bb2f5f4a72b8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:40.418884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1dadb-70ba-4d36-a3f6-bb2f5f4a72b8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:40.419013 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1dadb-70ba-4d36-a3f6-bb2f5f4a72b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:40.438576 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0bd1dadb-70ba-4d36-a3f6-bb2f5f4a72b8 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:40.439790 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0bd1dadb-70ba-4d36-a3f6-bb2f5f4a72b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:40.504161 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1369/2780] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:40.512021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f095e-0d90-4280-a34e-edab2155e190 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:40.512306 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f095e-0d90-4280-a34e-edab2155e190 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:40.512581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f095e-0d90-4280-a34e-edab2155e190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:40.533382 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6f5f095e-0d90-4280-a34e-edab2155e190 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:40.534673 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6f5f095e-0d90-4280-a34e-edab2155e190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:40.543732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1412/2781] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:40.548228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1dadb-70ba-4d36-a3f6-bb2f5f4a72b8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:40.558460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1dadb-70ba-4d36-a3f6-bb2f5f4a72b8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:40.563175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f782478-402f-455c-a2e4-3692e08a4da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:40.563772 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f782478-402f-455c-a2e4-3692e08a4da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:40.564053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f782478-402f-455c-a2e4-3692e08a4da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:40.564328 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f782478-402f-455c-a2e4-3692e08a4da0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:40.565009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f782478-402f-455c-a2e4-3692e08a4da0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:40.565418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f782478-402f-455c-a2e4-3692e08a4da0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:40.567016 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f782478-402f-455c-a2e4-3692e08a4da0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:40.569974 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:40.580795 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1370/2782] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:33:40.585918 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f095e-0d90-4280-a34e-edab2155e190 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:40.595081 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f095e-0d90-4280-a34e-edab2155e190 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:40.599766 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99771d2-7381-4b2d-ad4c-2b930cf8b8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:40.600358 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99771d2-7381-4b2d-ad4c-2b930cf8b8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:40.600630 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99771d2-7381-4b2d-ad4c-2b930cf8b8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:40.600941 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99771d2-7381-4b2d-ad4c-2b930cf8b8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:40.601563 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99771d2-7381-4b2d-ad4c-2b930cf8b8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:40.603599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99771d2-7381-4b2d-ad4c-2b930cf8b8a6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:40.630303 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1413/2783] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:40 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:40.635100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f782478-402f-455c-a2e4-3692e08a4da0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:40.645127 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f782478-402f-455c-a2e4-3692e08a4da0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:40.702451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949063b2-ed39-4572-911a-69d8fe918f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:40.703001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949063b2-ed39-4572-911a-69d8fe918f59 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:40.703278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949063b2-ed39-4572-911a-69d8fe918f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:40.703575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949063b2-ed39-4572-911a-69d8fe918f59 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:40.704215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949063b2-ed39-4572-911a-69d8fe918f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:40.706169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949063b2-ed39-4572-911a-69d8fe918f59 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:40.727460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1371/2784] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:40 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:40.732308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99771d2-7381-4b2d-ad4c-2b930cf8b8a6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:40.743301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99771d2-7381-4b2d-ad4c-2b930cf8b8a6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:40.748470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c7ed9-1c58-4417-8e08-77a63bf663e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:40.749117 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c7ed9-1c58-4417-8e08-77a63bf663e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:40.749393 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c7ed9-1c58-4417-8e08-77a63bf663e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:40.749734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c7ed9-1c58-4417-8e08-77a63bf663e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:40.750301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c7ed9-1c58-4417-8e08-77a63bf663e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:40.751896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c7ed9-1c58-4417-8e08-77a63bf663e9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:40.762979 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1414/2785] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:40.767402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949063b2-ed39-4572-911a-69d8fe918f59 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:40.779399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949063b2-ed39-4572-911a-69d8fe918f59 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:40.784263 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec0f41-d372-47ca-a858-3a301f6508ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:40.784962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec0f41-d372-47ca-a858-3a301f6508ed admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:40.785243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec0f41-d372-47ca-a858-3a301f6508ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:40.785564 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec0f41-d372-47ca-a858-3a301f6508ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:40.786158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec0f41-d372-47ca-a858-3a301f6508ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:40.787849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec0f41-d372-47ca-a858-3a301f6508ed admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:40.799120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1372/2786] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:40.803335 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c7ed9-1c58-4417-8e08-77a63bf663e9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:40.813943 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c7ed9-1c58-4417-8e08-77a63bf663e9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:40.819656 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a9d5-f559-4810-bd9d-06e928c46618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:40.820308 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a9d5-f559-4810-bd9d-06e928c46618 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:40.820584 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a9d5-f559-4810-bd9d-06e928c46618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:40.820915 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a9d5-f559-4810-bd9d-06e928c46618 admin admin] PATH_INFO: `/v3/projects/5aadd2c712e04ffea6edc2312f3e8fb0/users/a3dc43c466c04abf9e4f22fb9d260185/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:40.836785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66a9d5-f559-4810-bd9d-06e928c46618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aadd2c712e04ffea6edc2312f3e8fb0, user_id=a3dc43c466c04abf9e4f22fb9d260185, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:40.839433 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66a9d5-f559-4810-bd9d-06e928c46618 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:40.857221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1415/2787] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:40 2022] PUT /identity/v3/projects/5aadd2c712e04ffea6edc2312f3e8fb0/users/a3dc43c466c04abf9e4f22fb9d260185/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:40.863169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001211c1-5901-4b25-837d-5c1187f14336 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:40.863458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001211c1-5901-4b25-837d-5c1187f14336 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:40.863729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001211c1-5901-4b25-837d-5c1187f14336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:40.892934 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-001211c1-5901-4b25-837d-5c1187f14336 None None] MFA Rules not processed for user `a3dc43c466c04abf9e4f22fb9d260185`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:40.894216 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-001211c1-5901-4b25-837d-5c1187f14336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:40.966202 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1373/2788] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:40.976717 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a9d5-f559-4810-bd9d-06e928c46618 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:40.978441 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7d66a9d5-f559-4810-bd9d-06e928c46618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:41.039256 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a9d5-f559-4810-bd9d-06e928c46618 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:41.043299 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7aec6-ece0-4e8e-8a5a-83e1dc75f91c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:41.043987 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7aec6-ece0-4e8e-8a5a-83e1dc75f91c service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:41.044311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7aec6-ece0-4e8e-8a5a-83e1dc75f91c service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:41.044578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7aec6-ece0-4e8e-8a5a-83e1dc75f91c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:41.054338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7aec6-ece0-4e8e-8a5a-83e1dc75f91c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:41.055740 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7aec6-ece0-4e8e-8a5a-83e1dc75f91c service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:41.066661 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1416/2789] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:41.345654 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001211c1-5901-4b25-837d-5c1187f14336 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:41.347406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-001211c1-5901-4b25-837d-5c1187f14336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:41.362677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001211c1-5901-4b25-837d-5c1187f14336 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:41.367928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c0481-f8b8-4fc1-9962-f52c29fb4367 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:41.368533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c0481-f8b8-4fc1-9962-f52c29fb4367 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:41.369012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c0481-f8b8-4fc1-9962-f52c29fb4367 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:41.369273 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c0481-f8b8-4fc1-9962-f52c29fb4367 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:41.372228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-957c0481-f8b8-4fc1-9962-f52c29fb4367 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:41.441392 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c0481-f8b8-4fc1-9962-f52c29fb4367 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:41.442833 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c0481-f8b8-4fc1-9962-f52c29fb4367 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:41.447020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:41.460827 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1374/2790] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:45.010878 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675c49e-fccc-4d18-a877-c63711f8aa99 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:45.011435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675c49e-fccc-4d18-a877-c63711f8aa99 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:45.011435 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675c49e-fccc-4d18-a877-c63711f8aa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:45.035163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e675c49e-fccc-4d18-a877-c63711f8aa99 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:45.036417 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e675c49e-fccc-4d18-a877-c63711f8aa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:45.099185 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1417/2791] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 16:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:45.121628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c0481-f8b8-4fc1-9962-f52c29fb4367 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:45.123092 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-957c0481-f8b8-4fc1-9962-f52c29fb4367 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:45.196727 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c0481-f8b8-4fc1-9962-f52c29fb4367 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:45.203665 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f6e71-fef9-4f48-8e0e-20a5688e0264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:45.204274 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f6e71-fef9-4f48-8e0e-20a5688e0264 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:45.204571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f6e71-fef9-4f48-8e0e-20a5688e0264 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:45.204860 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f6e71-fef9-4f48-8e0e-20a5688e0264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:45.214921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f6e71-fef9-4f48-8e0e-20a5688e0264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:45.216604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f6e71-fef9-4f48-8e0e-20a5688e0264 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:45.226751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1375/2792] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:46.415347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675c49e-fccc-4d18-a877-c63711f8aa99 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:46.416990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e675c49e-fccc-4d18-a877-c63711f8aa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:46.429060 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675c49e-fccc-4d18-a877-c63711f8aa99 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:46.433694 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39342aa3-82e5-4241-82d8-fd69c2237f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:46.434316 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342aa3-82e5-4241-82d8-fd69c2237f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:46.434590 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342aa3-82e5-4241-82d8-fd69c2237f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:46.434855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342aa3-82e5-4241-82d8-fd69c2237f2c admin admin] PATH_INFO: `/v3/users/e13f8daee531424fa036ea65d0a02016` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:46.435990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39342aa3-82e5-4241-82d8-fd69c2237f2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13f8daee531424fa036ea65d0a02016)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:46.437907 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39342aa3-82e5-4241-82d8-fd69c2237f2c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:46.468577 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f6e71-fef9-4f48-8e0e-20a5688e0264 service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:46.478821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:46.479532 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f6e71-fef9-4f48-8e0e-20a5688e0264 service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:46.484237 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98f6f7-c4dd-406a-a9ea-7d87de48ce66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:46.484889 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98f6f7-c4dd-406a-a9ea-7d87de48ce66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:46.485379 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98f6f7-c4dd-406a-a9ea-7d87de48ce66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:46.485819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98f6f7-c4dd-406a-a9ea-7d87de48ce66 admin admin] PATH_INFO: `/v3/users/a3dc43c466c04abf9e4f22fb9d260185` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:46.487118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98f6f7-c4dd-406a-a9ea-7d87de48ce66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3dc43c466c04abf9e4f22fb9d260185)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:46.489072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98f6f7-c4dd-406a-a9ea-7d87de48ce66 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:46.490214 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-39342aa3-82e5-4241-82d8-fd69c2237f2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13f8daee531424fa036ea65d0a02016'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:46.490866 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-39342aa3-82e5-4241-82d8-fd69c2237f2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13f8daee531424fa036ea65d0a02016'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:46.503449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-39342aa3-82e5-4241-82d8-fd69c2237f2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13f8daee531424fa036ea65d0a02016'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:46.514289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-39342aa3-82e5-4241-82d8-fd69c2237f2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13f8daee531424fa036ea65d0a02016'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:46.515311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-39342aa3-82e5-4241-82d8-fd69c2237f2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13f8daee531424fa036ea65d0a02016'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:46.530536 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1418/2793] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:46 2022] DELETE /identity/v3/users/e13f8daee531424fa036ea65d0a02016 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:46.535346 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa270e-572b-4acb-b59b-62750d414a37 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:46.535627 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa270e-572b-4acb-b59b-62750d414a37 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:46.535902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa270e-572b-4acb-b59b-62750d414a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:46.540830 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ef98f6f7-c4dd-406a-a9ea-7d87de48ce66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3dc43c466c04abf9e4f22fb9d260185'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:46.541647 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ef98f6f7-c4dd-406a-a9ea-7d87de48ce66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3dc43c466c04abf9e4f22fb9d260185'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:46.542364 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ef98f6f7-c4dd-406a-a9ea-7d87de48ce66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3dc43c466c04abf9e4f22fb9d260185'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:46.550540 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ef98f6f7-c4dd-406a-a9ea-7d87de48ce66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3dc43c466c04abf9e4f22fb9d260185'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:46.557389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a8fa270e-572b-4acb-b59b-62750d414a37 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:46.558583 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a8fa270e-572b-4acb-b59b-62750d414a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:46.562545 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ef98f6f7-c4dd-406a-a9ea-7d87de48ce66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3dc43c466c04abf9e4f22fb9d260185'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:46.580381 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1376/2794] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:46 2022] DELETE /identity/v3/users/a3dc43c466c04abf9e4f22fb9d260185 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:46.585484 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90506222-440e-42c9-8086-0cdd0a276402 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:46.585896 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90506222-440e-42c9-8086-0cdd0a276402 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:46.586175 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90506222-440e-42c9-8086-0cdd0a276402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:46.606492 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-90506222-440e-42c9-8086-0cdd0a276402 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:46.607846 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-90506222-440e-42c9-8086-0cdd0a276402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:46.619996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1419/2795] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:46.629919 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa270e-572b-4acb-b59b-62750d414a37 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:46.631830 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a8fa270e-572b-4acb-b59b-62750d414a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:46.663880 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:46.677716 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1377/2796] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:46.688132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90506222-440e-42c9-8086-0cdd0a276402 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:46.695880 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa270e-572b-4acb-b59b-62750d414a37 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:46.747434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf1481-d557-42d8-b214-99980dbcd31d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:46.747947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90506222-440e-42c9-8086-0cdd0a276402 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:46.748071 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf1481-d557-42d8-b214-99980dbcd31d service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:46.748327 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf1481-d557-42d8-b214-99980dbcd31d service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:46.748595 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf1481-d557-42d8-b214-99980dbcd31d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:46.751628 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f332da5-7369-4f4d-83a6-9ddfa2cd94c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:46.752235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f332da5-7369-4f4d-83a6-9ddfa2cd94c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:46.752510 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f332da5-7369-4f4d-83a6-9ddfa2cd94c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:46.752811 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f332da5-7369-4f4d-83a6-9ddfa2cd94c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:46.758209 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf1481-d557-42d8-b214-99980dbcd31d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:46.759641 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf1481-d557-42d8-b214-99980dbcd31d service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:46.762702 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f332da5-7369-4f4d-83a6-9ddfa2cd94c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:46.764290 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f332da5-7369-4f4d-83a6-9ddfa2cd94c5 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:46.769575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1420/2797] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:46.774438 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1378/2798] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:33:47.157398 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf1481-d557-42d8-b214-99980dbcd31d service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:47.159299 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-86cf1481-d557-42d8-b214-99980dbcd31d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:47.176374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf1481-d557-42d8-b214-99980dbcd31d service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:47.184257 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:47.185279 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:47.185653 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:47.186023 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] PATH_INFO: `/v3/projects/3d7b7cd856fa47b3bfae601d674807c2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:47.190240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7b7cd856fa47b3bfae601d674807c2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:47.191157 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:47.192903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f332da5-7369-4f4d-83a6-9ddfa2cd94c5 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:47.195232 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6f332da5-7369-4f4d-83a6-9ddfa2cd94c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:47.201798 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:47.220145 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f332da5-7369-4f4d-83a6-9ddfa2cd94c5 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:47.228977 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b200bd7-afd5-4e0e-9734-2242e2bc701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:47.230427 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b200bd7-afd5-4e0e-9734-2242e2bc701c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:47.231118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b200bd7-afd5-4e0e-9734-2242e2bc701c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:47.232166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b200bd7-afd5-4e0e-9734-2242e2bc701c admin admin] PATH_INFO: `/v3/projects/5aadd2c712e04ffea6edc2312f3e8fb0` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:47.233517 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b200bd7-afd5-4e0e-9734-2242e2bc701c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aadd2c712e04ffea6edc2312f3e8fb0)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:47.235759 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b200bd7-afd5-4e0e-9734-2242e2bc701c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:47.260055 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7b7cd856fa47b3bfae601d674807c2', 'request_id': 'req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.268110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7b7cd856fa47b3bfae601d674807c2', 'request_id': 'req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.278321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7b7cd856fa47b3bfae601d674807c2', 'request_id': 'req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.291737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] The token cache is being invalidate because project 3d7b7cd856fa47b3bfae601d674807c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:47.292035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.292680 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.294189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1421/2799] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:47 2022] DELETE /identity/v3/projects/3d7b7cd856fa47b3bfae601d674807c2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:47.296163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b200bd7-afd5-4e0e-9734-2242e2bc701c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aadd2c712e04ffea6edc2312f3e8fb0', 'request_id': 'req-8b200bd7-afd5-4e0e-9734-2242e2bc701c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.298140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:47.299521 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:47.303944 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b200bd7-afd5-4e0e-9734-2242e2bc701c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aadd2c712e04ffea6edc2312f3e8fb0', 'request_id': 'req-8b200bd7-afd5-4e0e-9734-2242e2bc701c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.310137 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b200bd7-afd5-4e0e-9734-2242e2bc701c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aadd2c712e04ffea6edc2312f3e8fb0', 'request_id': 'req-8b200bd7-afd5-4e0e-9734-2242e2bc701c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.325861 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b200bd7-afd5-4e0e-9734-2242e2bc701c admin admin] The token cache is being invalidate because project 5aadd2c712e04ffea6edc2312f3e8fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:47.326154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b200bd7-afd5-4e0e-9734-2242e2bc701c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.326814 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b200bd7-afd5-4e0e-9734-2242e2bc701c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.328490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1379/2800] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:47 2022] DELETE /identity/v3/projects/5aadd2c712e04ffea6edc2312f3e8fb0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:47.333042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3b66f-05e1-456a-b2c9-259c546cfd95 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:47.333325 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3b66f-05e1-456a-b2c9-259c546cfd95 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:47.333646 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3b66f-05e1-456a-b2c9-259c546cfd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:47.355614 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-03e3b66f-05e1-456a-b2c9-259c546cfd95 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:47.356908 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-03e3b66f-05e1-456a-b2c9-259c546cfd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:47.369670 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad41a22-59a0-4772-b4e2-6f73cfcbe1e4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:47.424129 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1380/2801] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:47.432532 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977eeb-d263-40f7-ab21-e15e6b8bbc00 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:47.432878 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977eeb-d263-40f7-ab21-e15e6b8bbc00 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:47.433115 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977eeb-d263-40f7-ab21-e15e6b8bbc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:47.445845 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ddda7-47ee-49dc-9d18-da97a2373330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:47.447151 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ddda7-47ee-49dc-9d18-da97a2373330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:47.447947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ddda7-47ee-49dc-9d18-da97a2373330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:47.448421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ddda7-47ee-49dc-9d18-da97a2373330 admin admin] PATH_INFO: `/v3/users/c1c1d4beb3154df38a09183de3076826` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:47.449884 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ddda7-47ee-49dc-9d18-da97a2373330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c1d4beb3154df38a09183de3076826)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:47.452905 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ddda7-47ee-49dc-9d18-da97a2373330 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:47.455109 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-94977eeb-d263-40f7-ab21-e15e6b8bbc00 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:47.456326 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-94977eeb-d263-40f7-ab21-e15e6b8bbc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:47.468595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1381/2802] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:47.473158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94977eeb-d263-40f7-ab21-e15e6b8bbc00 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:47.483220 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94977eeb-d263-40f7-ab21-e15e6b8bbc00 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:47.489484 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f3d52-2d6d-49d9-89ef-8d1b9db39bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:47.490120 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f3d52-2d6d-49d9-89ef-8d1b9db39bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:47.490477 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f3d52-2d6d-49d9-89ef-8d1b9db39bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:47.490751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f3d52-2d6d-49d9-89ef-8d1b9db39bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:47.491453 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f3d52-2d6d-49d9-89ef-8d1b9db39bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:47.491757 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f3d52-2d6d-49d9-89ef-8d1b9db39bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:47.493456 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f3d52-2d6d-49d9-89ef-8d1b9db39bf0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:47.508072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1382/2803] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:33:47.509053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:47.512204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-808ddda7-47ee-49dc-9d18-da97a2373330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c1d4beb3154df38a09183de3076826'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.513156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f3d52-2d6d-49d9-89ef-8d1b9db39bf0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:47.513411 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-808ddda7-47ee-49dc-9d18-da97a2373330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c1d4beb3154df38a09183de3076826'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.515014 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-626f3d52-2d6d-49d9-89ef-8d1b9db39bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:47.525727 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:47.533526 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f3d52-2d6d-49d9-89ef-8d1b9db39bf0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:47.538712 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-808ddda7-47ee-49dc-9d18-da97a2373330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c1d4beb3154df38a09183de3076826'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.540955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67187f34-4a39-44bc-8d8b-92ca3c4c6b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:47.541572 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67187f34-4a39-44bc-8d8b-92ca3c4c6b2a admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:47.541849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67187f34-4a39-44bc-8d8b-92ca3c4c6b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:47.542121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67187f34-4a39-44bc-8d8b-92ca3c4c6b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:47.542751 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67187f34-4a39-44bc-8d8b-92ca3c4c6b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:47.544710 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67187f34-4a39-44bc-8d8b-92ca3c4c6b2a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:47.546013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-808ddda7-47ee-49dc-9d18-da97a2373330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c1d4beb3154df38a09183de3076826'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.546746 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-808ddda7-47ee-49dc-9d18-da97a2373330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c1d4beb3154df38a09183de3076826'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:47.561017 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1422/2804] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:47 2022] DELETE /identity/v3/users/c1c1d4beb3154df38a09183de3076826 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:47.574122 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1383/2805] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:47 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:47.578202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ddda7-47ee-49dc-9d18-da97a2373330 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:47.643385 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ddda7-47ee-49dc-9d18-da97a2373330 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:47.706040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccba98-5f4b-40e9-81fa-8a1ca5d7d2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:47.710114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccba98-5f4b-40e9-81fa-8a1ca5d7d2fe admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:47.710114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccba98-5f4b-40e9-81fa-8a1ca5d7d2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:47.710114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccba98-5f4b-40e9-81fa-8a1ca5d7d2fe admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:47.710114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccba98-5f4b-40e9-81fa-8a1ca5d7d2fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:47.711095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccba98-5f4b-40e9-81fa-8a1ca5d7d2fe admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:47.735855 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1423/2806] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:47 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:47.740205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67187f34-4a39-44bc-8d8b-92ca3c4c6b2a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:47.753110 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67187f34-4a39-44bc-8d8b-92ca3c4c6b2a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:47.758971 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42945551-e07e-4555-bee8-cafbb5af356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:47.759585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42945551-e07e-4555-bee8-cafbb5af356e admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:47.759864 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42945551-e07e-4555-bee8-cafbb5af356e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:47.760135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42945551-e07e-4555-bee8-cafbb5af356e admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:47.760816 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42945551-e07e-4555-bee8-cafbb5af356e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:47.762677 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42945551-e07e-4555-bee8-cafbb5af356e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:47.777060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1384/2807] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:47.778420 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccba98-5f4b-40e9-81fa-8a1ca5d7d2fe admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:47.793114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccba98-5f4b-40e9-81fa-8a1ca5d7d2fe admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:47.795852 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bde6c1-e7e7-41ee-a8d1-dcb9aa303c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:47.796519 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bde6c1-e7e7-41ee-a8d1-dcb9aa303c56 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:47.796835 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bde6c1-e7e7-41ee-a8d1-dcb9aa303c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:47.797109 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bde6c1-e7e7-41ee-a8d1-dcb9aa303c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:47.797758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bde6c1-e7e7-41ee-a8d1-dcb9aa303c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:47.799518 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bde6c1-e7e7-41ee-a8d1-dcb9aa303c56 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:47.812168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1424/2808] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:47.816419 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42945551-e07e-4555-bee8-cafbb5af356e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:47.833424 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42945551-e07e-4555-bee8-cafbb5af356e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:47.843637 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841d739-7d72-48c5-b79f-186821ede3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:47.844391 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841d739-7d72-48c5-b79f-186821ede3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:47.844735 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841d739-7d72-48c5-b79f-186821ede3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:47.845079 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841d739-7d72-48c5-b79f-186821ede3b1 admin admin] PATH_INFO: `/v3/projects/06c12f8a860c402ab2ef0502416c9d1e/users/31739a6cdf524bb5af70965d7b467226/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:47.863853 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841d739-7d72-48c5-b79f-186821ede3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c12f8a860c402ab2ef0502416c9d1e, user_id=31739a6cdf524bb5af70965d7b467226, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:47.867999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841d739-7d72-48c5-b79f-186821ede3b1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:47.889217 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1385/2809] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:47 2022] PUT /identity/v3/projects/06c12f8a860c402ab2ef0502416c9d1e/users/31739a6cdf524bb5af70965d7b467226/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:47.899990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bde6c1-e7e7-41ee-a8d1-dcb9aa303c56 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:47.900659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8bcf4-9fde-49c0-b0af-f66cee765c80 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:47.901013 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8bcf4-9fde-49c0-b0af-f66cee765c80 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:47.901298 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8bcf4-9fde-49c0-b0af-f66cee765c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:47.902301 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-54bde6c1-e7e7-41ee-a8d1-dcb9aa303c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:47.916152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bde6c1-e7e7-41ee-a8d1-dcb9aa303c56 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:47.980056 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:47.996871 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24831f54-3f80-46c6-8856-3ea3bf953d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:47.997525 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24831f54-3f80-46c6-8856-3ea3bf953d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:47.997851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24831f54-3f80-46c6-8856-3ea3bf953d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:47.998127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24831f54-3f80-46c6-8856-3ea3bf953d85 admin admin] PATH_INFO: `/v3/projects/2a40e581775a4e4690a0ae83c77f87c6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:47.999362 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24831f54-3f80-46c6-8856-3ea3bf953d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a40e581775a4e4690a0ae83c77f87c6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:48.001520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24831f54-3f80-46c6-8856-3ea3bf953d85 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:48.056004 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-24831f54-3f80-46c6-8856-3ea3bf953d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a40e581775a4e4690a0ae83c77f87c6', 'request_id': 'req-24831f54-3f80-46c6-8856-3ea3bf953d85'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:48.063561 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-24831f54-3f80-46c6-8856-3ea3bf953d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a40e581775a4e4690a0ae83c77f87c6', 'request_id': 'req-24831f54-3f80-46c6-8856-3ea3bf953d85'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:48.065260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a2d8bcf4-9fde-49c0-b0af-f66cee765c80 None None] MFA Rules not processed for user `31739a6cdf524bb5af70965d7b467226`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:48.066674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a2d8bcf4-9fde-49c0-b0af-f66cee765c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:48.073347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-24831f54-3f80-46c6-8856-3ea3bf953d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a40e581775a4e4690a0ae83c77f87c6', 'request_id': 'req-24831f54-3f80-46c6-8856-3ea3bf953d85'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:48.086272 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-24831f54-3f80-46c6-8856-3ea3bf953d85 admin admin] The token cache is being invalidate because project 2a40e581775a4e4690a0ae83c77f87c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:48.086570 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-24831f54-3f80-46c6-8856-3ea3bf953d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:48.087232 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-24831f54-3f80-46c6-8856-3ea3bf953d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:48.089009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1425/2810] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:47 2022] DELETE /identity/v3/projects/2a40e581775a4e4690a0ae83c77f87c6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:48.089942 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc5f70-d6ef-427d-9eee-2c3c6475c484 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:48.090221 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc5f70-d6ef-427d-9eee-2c3c6475c484 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:48.090484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc5f70-d6ef-427d-9eee-2c3c6475c484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:48.109352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f3bc5f70-d6ef-427d-9eee-2c3c6475c484 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:48.110557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3bc5f70-d6ef-427d-9eee-2c3c6475c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:48.139459 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1386/2811] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:48.140985 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e1976-ca60-4c17-842f-68bc407bb5f0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:48.141265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e1976-ca60-4c17-842f-68bc407bb5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:48.141534 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e1976-ca60-4c17-842f-68bc407bb5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:48.162422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c45e1976-ca60-4c17-842f-68bc407bb5f0 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:48.163615 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c45e1976-ca60-4c17-842f-68bc407bb5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:48.178131 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1426/2812] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:48.178990 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc5f70-d6ef-427d-9eee-2c3c6475c484 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:48.180253 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3bc5f70-d6ef-427d-9eee-2c3c6475c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:48.233880 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1387/2813] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:48.233880 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e1976-ca60-4c17-842f-68bc407bb5f0 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:48.235346 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c45e1976-ca60-4c17-842f-68bc407bb5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:48.248781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc5f70-d6ef-427d-9eee-2c3c6475c484 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:48.252697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa42b5e-3d23-4269-94ea-2f38b6654b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:48.253310 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa42b5e-3d23-4269-94ea-2f38b6654b16 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:48.253587 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa42b5e-3d23-4269-94ea-2f38b6654b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:48.253860 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa42b5e-3d23-4269-94ea-2f38b6654b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:48.263198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa42b5e-3d23-4269-94ea-2f38b6654b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:48.264626 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa42b5e-3d23-4269-94ea-2f38b6654b16 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:48.274280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1427/2814] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:48.275484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872632fa-3d43-4bff-8306-06d82cc6b562 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:48.275769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872632fa-3d43-4bff-8306-06d82cc6b562 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:48.276037 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872632fa-3d43-4bff-8306-06d82cc6b562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:48.279506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:48.298742 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-872632fa-3d43-4bff-8306-06d82cc6b562 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:48.300455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-872632fa-3d43-4bff-8306-06d82cc6b562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:48.309963 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1428/2815] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:48.315354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872632fa-3d43-4bff-8306-06d82cc6b562 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:48.320843 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e1976-ca60-4c17-842f-68bc407bb5f0 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:48.326172 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872632fa-3d43-4bff-8306-06d82cc6b562 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:48.328182 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b95ae-b70c-4506-b27e-90883bfe3d4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:48.329004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b95ae-b70c-4506-b27e-90883bfe3d4d service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:48.329288 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b95ae-b70c-4506-b27e-90883bfe3d4d service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:48.329648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b95ae-b70c-4506-b27e-90883bfe3d4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:48.331127 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd408a3a-527b-432f-8a97-2eed68a4283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:48.331718 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd408a3a-527b-432f-8a97-2eed68a4283c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:48.331991 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd408a3a-527b-432f-8a97-2eed68a4283c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:48.332250 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd408a3a-527b-432f-8a97-2eed68a4283c admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:48.332928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd408a3a-527b-432f-8a97-2eed68a4283c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:48.333219 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd408a3a-527b-432f-8a97-2eed68a4283c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:48.335454 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd408a3a-527b-432f-8a97-2eed68a4283c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:48.341327 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b95ae-b70c-4506-b27e-90883bfe3d4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:48.343014 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b95ae-b70c-4506-b27e-90883bfe3d4d service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:48.344468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:48.350015 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1429/2816] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:33:48.353947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd408a3a-527b-432f-8a97-2eed68a4283c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:48.355668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1388/2817] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:48.366501 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd408a3a-527b-432f-8a97-2eed68a4283c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:48.371627 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e520b14-19ce-45ab-a0bd-71899fce7be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:48.372223 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e520b14-19ce-45ab-a0bd-71899fce7be8 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:48.372639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e520b14-19ce-45ab-a0bd-71899fce7be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:48.372944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e520b14-19ce-45ab-a0bd-71899fce7be8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:48.373576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e520b14-19ce-45ab-a0bd-71899fce7be8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:48.375464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e520b14-19ce-45ab-a0bd-71899fce7be8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:48.408270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1430/2818] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:48 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:48.412887 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b95ae-b70c-4506-b27e-90883bfe3d4d service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:48.424151 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b95ae-b70c-4506-b27e-90883bfe3d4d service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:48.502084 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6a8da-c5dc-4c9a-b747-18e09b84cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:48.502739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6a8da-c5dc-4c9a-b747-18e09b84cd3d admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:48.503032 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6a8da-c5dc-4c9a-b747-18e09b84cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:48.503227 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6a8da-c5dc-4c9a-b747-18e09b84cd3d admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:48.503877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6a8da-c5dc-4c9a-b747-18e09b84cd3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:48.507451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6a8da-c5dc-4c9a-b747-18e09b84cd3d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:48.541177 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1389/2819] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:48 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:48.545407 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e520b14-19ce-45ab-a0bd-71899fce7be8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:48.571917 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e520b14-19ce-45ab-a0bd-71899fce7be8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:48.577286 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77875b-4303-4502-bfe2-8be8867a936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:48.577926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77875b-4303-4502-bfe2-8be8867a936d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:48.578282 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77875b-4303-4502-bfe2-8be8867a936d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:48.579942 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77875b-4303-4502-bfe2-8be8867a936d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:48.579942 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77875b-4303-4502-bfe2-8be8867a936d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:48.580867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77875b-4303-4502-bfe2-8be8867a936d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:48.595367 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1431/2820] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:48.596479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6a8da-c5dc-4c9a-b747-18e09b84cd3d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:48.606831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6a8da-c5dc-4c9a-b747-18e09b84cd3d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:48.612023 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b61c23-7378-4b28-951c-d8d970e56399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:48.612376 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b61c23-7378-4b28-951c-d8d970e56399 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:48.612651 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b61c23-7378-4b28-951c-d8d970e56399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:48.612964 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b61c23-7378-4b28-951c-d8d970e56399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:48.613625 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b61c23-7378-4b28-951c-d8d970e56399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:48.615200 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b61c23-7378-4b28-951c-d8d970e56399 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:48.632018 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1390/2821] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:48.636337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77875b-4303-4502-bfe2-8be8867a936d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:48.648930 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77875b-4303-4502-bfe2-8be8867a936d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:48.653497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d2be1-5d1c-46c9-9121-2d2f931ccb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:48.654146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d2be1-5d1c-46c9-9121-2d2f931ccb0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:48.654421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d2be1-5d1c-46c9-9121-2d2f931ccb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:48.654687 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d2be1-5d1c-46c9-9121-2d2f931ccb0b admin admin] PATH_INFO: `/v3/projects/9d5af3cad71c47018131da28209b603d/users/fc6f83ae034f496d9c6833f4d747f1f9/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:48.670758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d2be1-5d1c-46c9-9121-2d2f931ccb0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5af3cad71c47018131da28209b603d, user_id=fc6f83ae034f496d9c6833f4d747f1f9, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:48.673424 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d2be1-5d1c-46c9-9121-2d2f931ccb0b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:48.687625 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1432/2822] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:48 2022] PUT /identity/v3/projects/9d5af3cad71c47018131da28209b603d/users/fc6f83ae034f496d9c6833f4d747f1f9/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:48.703264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648523b-3ea3-481e-87bd-ac48e2eca53d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:48.703671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648523b-3ea3-481e-87bd-ac48e2eca53d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:48.703988 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648523b-3ea3-481e-87bd-ac48e2eca53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:48.731537 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b648523b-3ea3-481e-87bd-ac48e2eca53d None None] MFA Rules not processed for user `fc6f83ae034f496d9c6833f4d747f1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:48.732791 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b648523b-3ea3-481e-87bd-ac48e2eca53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:48.796734 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1391/2823] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:48.801304 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d2be1-5d1c-46c9-9121-2d2f931ccb0b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:48.863825 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d2be1-5d1c-46c9-9121-2d2f931ccb0b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:48.869001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9397739-28aa-4cde-85cb-7d2e60dafb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:48.869593 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9397739-28aa-4cde-85cb-7d2e60dafb9a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:48.869870 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9397739-28aa-4cde-85cb-7d2e60dafb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:48.870132 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9397739-28aa-4cde-85cb-7d2e60dafb9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:48.870766 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9397739-28aa-4cde-85cb-7d2e60dafb9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:48.872648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9397739-28aa-4cde-85cb-7d2e60dafb9a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:48.898481 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1433/2824] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:48 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:48.902416 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648523b-3ea3-481e-87bd-ac48e2eca53d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:48.914035 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648523b-3ea3-481e-87bd-ac48e2eca53d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:48.940999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:48.971713 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d7f04-4309-47a4-b333-b31d9501a0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:48.972310 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d7f04-4309-47a4-b333-b31d9501a0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:48.972585 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d7f04-4309-47a4-b333-b31d9501a0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:48.972879 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d7f04-4309-47a4-b333-b31d9501a0d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:48.973492 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d7f04-4309-47a4-b333-b31d9501a0d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:48.975918 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d7f04-4309-47a4-b333-b31d9501a0d9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:48.997821 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1392/2825] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:48 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:49.001996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9397739-28aa-4cde-85cb-7d2e60dafb9a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:49.012204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9397739-28aa-4cde-85cb-7d2e60dafb9a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:49.016806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1f9ef-cc5f-4f94-b439-f01206bfe375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:49.017404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1f9ef-cc5f-4f94-b439-f01206bfe375 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:49.017690 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1f9ef-cc5f-4f94-b439-f01206bfe375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:49.017945 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1f9ef-cc5f-4f94-b439-f01206bfe375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:49.018575 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1f9ef-cc5f-4f94-b439-f01206bfe375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:49.020199 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1f9ef-cc5f-4f94-b439-f01206bfe375 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:49.030879 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1434/2826] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:49.035215 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d7f04-4309-47a4-b333-b31d9501a0d9 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:49.045670 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d7f04-4309-47a4-b333-b31d9501a0d9 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:49.050280 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe378ac-cc18-4370-b7ec-8badb9a938e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:49.050857 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe378ac-cc18-4370-b7ec-8badb9a938e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:49.051132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe378ac-cc18-4370-b7ec-8badb9a938e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:49.051398 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe378ac-cc18-4370-b7ec-8badb9a938e5 admin admin] PATH_INFO: `/v3/projects/91ffed63bc764028b1153b2d5c8286ec/users/3bf65a3468384f7da019cb178578c0a1/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:49.068104 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe378ac-cc18-4370-b7ec-8badb9a938e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ffed63bc764028b1153b2d5c8286ec, user_id=3bf65a3468384f7da019cb178578c0a1, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:49.071119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe378ac-cc18-4370-b7ec-8badb9a938e5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:49.085431 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1393/2827] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:49 2022] PUT /identity/v3/projects/91ffed63bc764028b1153b2d5c8286ec/users/3bf65a3468384f7da019cb178578c0a1/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:49.089484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1f9ef-cc5f-4f94-b439-f01206bfe375 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:49.100581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1f9ef-cc5f-4f94-b439-f01206bfe375 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:49.160183 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3f278-433a-469d-a429-a55b66e70bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:49.160886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f278-433a-469d-a429-a55b66e70bba admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:49.161166 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f278-433a-469d-a429-a55b66e70bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:49.161434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f278-433a-469d-a429-a55b66e70bba admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:49.162068 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3f278-433a-469d-a429-a55b66e70bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:49.164160 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3f278-433a-469d-a429-a55b66e70bba admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:49.173963 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1435/2828] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:49.178769 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe378ac-cc18-4370-b7ec-8badb9a938e5 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:49.189040 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe378ac-cc18-4370-b7ec-8badb9a938e5 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:49.193754 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5b6eb-ad65-4b92-9168-38238813c23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:49.194395 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5b6eb-ad65-4b92-9168-38238813c23d admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:49.194675 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5b6eb-ad65-4b92-9168-38238813c23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:49.194947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5b6eb-ad65-4b92-9168-38238813c23d admin admin] PATH_INFO: `/v3/projects/91ffed63bc764028b1153b2d5c8286ec/users/3bf65a3468384f7da019cb178578c0a1/roles/beec000223e041209205627bfa0dbed1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:49.196915 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5b6eb-ad65-4b92-9168-38238813c23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ffed63bc764028b1153b2d5c8286ec, user_id=3bf65a3468384f7da019cb178578c0a1, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:49.200483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5b6eb-ad65-4b92-9168-38238813c23d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:49.211339 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1394/2829] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:49 2022] PUT /identity/v3/projects/91ffed63bc764028b1153b2d5c8286ec/users/3bf65a3468384f7da019cb178578c0a1/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:49.221522 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a8438-5ffa-4c69-bdb5-4ae490bec572 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:49.221810 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a8438-5ffa-4c69-bdb5-4ae490bec572 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:49.222083 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a8438-5ffa-4c69-bdb5-4ae490bec572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:49.251318 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:49.254428 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b39a8438-5ffa-4c69-bdb5-4ae490bec572 None None] MFA Rules not processed for user `3bf65a3468384f7da019cb178578c0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:49.256055 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b39a8438-5ffa-4c69-bdb5-4ae490bec572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:49.325374 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1436/2830] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:49.337458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5b6eb-ad65-4b92-9168-38238813c23d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:49.339784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4bb5b6eb-ad65-4b92-9168-38238813c23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:49.398119 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5b6eb-ad65-4b92-9168-38238813c23d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:49.401762 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719dbb8-03c5-4aae-af3d-d555b35e5260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:49.402377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719dbb8-03c5-4aae-af3d-d555b35e5260 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:49.402655 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719dbb8-03c5-4aae-af3d-d555b35e5260 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:49.402949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719dbb8-03c5-4aae-af3d-d555b35e5260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:49.460223 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719dbb8-03c5-4aae-af3d-d555b35e5260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:49.461714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719dbb8-03c5-4aae-af3d-d555b35e5260 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:49.471107 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1395/2831] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:51.408489 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d631e28-21c7-4729-8284-9befa3c2d8c1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:51.409061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d631e28-21c7-4729-8284-9befa3c2d8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:51.409061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d631e28-21c7-4729-8284-9befa3c2d8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:51.429271 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2d631e28-21c7-4729-8284-9befa3c2d8c1 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:51.430479 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2d631e28-21c7-4729-8284-9befa3c2d8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:51.490867 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1437/2832] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 16:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:51.522321 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719dbb8-03c5-4aae-af3d-d555b35e5260 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:51.523830 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a719dbb8-03c5-4aae-af3d-d555b35e5260 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:51.565296 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:51.600002 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719dbb8-03c5-4aae-af3d-d555b35e5260 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:51.606195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ab3aa-4726-4c2b-ba38-d4d6b2c92927 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:51.606804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ab3aa-4726-4c2b-ba38-d4d6b2c92927 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:51.607074 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ab3aa-4726-4c2b-ba38-d4d6b2c92927 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:51.607338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ab3aa-4726-4c2b-ba38-d4d6b2c92927 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:51.615565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ab3aa-4726-4c2b-ba38-d4d6b2c92927 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:51.617148 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ab3aa-4726-4c2b-ba38-d4d6b2c92927 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:51.627205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1396/2833] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:52.069621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d631e28-21c7-4729-8284-9befa3c2d8c1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:52.079475 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d631e28-21c7-4729-8284-9befa3c2d8c1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:52.083977 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ebc1c-a689-4279-886d-36c18bfe2218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:52.084589 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ebc1c-a689-4279-886d-36c18bfe2218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:52.084906 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ebc1c-a689-4279-886d-36c18bfe2218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:52.085178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ebc1c-a689-4279-886d-36c18bfe2218 admin admin] PATH_INFO: `/v3/users/fc6f83ae034f496d9c6833f4d747f1f9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:52.086290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ebc1c-a689-4279-886d-36c18bfe2218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6f83ae034f496d9c6833f4d747f1f9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:52.088270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ebc1c-a689-4279-886d-36c18bfe2218 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:52.137791 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2c7ebc1c-a689-4279-886d-36c18bfe2218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6f83ae034f496d9c6833f4d747f1f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.138477 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2c7ebc1c-a689-4279-886d-36c18bfe2218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6f83ae034f496d9c6833f4d747f1f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.151521 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2c7ebc1c-a689-4279-886d-36c18bfe2218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6f83ae034f496d9c6833f4d747f1f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.163193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2c7ebc1c-a689-4279-886d-36c18bfe2218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6f83ae034f496d9c6833f4d747f1f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.163980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2c7ebc1c-a689-4279-886d-36c18bfe2218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6f83ae034f496d9c6833f4d747f1f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.180865 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1438/2834] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:52 2022] DELETE /identity/v3/users/fc6f83ae034f496d9c6833f4d747f1f9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:52.186533 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200f5d5-c047-4f51-aeae-af2cc9cf3091 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:52.187132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200f5d5-c047-4f51-aeae-af2cc9cf3091 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:52.187663 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200f5d5-c047-4f51-aeae-af2cc9cf3091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:52.208785 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8200f5d5-c047-4f51-aeae-af2cc9cf3091 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:52.210038 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8200f5d5-c047-4f51-aeae-af2cc9cf3091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:52.278612 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1397/2835] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:33:52.288422 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ebc1c-a689-4279-886d-36c18bfe2218 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:52.289972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2c7ebc1c-a689-4279-886d-36c18bfe2218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:52.304246 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:52.350754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ebc1c-a689-4279-886d-36c18bfe2218 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:52.354434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a03111-e948-470b-a783-bc6473ea590c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:52.355040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a03111-e948-470b-a783-bc6473ea590c service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:52.355317 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a03111-e948-470b-a783-bc6473ea590c service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:52.355588 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a03111-e948-470b-a783-bc6473ea590c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:52.364375 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a03111-e948-470b-a783-bc6473ea590c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:52.365833 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a03111-e948-470b-a783-bc6473ea590c service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:52.375721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1439/2836] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:52.642962 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200f5d5-c047-4f51-aeae-af2cc9cf3091 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:52.644447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8200f5d5-c047-4f51-aeae-af2cc9cf3091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:52.656315 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200f5d5-c047-4f51-aeae-af2cc9cf3091 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:52.660968 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:52.661598 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:52.661872 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:52.662140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] PATH_INFO: `/v3/projects/9d5af3cad71c47018131da28209b603d` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:52.663249 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5af3cad71c47018131da28209b603d)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:52.665775 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:52.712707 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5af3cad71c47018131da28209b603d', 'request_id': 'req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.719187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5af3cad71c47018131da28209b603d', 'request_id': 'req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.725133 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5af3cad71c47018131da28209b603d', 'request_id': 'req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.740070 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] The token cache is being invalidate because project 9d5af3cad71c47018131da28209b603d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:52.740361 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.740999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.742497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1398/2837] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:52 2022] DELETE /identity/v3/projects/9d5af3cad71c47018131da28209b603d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:52.747240 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a03111-e948-470b-a783-bc6473ea590c service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:52.756649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a03111-e948-470b-a783-bc6473ea590c service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:52.813289 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2ad92-9d6a-44d3-9fc2-bfaab69f6e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:52.813923 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ad92-9d6a-44d3-9fc2-bfaab69f6e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:52.814198 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ad92-9d6a-44d3-9fc2-bfaab69f6e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:52.814469 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ad92-9d6a-44d3-9fc2-bfaab69f6e4d admin admin] PATH_INFO: `/v3/users/3bf65a3468384f7da019cb178578c0a1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:52.815697 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2ad92-9d6a-44d3-9fc2-bfaab69f6e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf65a3468384f7da019cb178578c0a1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:52.817672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2ad92-9d6a-44d3-9fc2-bfaab69f6e4d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:52.866647 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-13c2ad92-9d6a-44d3-9fc2-bfaab69f6e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf65a3468384f7da019cb178578c0a1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.867376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-13c2ad92-9d6a-44d3-9fc2-bfaab69f6e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf65a3468384f7da019cb178578c0a1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.881461 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-13c2ad92-9d6a-44d3-9fc2-bfaab69f6e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf65a3468384f7da019cb178578c0a1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.888816 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-13c2ad92-9d6a-44d3-9fc2-bfaab69f6e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf65a3468384f7da019cb178578c0a1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.889531 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-13c2ad92-9d6a-44d3-9fc2-bfaab69f6e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf65a3468384f7da019cb178578c0a1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:52.903849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1440/2838] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:33:52 2022] DELETE /identity/v3/users/3bf65a3468384f7da019cb178578c0a1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:33:53.187228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:53.189235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:53.203653 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a3ce2-4dbe-433f-a6e9-8780bc31da4d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:53.249421 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:53.268057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6762637-77b2-4af0-af1f-fa9a0f799132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:53.268743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6762637-77b2-4af0-af1f-fa9a0f799132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:53.269028 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6762637-77b2-4af0-af1f-fa9a0f799132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:53.269303 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6762637-77b2-4af0-af1f-fa9a0f799132 admin admin] PATH_INFO: `/v3/projects/91ffed63bc764028b1153b2d5c8286ec` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:53.270444 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6762637-77b2-4af0-af1f-fa9a0f799132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ffed63bc764028b1153b2d5c8286ec)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:53.272329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6762637-77b2-4af0-af1f-fa9a0f799132 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:53.320349 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c6762637-77b2-4af0-af1f-fa9a0f799132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ffed63bc764028b1153b2d5c8286ec', 'request_id': 'req-c6762637-77b2-4af0-af1f-fa9a0f799132'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:53.327064 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c6762637-77b2-4af0-af1f-fa9a0f799132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ffed63bc764028b1153b2d5c8286ec', 'request_id': 'req-c6762637-77b2-4af0-af1f-fa9a0f799132'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:53.332923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c6762637-77b2-4af0-af1f-fa9a0f799132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ffed63bc764028b1153b2d5c8286ec', 'request_id': 'req-c6762637-77b2-4af0-af1f-fa9a0f799132'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:53.346429 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c6762637-77b2-4af0-af1f-fa9a0f799132 admin admin] The token cache is being invalidate because project 91ffed63bc764028b1153b2d5c8286ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:33:53.346719 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c6762637-77b2-4af0-af1f-fa9a0f799132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:53.347330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c6762637-77b2-4af0-af1f-fa9a0f799132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:33:53.349056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1399/2839] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:33:53 2022] DELETE /identity/v3/projects/91ffed63bc764028b1153b2d5c8286ec => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:53.354169 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72809b-1009-425d-8d22-49c9680b246b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:53.354452 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72809b-1009-425d-8d22-49c9680b246b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:53.354721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72809b-1009-425d-8d22-49c9680b246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:53.374320 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fb72809b-1009-425d-8d22-49c9680b246b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:53.375493 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fb72809b-1009-425d-8d22-49c9680b246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:53.403935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:53.435876 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1441/2840] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:53.443721 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caad639-3d1b-4b58-90a9-6c05f69ad20c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:53.444004 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caad639-3d1b-4b58-90a9-6c05f69ad20c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:53.444275 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caad639-3d1b-4b58-90a9-6c05f69ad20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:53.464648 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2caad639-3d1b-4b58-90a9-6c05f69ad20c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:53.465907 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2caad639-3d1b-4b58-90a9-6c05f69ad20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:53.474506 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1400/2841] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:53.479080 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72809b-1009-425d-8d22-49c9680b246b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:53.489100 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72809b-1009-425d-8d22-49c9680b246b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:53.495352 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ced2d2-5d13-4064-8c14-f2e3f0d38b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:53.496006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ced2d2-5d13-4064-8c14-f2e3f0d38b1a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:53.496348 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ced2d2-5d13-4064-8c14-f2e3f0d38b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:53.496644 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ced2d2-5d13-4064-8c14-f2e3f0d38b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:53.497461 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ced2d2-5d13-4064-8c14-f2e3f0d38b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:33:53.497769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ced2d2-5d13-4064-8c14-f2e3f0d38b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:53.499365 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ced2d2-5d13-4064-8c14-f2e3f0d38b1a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:53.511443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1442/2842] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:33:53.516101 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caad639-3d1b-4b58-90a9-6c05f69ad20c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:53.525711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caad639-3d1b-4b58-90a9-6c05f69ad20c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:53.530408 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbe843-69df-4a1a-b5cf-38dc41da6842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:53.531007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbe843-69df-4a1a-b5cf-38dc41da6842 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:53.531287 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbe843-69df-4a1a-b5cf-38dc41da6842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:53.531625 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbe843-69df-4a1a-b5cf-38dc41da6842 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:53.532360 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecbe843-69df-4a1a-b5cf-38dc41da6842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:53.534336 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecbe843-69df-4a1a-b5cf-38dc41da6842 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:53.564098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1401/2843] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:33:53 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:33:53.568087 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ced2d2-5d13-4064-8c14-f2e3f0d38b1a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:53.579920 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ced2d2-5d13-4064-8c14-f2e3f0d38b1a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:53.642040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6e70d-adf0-40f8-b317-3339cb5449c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:53.642560 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6e70d-adf0-40f8-b317-3339cb5449c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:53.642835 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6e70d-adf0-40f8-b317-3339cb5449c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:53.643101 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6e70d-adf0-40f8-b317-3339cb5449c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:53.643727 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6e70d-adf0-40f8-b317-3339cb5449c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:53.645651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6e70d-adf0-40f8-b317-3339cb5449c5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:53.668664 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1443/2844] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:33:53 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:33:53.672959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbe843-69df-4a1a-b5cf-38dc41da6842 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:53.683131 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbe843-69df-4a1a-b5cf-38dc41da6842 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:53.687965 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd0e9f-7773-48b8-96c5-28ea73c75c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:53.688590 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd0e9f-7773-48b8-96c5-28ea73c75c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:53.688898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd0e9f-7773-48b8-96c5-28ea73c75c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:53.689165 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd0e9f-7773-48b8-96c5-28ea73c75c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:53.689842 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd0e9f-7773-48b8-96c5-28ea73c75c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:53.691422 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd0e9f-7773-48b8-96c5-28ea73c75c2d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:53.701573 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1402/2845] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:53.705621 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6e70d-adf0-40f8-b317-3339cb5449c5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:53.716217 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6e70d-adf0-40f8-b317-3339cb5449c5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:53.721013 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a81be-17a3-4bcb-990f-8857f82a8f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:53.721612 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a81be-17a3-4bcb-990f-8857f82a8f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:53.721892 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a81be-17a3-4bcb-990f-8857f82a8f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:53.722170 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a81be-17a3-4bcb-990f-8857f82a8f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:53.722804 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a81be-17a3-4bcb-990f-8857f82a8f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:53.724413 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a81be-17a3-4bcb-990f-8857f82a8f34 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:53.736031 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1444/2846] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:33:53.740079 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd0e9f-7773-48b8-96c5-28ea73c75c2d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:53.751092 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd0e9f-7773-48b8-96c5-28ea73c75c2d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:53.755804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2a4c5-7a05-4b4e-a26d-ae35882bc845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:53.756473 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2a4c5-7a05-4b4e-a26d-ae35882bc845 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:53.756780 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2a4c5-7a05-4b4e-a26d-ae35882bc845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:53.757054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2a4c5-7a05-4b4e-a26d-ae35882bc845 admin admin] PATH_INFO: `/v3/projects/3a3c3219078b40e8b68baa402bf8f4c5/users/e67a7286154049079cb2ae8aab86560e/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:53.772146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2a4c5-7a05-4b4e-a26d-ae35882bc845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3c3219078b40e8b68baa402bf8f4c5, user_id=e67a7286154049079cb2ae8aab86560e, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:53.775424 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2a4c5-7a05-4b4e-a26d-ae35882bc845 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:53.791167 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1403/2847] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:33:53 2022] PUT /identity/v3/projects/3a3c3219078b40e8b68baa402bf8f4c5/users/e67a7286154049079cb2ae8aab86560e/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:33:53.861211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8db5c7-56ce-416c-866a-9c9a93ccc000 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:53.861808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8db5c7-56ce-416c-866a-9c9a93ccc000 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:53.861808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8db5c7-56ce-416c-866a-9c9a93ccc000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:53.890364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3d8db5c7-56ce-416c-866a-9c9a93ccc000 None None] MFA Rules not processed for user `e67a7286154049079cb2ae8aab86560e`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:53.891672 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3d8db5c7-56ce-416c-866a-9c9a93ccc000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:53.960484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1445/2848] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:53.972135 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2a4c5-7a05-4b4e-a26d-ae35882bc845 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:53.973882 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1bd2a4c5-7a05-4b4e-a26d-ae35882bc845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:54.033489 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2a4c5-7a05-4b4e-a26d-ae35882bc845 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:54.037201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e49be-5aa6-43bc-ae3e-bee246eca586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:54.037922 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e49be-5aa6-43bc-ae3e-bee246eca586 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:54.038203 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e49be-5aa6-43bc-ae3e-bee246eca586 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:54.038474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e49be-5aa6-43bc-ae3e-bee246eca586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:54.046718 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e49be-5aa6-43bc-ae3e-bee246eca586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:54.048171 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e49be-5aa6-43bc-ae3e-bee246eca586 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:54.056913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1404/2849] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:54.461908 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc4c82-a329-4435-a373-14db84030e98 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:54.462189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc4c82-a329-4435-a373-14db84030e98 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:54.462463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc4c82-a329-4435-a373-14db84030e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:54.484856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-88bc4c82-a329-4435-a373-14db84030e98 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:54.486175 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-88bc4c82-a329-4435-a373-14db84030e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:54.512312 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:54.557179 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1446/2850] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 16:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:54.648848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e49be-5aa6-43bc-ae3e-bee246eca586 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:54.650594 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7a0e49be-5aa6-43bc-ae3e-bee246eca586 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:54.665152 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:33:54.750471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e49be-5aa6-43bc-ae3e-bee246eca586 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:54.757176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf600fd-0c36-451a-ab0f-edb08ba7b528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:54.758118 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf600fd-0c36-451a-ab0f-edb08ba7b528 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:54.758405 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf600fd-0c36-451a-ab0f-edb08ba7b528 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:54.758672 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf600fd-0c36-451a-ab0f-edb08ba7b528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:54.773009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf600fd-0c36-451a-ab0f-edb08ba7b528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:54.773009 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf600fd-0c36-451a-ab0f-edb08ba7b528 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:54.781154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1405/2851] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:33:55.454563 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be6a18-ff2c-4a32-93b4-b3667848ecfe None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:55.455206 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be6a18-ff2c-4a32-93b4-b3667848ecfe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:55.455503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be6a18-ff2c-4a32-93b4-b3667848ecfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:55.480093 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-53be6a18-ff2c-4a32-93b4-b3667848ecfe None None] MFA Rules not processed for user `e67a7286154049079cb2ae8aab86560e`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:55.481245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-53be6a18-ff2c-4a32-93b4-b3667848ecfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:55.488011 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1447/2852] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:33:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:58.669278 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3112f9a-555e-461b-99e9-2013fdc1e8de None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:58.669888 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3112f9a-555e-461b-99e9-2013fdc1e8de None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:58.670085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3112f9a-555e-461b-99e9-2013fdc1e8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:58.689315 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-f3112f9a-555e-461b-99e9-2013fdc1e8de None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:33:58.690820 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f3112f9a-555e-461b-99e9-2013fdc1e8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:58.699867 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1406/2853] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 16:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:33:58.722182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be6a18-ff2c-4a32-93b4-b3667848ecfe None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:33:58.723808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-53be6a18-ff2c-4a32-93b4-b3667848ecfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:33:58.740792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be6a18-ff2c-4a32-93b4-b3667848ecfe None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:33:58.746744 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea31bb4-9806-4b7b-8745-06aee7f7da87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:33:58.747360 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea31bb4-9806-4b7b-8745-06aee7f7da87 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:33:58.747641 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea31bb4-9806-4b7b-8745-06aee7f7da87 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:33:58.747912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea31bb4-9806-4b7b-8745-06aee7f7da87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:33:58.756704 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea31bb4-9806-4b7b-8745-06aee7f7da87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:33:58.758295 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea31bb4-9806-4b7b-8745-06aee7f7da87 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:33:58.769038 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1448/2854] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:34:00.732007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3112f9a-555e-461b-99e9-2013fdc1e8de None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:00.733458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f3112f9a-555e-461b-99e9-2013fdc1e8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:00.796329 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3112f9a-555e-461b-99e9-2013fdc1e8de None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:00.800748 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f43d2-365c-4d1c-9f38-6e1891465f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:00.801595 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f43d2-365c-4d1c-9f38-6e1891465f23 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:00.801766 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f43d2-365c-4d1c-9f38-6e1891465f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:00.802047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f43d2-365c-4d1c-9f38-6e1891465f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:00.807993 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ee3f43d2-365c-4d1c-9f38-6e1891465f23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:00.820239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f43d2-365c-4d1c-9f38-6e1891465f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:00.822735 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f43d2-365c-4d1c-9f38-6e1891465f23 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:00.831862 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1407/2855] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:34:02.102912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea31bb4-9806-4b7b-8745-06aee7f7da87 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:02.104377 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8ea31bb4-9806-4b7b-8745-06aee7f7da87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:02.117323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea31bb4-9806-4b7b-8745-06aee7f7da87 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:02.122329 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e8e76-7c3e-4369-b75d-6f1e1f9034a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:02.122934 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e8e76-7c3e-4369-b75d-6f1e1f9034a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:02.123205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e8e76-7c3e-4369-b75d-6f1e1f9034a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:02.123470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e8e76-7c3e-4369-b75d-6f1e1f9034a1 admin admin] PATH_INFO: `/v3/users/31739a6cdf524bb5af70965d7b467226` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:02.124598 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e8e76-7c3e-4369-b75d-6f1e1f9034a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31739a6cdf524bb5af70965d7b467226)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:02.126509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e8e76-7c3e-4369-b75d-6f1e1f9034a1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:02.171208 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7e1e8e76-7c3e-4369-b75d-6f1e1f9034a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31739a6cdf524bb5af70965d7b467226'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:02.171849 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7e1e8e76-7c3e-4369-b75d-6f1e1f9034a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31739a6cdf524bb5af70965d7b467226'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:02.183886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7e1e8e76-7c3e-4369-b75d-6f1e1f9034a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31739a6cdf524bb5af70965d7b467226'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:02.190976 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7e1e8e76-7c3e-4369-b75d-6f1e1f9034a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31739a6cdf524bb5af70965d7b467226'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:02.191633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7e1e8e76-7c3e-4369-b75d-6f1e1f9034a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31739a6cdf524bb5af70965d7b467226'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:02.206249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1449/2856] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:34:02 2022] DELETE /identity/v3/users/31739a6cdf524bb5af70965d7b467226 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:34:02.210898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c60c9-37fe-4bdf-b610-b7ab4a281e6b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:02.211377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c60c9-37fe-4bdf-b610-b7ab4a281e6b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:02.211479 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c60c9-37fe-4bdf-b610-b7ab4a281e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:02.229972 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ec5c60c9-37fe-4bdf-b610-b7ab4a281e6b None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:02.231077 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ec5c60c9-37fe-4bdf-b610-b7ab4a281e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:02.288848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1408/2857] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:02.298980 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e8e76-7c3e-4369-b75d-6f1e1f9034a1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:02.300380 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7e1e8e76-7c3e-4369-b75d-6f1e1f9034a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:02.357062 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e8e76-7c3e-4369-b75d-6f1e1f9034a1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:02.360858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6a940-b7ce-42f6-a804-84041f85d3c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:02.361455 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6a940-b7ce-42f6-a804-84041f85d3c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:02.361758 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6a940-b7ce-42f6-a804-84041f85d3c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:02.362029 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6a940-b7ce-42f6-a804-84041f85d3c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:02.371533 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6a940-b7ce-42f6-a804-84041f85d3c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:02.372989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6a940-b7ce-42f6-a804-84041f85d3c7 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:02.382193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1450/2858] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:34:02.668020 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c60c9-37fe-4bdf-b610-b7ab4a281e6b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:02.669496 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ec5c60c9-37fe-4bdf-b610-b7ab4a281e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:02.683461 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c60c9-37fe-4bdf-b610-b7ab4a281e6b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:02.687960 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f0a0f-e7ef-4c98-8780-33de6859383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:02.688596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f0a0f-e7ef-4c98-8780-33de6859383b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:02.688913 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f0a0f-e7ef-4c98-8780-33de6859383b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:02.689181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f0a0f-e7ef-4c98-8780-33de6859383b admin admin] PATH_INFO: `/v3/projects/06c12f8a860c402ab2ef0502416c9d1e` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:02.690306 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f0a0f-e7ef-4c98-8780-33de6859383b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c12f8a860c402ab2ef0502416c9d1e)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:02.692242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f0a0f-e7ef-4c98-8780-33de6859383b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:02.728873 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:34:02.743165 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-388f0a0f-e7ef-4c98-8780-33de6859383b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c12f8a860c402ab2ef0502416c9d1e', 'request_id': 'req-388f0a0f-e7ef-4c98-8780-33de6859383b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:02.749676 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-388f0a0f-e7ef-4c98-8780-33de6859383b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c12f8a860c402ab2ef0502416c9d1e', 'request_id': 'req-388f0a0f-e7ef-4c98-8780-33de6859383b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:02.755698 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-388f0a0f-e7ef-4c98-8780-33de6859383b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c12f8a860c402ab2ef0502416c9d1e', 'request_id': 'req-388f0a0f-e7ef-4c98-8780-33de6859383b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:02.769386 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-388f0a0f-e7ef-4c98-8780-33de6859383b admin admin] The token cache is being invalidate because project 06c12f8a860c402ab2ef0502416c9d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:34:02.769680 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-388f0a0f-e7ef-4c98-8780-33de6859383b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:02.770300 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-388f0a0f-e7ef-4c98-8780-33de6859383b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:02.771780 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1409/2859] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:34:02 2022] DELETE /identity/v3/projects/06c12f8a860c402ab2ef0502416c9d1e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:34:02.777307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053133-a3b5-401b-b503-fe23dce5bc84 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:02.777597 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053133-a3b5-401b-b503-fe23dce5bc84 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:02.777871 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053133-a3b5-401b-b503-fe23dce5bc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:02.797639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-41053133-a3b5-401b-b503-fe23dce5bc84 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:02.798851 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-41053133-a3b5-401b-b503-fe23dce5bc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:02.821180 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:34:02.871842 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1451/2860] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:34:02.874181 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bbf62-8607-4b5a-9088-41186b56bee9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:02.874752 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bbf62-8607-4b5a-9088-41186b56bee9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:02.875199 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bbf62-8607-4b5a-9088-41186b56bee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:02.881754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a73ae-7180-46a1-aa9d-464b4e71b075 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:02.882125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a73ae-7180-46a1-aa9d-464b4e71b075 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:02.882401 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a73ae-7180-46a1-aa9d-464b4e71b075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:02.896072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e38bbf62-8607-4b5a-9088-41186b56bee9 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:02.897322 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e38bbf62-8607-4b5a-9088-41186b56bee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:02.902732 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-609a73ae-7180-46a1-aa9d-464b4e71b075 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:02.903883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-609a73ae-7180-46a1-aa9d-464b4e71b075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:02.906122 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1410/2861] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 16:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:02.912059 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1452/2862] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:34:02.917125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bbf62-8607-4b5a-9088-41186b56bee9 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:02.927189 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a73ae-7180-46a1-aa9d-464b4e71b075 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:02.927366 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bbf62-8607-4b5a-9088-41186b56bee9 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:02.928541 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-609a73ae-7180-46a1-aa9d-464b4e71b075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:02.931849 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749864-f963-41d3-b978-f37399e8c46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:02.932447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749864-f963-41d3-b978-f37399e8c46f admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:02.932741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749864-f963-41d3-b978-f37399e8c46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:02.933021 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749864-f963-41d3-b978-f37399e8c46f admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:02.933649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20749864-f963-41d3-b978-f37399e8c46f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:34:02.933947 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20749864-f963-41d3-b978-f37399e8c46f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:02.935518 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20749864-f963-41d3-b978-f37399e8c46f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:02.955784 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1411/2863] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:34:02.956952 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749864-f963-41d3-b978-f37399e8c46f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:02.968903 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749864-f963-41d3-b978-f37399e8c46f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:02.979544 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45610d5f-019c-4ab9-820c-e1951b16ec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:02.980154 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45610d5f-019c-4ab9-820c-e1951b16ec59 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:02.980851 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45610d5f-019c-4ab9-820c-e1951b16ec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:02.980851 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45610d5f-019c-4ab9-820c-e1951b16ec59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:02.985354 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45610d5f-019c-4ab9-820c-e1951b16ec59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:02.987194 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45610d5f-019c-4ab9-820c-e1951b16ec59 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:03.028404 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a73ae-7180-46a1-aa9d-464b4e71b075 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:03.029449 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1412/2864] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:34:02 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:34:03.033760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45610d5f-019c-4ab9-820c-e1951b16ec59 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:03.103838 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d45c17-58d1-4cd5-bf13-c0cb0f773644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:03.104558 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d45c17-58d1-4cd5-bf13-c0cb0f773644 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:03.104929 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d45c17-58d1-4cd5-bf13-c0cb0f773644 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:03.105270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d45c17-58d1-4cd5-bf13-c0cb0f773644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:03.109543 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45610d5f-019c-4ab9-820c-e1951b16ec59 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:03.114560 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d45c17-58d1-4cd5-bf13-c0cb0f773644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:03.115777 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40cf7f-e695-416e-9dee-e6bc4e2585b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:03.116463 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40cf7f-e695-416e-9dee-e6bc4e2585b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:03.116581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d45c17-58d1-4cd5-bf13-c0cb0f773644 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:03.116921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40cf7f-e695-416e-9dee-e6bc4e2585b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:03.117264 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40cf7f-e695-416e-9dee-e6bc4e2585b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:03.117999 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40cf7f-e695-416e-9dee-e6bc4e2585b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:03.119957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40cf7f-e695-416e-9dee-e6bc4e2585b8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:03.131863 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1453/2865] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:34:03.142169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1413/2866] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:34:03 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:34:03.146554 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d45c17-58d1-4cd5-bf13-c0cb0f773644 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:03.156999 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d45c17-58d1-4cd5-bf13-c0cb0f773644 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:03.161645 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c4c15-bdf6-41f7-9662-181bd0bfc6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:03.162229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c4c15-bdf6-41f7-9662-181bd0bfc6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:03.162503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c4c15-bdf6-41f7-9662-181bd0bfc6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:03.162769 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c4c15-bdf6-41f7-9662-181bd0bfc6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:03.163400 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c4c15-bdf6-41f7-9662-181bd0bfc6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:03.165016 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c4c15-bdf6-41f7-9662-181bd0bfc6b0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:03.175220 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1454/2867] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:34:03.179095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40cf7f-e695-416e-9dee-e6bc4e2585b8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:03.189128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40cf7f-e695-416e-9dee-e6bc4e2585b8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:03.193776 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f719c-4a93-480e-9c8e-00de1426f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:03.194371 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f719c-4a93-480e-9c8e-00de1426f0cb admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:03.194652 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f719c-4a93-480e-9c8e-00de1426f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:03.194923 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f719c-4a93-480e-9c8e-00de1426f0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:03.195565 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f719c-4a93-480e-9c8e-00de1426f0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:03.197992 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f719c-4a93-480e-9c8e-00de1426f0cb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:03.208701 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1414/2868] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:34:03.213449 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c4c15-bdf6-41f7-9662-181bd0bfc6b0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:03.223284 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c4c15-bdf6-41f7-9662-181bd0bfc6b0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:03.228021 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb9e24-60e6-483b-9f7f-e480a542843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:03.228660 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb9e24-60e6-483b-9f7f-e480a542843d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:03.229136 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb9e24-60e6-483b-9f7f-e480a542843d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:03.229408 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb9e24-60e6-483b-9f7f-e480a542843d admin admin] PATH_INFO: `/v3/projects/85ba6e8727094ac4bb1dcba200babab6/users/0724af3124c64095b9717d38a144ee0b/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:03.247806 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb9e24-60e6-483b-9f7f-e480a542843d admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ba6e8727094ac4bb1dcba200babab6, user_id=0724af3124c64095b9717d38a144ee0b, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:03.250394 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb9e24-60e6-483b-9f7f-e480a542843d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:03.263935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1455/2869] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:34:03 2022] PUT /identity/v3/projects/85ba6e8727094ac4bb1dcba200babab6/users/0724af3124c64095b9717d38a144ee0b/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:34:03.269094 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c19af8-20cf-4fe1-a4b6-100664a8274d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:03.269592 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c19af8-20cf-4fe1-a4b6-100664a8274d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:03.269592 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c19af8-20cf-4fe1-a4b6-100664a8274d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:03.292162 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-59c19af8-20cf-4fe1-a4b6-100664a8274d None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:03.293428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-59c19af8-20cf-4fe1-a4b6-100664a8274d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:03.343882 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:34:03.359733 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1415/2870] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:03.369551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb9e24-60e6-483b-9f7f-e480a542843d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:03.371302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5ffb9e24-60e6-483b-9f7f-e480a542843d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:03.381120 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:34:03.431009 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb9e24-60e6-483b-9f7f-e480a542843d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:03.434829 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e10170-8ca6-42fb-97c6-dbda0138e07b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:03.435439 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10170-8ca6-42fb-97c6-dbda0138e07b service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:03.435721 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10170-8ca6-42fb-97c6-dbda0138e07b service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:03.435994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10170-8ca6-42fb-97c6-dbda0138e07b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:03.445784 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e10170-8ca6-42fb-97c6-dbda0138e07b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:03.448275 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e10170-8ca6-42fb-97c6-dbda0138e07b service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:03.464788 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1456/2871] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:34:04.105260 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e8ee-0c19-4a66-96ef-2faaf69de1cf None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:04.105549 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e8ee-0c19-4a66-96ef-2faaf69de1cf None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:04.105827 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e8ee-0c19-4a66-96ef-2faaf69de1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:04.137795 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-bc43e8ee-0c19-4a66-96ef-2faaf69de1cf None None] MFA Rules not processed for user `0724af3124c64095b9717d38a144ee0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:04.138840 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bc43e8ee-0c19-4a66-96ef-2faaf69de1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:04.214457 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1416/2872] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:04.226349 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e10170-8ca6-42fb-97c6-dbda0138e07b service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:04.228800 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b5e10170-8ca6-42fb-97c6-dbda0138e07b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:04.315665 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e10170-8ca6-42fb-97c6-dbda0138e07b service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:04.319781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db428c6f-20f3-4dd9-9b13-34d5238055d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:04.320495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db428c6f-20f3-4dd9-9b13-34d5238055d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:04.320955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db428c6f-20f3-4dd9-9b13-34d5238055d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:04.321249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db428c6f-20f3-4dd9-9b13-34d5238055d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:04.330451 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db428c6f-20f3-4dd9-9b13-34d5238055d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:04.331876 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db428c6f-20f3-4dd9-9b13-34d5238055d4 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:04.341741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1457/2873] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:34:05.723550 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878d028-3c2a-4534-9c26-b2c7d13159c2 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:05.724047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878d028-3c2a-4534-9c26-b2c7d13159c2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:05.724047 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878d028-3c2a-4534-9c26-b2c7d13159c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:05.743495 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-4878d028-3c2a-4534-9c26-b2c7d13159c2 None None] MFA Rules not processed for user `0724af3124c64095b9717d38a144ee0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:05.744744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4878d028-3c2a-4534-9c26-b2c7d13159c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:05.751596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1417/2874] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:05.982819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db428c6f-20f3-4dd9-9b13-34d5238055d4 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:05.992191 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db428c6f-20f3-4dd9-9b13-34d5238055d4 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:05.995901 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a25d9a-5c33-4b94-a4e8-cebca8a2de5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:05.996496 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25d9a-5c33-4b94-a4e8-cebca8a2de5c service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:05.996814 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25d9a-5c33-4b94-a4e8-cebca8a2de5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:05.997085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25d9a-5c33-4b94-a4e8-cebca8a2de5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:05.998765 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-51a25d9a-5c33-4b94-a4e8-cebca8a2de5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:06.008337 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a25d9a-5c33-4b94-a4e8-cebca8a2de5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:06.010323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a25d9a-5c33-4b94-a4e8-cebca8a2de5c service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:06.018222 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1458/2875] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:34:06.353846 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878d028-3c2a-4534-9c26-b2c7d13159c2 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:06.356057 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4878d028-3c2a-4534-9c26-b2c7d13159c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:06.455163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878d028-3c2a-4534-9c26-b2c7d13159c2 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:06.464615 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74386ad-f473-45d8-8199-34e8cd3222e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd3076ca5a84ff7ada13065f9531f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:06.465495 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74386ad-f473-45d8-8199-34e8cd3222e5 service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:06.465974 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74386ad-f473-45d8-8199-34e8cd3222e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:06.466969 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74386ad-f473-45d8-8199-34e8cd3222e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:06.469123 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f74386ad-f473-45d8-8199-34e8cd3222e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:06.483216 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74386ad-f473-45d8-8199-34e8cd3222e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:06.485140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74386ad-f473-45d8-8199-34e8cd3222e5 service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:06.497026 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1418/2876] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:34:16.014638 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=55 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:34:16.310415 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a25d9a-5c33-4b94-a4e8-cebca8a2de5c service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:16.312307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-51a25d9a-5c33-4b94-a4e8-cebca8a2de5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:16.468302 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a25d9a-5c33-4b94-a4e8-cebca8a2de5c service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:16.483733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a074835-b0c8-428d-a649-2120c7703de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:16.485063 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a074835-b0c8-428d-a649-2120c7703de3 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:16.486584 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a074835-b0c8-428d-a649-2120c7703de3 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:16.487975 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a074835-b0c8-428d-a649-2120c7703de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:16.493627 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=69 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:34:16.494305 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3a074835-b0c8-428d-a649-2120c7703de3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:16.514972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a074835-b0c8-428d-a649-2120c7703de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:16.517417 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a074835-b0c8-428d-a649-2120c7703de3 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:16.535438 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1459/2877] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:34:17.862178 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82d22f-57c6-4698-b95d-f016cdd08c2e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:17.862687 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82d22f-57c6-4698-b95d-f016cdd08c2e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:17.862957 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82d22f-57c6-4698-b95d-f016cdd08c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:17.927197 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1c82d22f-57c6-4698-b95d-f016cdd08c2e None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:17.928571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1c82d22f-57c6-4698-b95d-f016cdd08c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:17.997869 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1419/2878] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:18.043578 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a074835-b0c8-428d-a649-2120c7703de3 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:18.045038 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3a074835-b0c8-428d-a649-2120c7703de3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:18.135527 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a074835-b0c8-428d-a649-2120c7703de3 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:18.140509 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d296ac-468d-44a9-a1db-a6c531d805fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:18.141130 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d296ac-468d-44a9-a1db-a6c531d805fa service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:18.141405 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d296ac-468d-44a9-a1db-a6c531d805fa service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:18.141671 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d296ac-468d-44a9-a1db-a6c531d805fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:18.150110 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d296ac-468d-44a9-a1db-a6c531d805fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:18.151659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d296ac-468d-44a9-a1db-a6c531d805fa service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:18.159418 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1460/2879] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:34:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:34:18.682272 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca709e5-5967-4ac7-9da6-e85d5da8777b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:18.682558 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca709e5-5967-4ac7-9da6-e85d5da8777b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:18.682833 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca709e5-5967-4ac7-9da6-e85d5da8777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:18.703338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-4ca709e5-5967-4ac7-9da6-e85d5da8777b None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:18.704556 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4ca709e5-5967-4ac7-9da6-e85d5da8777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:18.712343 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1420/2880] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 21 16:34:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:18.725174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d296ac-468d-44a9-a1db-a6c531d805fa service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:18.735946 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d296ac-468d-44a9-a1db-a6c531d805fa service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:18.740966 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478674d-742f-4d9f-a156-d2d4418120c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:18.741564 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478674d-742f-4d9f-a156-d2d4418120c9 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:18.741834 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478674d-742f-4d9f-a156-d2d4418120c9 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:18.742102 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478674d-742f-4d9f-a156-d2d4418120c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:18.751235 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478674d-742f-4d9f-a156-d2d4418120c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:18.753354 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478674d-742f-4d9f-a156-d2d4418120c9 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:18.762723 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1461/2881] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:34:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:34:19.015566 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9877a5d-6532-4965-a664-389fbc109569 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:19.016089 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9877a5d-6532-4965-a664-389fbc109569 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:19.016188 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9877a5d-6532-4965-a664-389fbc109569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:19.036493 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e9877a5d-6532-4965-a664-389fbc109569 None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:19.037760 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e9877a5d-6532-4965-a664-389fbc109569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:19.045540 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1421/2882] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:34:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:19.059010 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478674d-742f-4d9f-a156-d2d4418120c9 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:19.071069 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478674d-742f-4d9f-a156-d2d4418120c9 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:19.076321 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee71926-891c-424e-a340-b39520bb5708 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:19.076948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee71926-891c-424e-a340-b39520bb5708 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:19.077225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee71926-891c-424e-a340-b39520bb5708 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:19.077872 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee71926-891c-424e-a340-b39520bb5708 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:19.087463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee71926-891c-424e-a340-b39520bb5708 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:19.089270 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee71926-891c-424e-a340-b39520bb5708 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:19.098334 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1462/2883] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:34:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:34:19.435458 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f266dc-ad67-4d42-98ac-2a802cf7136d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:19.435739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f266dc-ad67-4d42-98ac-2a802cf7136d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:19.436054 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f266dc-ad67-4d42-98ac-2a802cf7136d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:19.456007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-24f266dc-ad67-4d42-98ac-2a802cf7136d None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:19.457357 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-24f266dc-ad67-4d42-98ac-2a802cf7136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:19.464362 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1422/2884] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 21 16:34:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:19.476738 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee71926-891c-424e-a340-b39520bb5708 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:19.487040 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee71926-891c-424e-a340-b39520bb5708 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:19.492043 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dbcdf-e923-480f-a253-c7caac145f39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:19.493163 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dbcdf-e923-480f-a253-c7caac145f39 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:19.493437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dbcdf-e923-480f-a253-c7caac145f39 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:19.493699 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dbcdf-e923-480f-a253-c7caac145f39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:19.501507 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dbcdf-e923-480f-a253-c7caac145f39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:19.503065 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dbcdf-e923-480f-a253-c7caac145f39 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:19.512795 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1463/2885] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:34:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:34:21.451996 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd31e1-fda7-46e4-ae96-beb1bdb17d16 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:21.452529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd31e1-fda7-46e4-ae96-beb1bdb17d16 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:21.452529 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd31e1-fda7-46e4-ae96-beb1bdb17d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:21.471382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-cbcd31e1-fda7-46e4-ae96-beb1bdb17d16 None None] MFA Rules not processed for user `a43a87036d66437eb64ea58231e41845`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:21.472559 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cbcd31e1-fda7-46e4-ae96-beb1bdb17d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:21.526384 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1423/2886] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:21.722095 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dbcdf-e923-480f-a253-c7caac145f39 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:21.723550 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4a1dbcdf-e923-480f-a253-c7caac145f39 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:21.737600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dbcdf-e923-480f-a253-c7caac145f39 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:21.742767 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24df04-2255-4f75-9512-1f1ede79e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:21.743384 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24df04-2255-4f75-9512-1f1ede79e4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:21.743663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24df04-2255-4f75-9512-1f1ede79e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:21.743935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24df04-2255-4f75-9512-1f1ede79e4c8 admin admin] PATH_INFO: `/v3/users/e67a7286154049079cb2ae8aab86560e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:21.745140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24df04-2255-4f75-9512-1f1ede79e4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67a7286154049079cb2ae8aab86560e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:21.747086 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24df04-2255-4f75-9512-1f1ede79e4c8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:21.759255 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:34:21.762060 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd31e1-fda7-46e4-ae96-beb1bdb17d16 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:21.763487 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cbcd31e1-fda7-46e4-ae96-beb1bdb17d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:21.776601 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd31e1-fda7-46e4-ae96-beb1bdb17d16 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:21.780418 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cf124-7198-4633-9b14-22fd29b03890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:21.781132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cf124-7198-4633-9b14-22fd29b03890 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:21.781482 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cf124-7198-4633-9b14-22fd29b03890 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:21.781848 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cf124-7198-4633-9b14-22fd29b03890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:21.783723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2b6cf124-7198-4633-9b14-22fd29b03890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:21.794377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cf124-7198-4633-9b14-22fd29b03890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:21.795831 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cf124-7198-4633-9b14-22fd29b03890 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:21.797733 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0d24df04-2255-4f75-9512-1f1ede79e4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67a7286154049079cb2ae8aab86560e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:21.798440 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0d24df04-2255-4f75-9512-1f1ede79e4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67a7286154049079cb2ae8aab86560e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:21.804128 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1424/2887] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:34:21.811858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0d24df04-2255-4f75-9512-1f1ede79e4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67a7286154049079cb2ae8aab86560e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:21.818678 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0d24df04-2255-4f75-9512-1f1ede79e4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67a7286154049079cb2ae8aab86560e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:21.819387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0d24df04-2255-4f75-9512-1f1ede79e4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67a7286154049079cb2ae8aab86560e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:21.833667 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1464/2888] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:34:21 2022] DELETE /identity/v3/users/e67a7286154049079cb2ae8aab86560e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:34:21.839027 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5667470-5e87-4916-99b7-530fbb990c27 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:21.839317 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5667470-5e87-4916-99b7-530fbb990c27 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:21.839588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5667470-5e87-4916-99b7-530fbb990c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:21.860334 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a5667470-5e87-4916-99b7-530fbb990c27 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:21.861580 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a5667470-5e87-4916-99b7-530fbb990c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:21.904661 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:34:21.925635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1425/2889] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:21.936340 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24df04-2255-4f75-9512-1f1ede79e4c8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:21.937902 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0d24df04-2255-4f75-9512-1f1ede79e4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:22.001274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24df04-2255-4f75-9512-1f1ede79e4c8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:22.004950 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee5caa-c70b-4da8-8af2-3073aa152a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:22.005568 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5caa-c70b-4da8-8af2-3073aa152a66 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:22.005852 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5caa-c70b-4da8-8af2-3073aa152a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:22.006148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5caa-c70b-4da8-8af2-3073aa152a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:22.016480 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee5caa-c70b-4da8-8af2-3073aa152a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:22.017944 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee5caa-c70b-4da8-8af2-3073aa152a66 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:22.028730 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1465/2890] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:34:22.248486 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5667470-5e87-4916-99b7-530fbb990c27 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:22.251190 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a5667470-5e87-4916-99b7-530fbb990c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:22.270519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5667470-5e87-4916-99b7-530fbb990c27 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:22.277034 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc282ed8-848c-4e2d-8628-8c219591ef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:22.278121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc282ed8-848c-4e2d-8628-8c219591ef7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:22.278596 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc282ed8-848c-4e2d-8628-8c219591ef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:22.279176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc282ed8-848c-4e2d-8628-8c219591ef7b admin admin] PATH_INFO: `/v3/projects/3a3c3219078b40e8b68baa402bf8f4c5` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:22.281187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc282ed8-848c-4e2d-8628-8c219591ef7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3c3219078b40e8b68baa402bf8f4c5)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:22.284538 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc282ed8-848c-4e2d-8628-8c219591ef7b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:22.339265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dc282ed8-848c-4e2d-8628-8c219591ef7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3c3219078b40e8b68baa402bf8f4c5', 'request_id': 'req-dc282ed8-848c-4e2d-8628-8c219591ef7b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:22.345819 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dc282ed8-848c-4e2d-8628-8c219591ef7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3c3219078b40e8b68baa402bf8f4c5', 'request_id': 'req-dc282ed8-848c-4e2d-8628-8c219591ef7b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:22.352795 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dc282ed8-848c-4e2d-8628-8c219591ef7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3c3219078b40e8b68baa402bf8f4c5', 'request_id': 'req-dc282ed8-848c-4e2d-8628-8c219591ef7b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:22.369124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dc282ed8-848c-4e2d-8628-8c219591ef7b admin admin] The token cache is being invalidate because project 3a3c3219078b40e8b68baa402bf8f4c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:34:22.369124 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dc282ed8-848c-4e2d-8628-8c219591ef7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:22.369649 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-dc282ed8-848c-4e2d-8628-8c219591ef7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:34:22.371195 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1426/2891] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:34:22 2022] DELETE /identity/v3/projects/3a3c3219078b40e8b68baa402bf8f4c5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:34:22.376497 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04b5a6-46ff-43de-980d-54e1f78405e0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:22.376815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04b5a6-46ff-43de-980d-54e1f78405e0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:22.377094 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04b5a6-46ff-43de-980d-54e1f78405e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:22.399307 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-da04b5a6-46ff-43de-980d-54e1f78405e0 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:22.400581 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-da04b5a6-46ff-43de-980d-54e1f78405e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:22.484599 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1466/2892] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:34:22.493981 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c5814-d331-4582-af6f-4c0d69ec76b4 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:22.494542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c5814-d331-4582-af6f-4c0d69ec76b4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:22.494542 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c5814-d331-4582-af6f-4c0d69ec76b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:22.526801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-779c5814-d331-4582-af6f-4c0d69ec76b4 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:22.529483 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-779c5814-d331-4582-af6f-4c0d69ec76b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:22.536897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1427/2893] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:34:22.541602 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04b5a6-46ff-43de-980d-54e1f78405e0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:22.552446 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04b5a6-46ff-43de-980d-54e1f78405e0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:22.558945 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992e2bc-de0b-4c70-ad86-65dcc284d5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:22.559566 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992e2bc-de0b-4c70-ad86-65dcc284d5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:22.559852 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992e2bc-de0b-4c70-ad86-65dcc284d5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:22.560125 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992e2bc-de0b-4c70-ad86-65dcc284d5cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:22.560857 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992e2bc-de0b-4c70-ad86-65dcc284d5cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:34:22.561205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992e2bc-de0b-4c70-ad86-65dcc284d5cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:22.563014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992e2bc-de0b-4c70-ad86-65dcc284d5cf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:22.580763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1467/2894] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 16:34:22.583488 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c5814-d331-4582-af6f-4c0d69ec76b4 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:22.593890 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c5814-d331-4582-af6f-4c0d69ec76b4 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:22.598871 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2214de4-01b2-441b-a9c9-40ecbc4d10c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:22.599627 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2214de4-01b2-441b-a9c9-40ecbc4d10c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:22.600012 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2214de4-01b2-441b-a9c9-40ecbc4d10c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:22.600372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2214de4-01b2-441b-a9c9-40ecbc4d10c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:22.601163 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2214de4-01b2-441b-a9c9-40ecbc4d10c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:22.603289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2214de4-01b2-441b-a9c9-40ecbc4d10c9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:22.637928 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1428/2895] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:34:22 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:34:22.641993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992e2bc-de0b-4c70-ad86-65dcc284d5cf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:22.655459 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992e2bc-de0b-4c70-ad86-65dcc284d5cf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:22.671323 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:34:22.725114 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77084a-4275-431a-baa1-6c4c05537928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:22.725773 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77084a-4275-431a-baa1-6c4c05537928 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:22.726053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77084a-4275-431a-baa1-6c4c05537928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:22.726389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77084a-4275-431a-baa1-6c4c05537928 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:22.727070 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77084a-4275-431a-baa1-6c4c05537928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:22.729039 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77084a-4275-431a-baa1-6c4c05537928 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:22.751593 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1468/2896] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:34:22 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:34:22.757243 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2214de4-01b2-441b-a9c9-40ecbc4d10c9 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:22.769053 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2214de4-01b2-441b-a9c9-40ecbc4d10c9 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:22.774406 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f08a51-416e-45f8-b82c-fe455637b95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:22.775017 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f08a51-416e-45f8-b82c-fe455637b95a admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:22.775295 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f08a51-416e-45f8-b82c-fe455637b95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:22.775566 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f08a51-416e-45f8-b82c-fe455637b95a admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:22.776235 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f08a51-416e-45f8-b82c-fe455637b95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:22.777845 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f08a51-416e-45f8-b82c-fe455637b95a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:22.789292 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1429/2897] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:34:22.794275 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77084a-4275-431a-baa1-6c4c05537928 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:22.807145 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77084a-4275-431a-baa1-6c4c05537928 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:22.813425 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22333d5-c26b-4f5c-97d0-c292bb299ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:22.814381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22333d5-c26b-4f5c-97d0-c292bb299ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:22.814648 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22333d5-c26b-4f5c-97d0-c292bb299ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:22.815061 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22333d5-c26b-4f5c-97d0-c292bb299ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:22.815947 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22333d5-c26b-4f5c-97d0-c292bb299ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:22.818018 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22333d5-c26b-4f5c-97d0-c292bb299ff7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:22.832734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1469/2898] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 16:34:22.835812 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f08a51-416e-45f8-b82c-fe455637b95a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:22.846744 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f08a51-416e-45f8-b82c-fe455637b95a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:22.852741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb072f-cae2-4408-9ef7-bdb67beee5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:22.852741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb072f-cae2-4408-9ef7-bdb67beee5df admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:22.852741 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb072f-cae2-4408-9ef7-bdb67beee5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:22.853172 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb072f-cae2-4408-9ef7-bdb67beee5df admin admin] PATH_INFO: `/v3/projects/59dcf94535a841ddaba47c978a683b89/users/dbb4892506c04a178bf63327c4c77b5c/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:22.870409 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb072f-cae2-4408-9ef7-bdb67beee5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=59dcf94535a841ddaba47c978a683b89, user_id=dbb4892506c04a178bf63327c4c77b5c, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:22.873460 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb072f-cae2-4408-9ef7-bdb67beee5df admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:22.889370 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1430/2899] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:34:22 2022] PUT /identity/v3/projects/59dcf94535a841ddaba47c978a683b89/users/dbb4892506c04a178bf63327c4c77b5c/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:34:22.894434 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf23969-d8f0-4a4e-8feb-45f11c19ad1c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:22.894892 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf23969-d8f0-4a4e-8feb-45f11c19ad1c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:22.895174 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf23969-d8f0-4a4e-8feb-45f11c19ad1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:22.916533 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ebf23969-d8f0-4a4e-8feb-45f11c19ad1c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:22.917843 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ebf23969-d8f0-4a4e-8feb-45f11c19ad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:22.979577 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1470/2900] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:22.989347 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb072f-cae2-4408-9ef7-bdb67beee5df admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:22.991061 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4aeb072f-cae2-4408-9ef7-bdb67beee5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:23.059471 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb072f-cae2-4408-9ef7-bdb67beee5df admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:23.063713 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ff37c-f334-463a-b066-e3552133bab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:23.064491 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ff37c-f334-463a-b066-e3552133bab1 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:23.064823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ff37c-f334-463a-b066-e3552133bab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:23.065098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ff37c-f334-463a-b066-e3552133bab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:23.075895 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ff37c-f334-463a-b066-e3552133bab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:23.077355 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ff37c-f334-463a-b066-e3552133bab1 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:23.087674 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1431/2901] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:34:28.303460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa802-f9d7-4147-af60-2d5f0c655b09 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:28.303998 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa802-f9d7-4147-af60-2d5f0c655b09 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:28.303998 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa802-f9d7-4147-af60-2d5f0c655b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:28.354888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bf6fa802-f9d7-4147-af60-2d5f0c655b09 None None] MFA Rules not processed for user `dbb4892506c04a178bf63327c4c77b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:28.356437 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bf6fa802-f9d7-4147-af60-2d5f0c655b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:28.481970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1471/2902] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:28.486989 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ff37c-f334-463a-b066-e3552133bab1 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:28.497095 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ff37c-f334-463a-b066-e3552133bab1 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:28.502191 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b582010-3d3c-45c4-9c7e-d0ca980cac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:28.502910 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b582010-3d3c-45c4-9c7e-d0ca980cac9b admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:28.503242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b582010-3d3c-45c4-9c7e-d0ca980cac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:28.503587 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b582010-3d3c-45c4-9c7e-d0ca980cac9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:28.504319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b582010-3d3c-45c4-9c7e-d0ca980cac9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:28.506338 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b582010-3d3c-45c4-9c7e-d0ca980cac9b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:28.513201 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:34:28.541551 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1432/2903] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:34:28 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:34:28.545871 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fa802-f9d7-4147-af60-2d5f0c655b09 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:28.558464 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fa802-f9d7-4147-af60-2d5f0c655b09 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:28.584260 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:34:28.639078 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17642747-fb16-47b6-8092-bd62d79883f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:28.640202 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17642747-fb16-47b6-8092-bd62d79883f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:28.641032 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17642747-fb16-47b6-8092-bd62d79883f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:28.641897 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17642747-fb16-47b6-8092-bd62d79883f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:28.642821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17642747-fb16-47b6-8092-bd62d79883f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:28.645932 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17642747-fb16-47b6-8092-bd62d79883f2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:28.686573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1472/2904] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:34:28 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:34:28.688234 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b582010-3d3c-45c4-9c7e-d0ca980cac9b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:28.705447 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b582010-3d3c-45c4-9c7e-d0ca980cac9b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:28.711747 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266c440-a635-4c82-a71a-a938e48e6fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:28.713434 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266c440-a635-4c82-a71a-a938e48e6fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:28.713805 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266c440-a635-4c82-a71a-a938e48e6fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:28.713984 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266c440-a635-4c82-a71a-a938e48e6fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:28.714620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266c440-a635-4c82-a71a-a938e48e6fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:28.716220 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266c440-a635-4c82-a71a-a938e48e6fa2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:28.727723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1433/2905] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:34:28.731904 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17642747-fb16-47b6-8092-bd62d79883f2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:28.743655 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17642747-fb16-47b6-8092-bd62d79883f2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:28.749441 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba2de8-cb31-4244-aae1-89b44d3cfc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:28.750112 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba2de8-cb31-4244-aae1-89b44d3cfc83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:28.750387 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba2de8-cb31-4244-aae1-89b44d3cfc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:28.750657 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba2de8-cb31-4244-aae1-89b44d3cfc83 admin admin] PATH_INFO: `/v3/projects/fa5ec27b2e794efbb71dcb841a6f049b/users/50c9beba3f434ecbae20151fa9bfacd5/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:28.766800 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba2de8-cb31-4244-aae1-89b44d3cfc83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5ec27b2e794efbb71dcb841a6f049b, user_id=50c9beba3f434ecbae20151fa9bfacd5, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:28.769609 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba2de8-cb31-4244-aae1-89b44d3cfc83 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:28.783542 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1473/2906] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:34:28 2022] PUT /identity/v3/projects/fa5ec27b2e794efbb71dcb841a6f049b/users/50c9beba3f434ecbae20151fa9bfacd5/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:34:28.787524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266c440-a635-4c82-a71a-a938e48e6fa2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:28.798467 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266c440-a635-4c82-a71a-a938e48e6fa2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:28.860897 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c17324-c1a9-4752-8aba-71833ca1aad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:28.861935 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17324-c1a9-4752-8aba-71833ca1aad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:28.862425 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17324-c1a9-4752-8aba-71833ca1aad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:28.862898 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17324-c1a9-4752-8aba-71833ca1aad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:28.863863 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c17324-c1a9-4752-8aba-71833ca1aad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:28.865604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c17324-c1a9-4752-8aba-71833ca1aad4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:28.876593 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1434/2907] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:34:28.880836 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba2de8-cb31-4244-aae1-89b44d3cfc83 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:28.892584 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba2de8-cb31-4244-aae1-89b44d3cfc83 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:28.898176 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f873d1-9edd-4ced-9163-d183a7d4be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:28.899492 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f873d1-9edd-4ced-9163-d183a7d4be3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:28.899768 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f873d1-9edd-4ced-9163-d183a7d4be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:28.900043 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f873d1-9edd-4ced-9163-d183a7d4be3a admin admin] PATH_INFO: `/v3/projects/fa5ec27b2e794efbb71dcb841a6f049b/users/50c9beba3f434ecbae20151fa9bfacd5/roles/beec000223e041209205627bfa0dbed1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:28.902073 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f873d1-9edd-4ced-9163-d183a7d4be3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5ec27b2e794efbb71dcb841a6f049b, user_id=50c9beba3f434ecbae20151fa9bfacd5, role_id=beec000223e041209205627bfa0dbed1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:28.904776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f873d1-9edd-4ced-9163-d183a7d4be3a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:28.918702 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1474/2908] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:34:28 2022] PUT /identity/v3/projects/fa5ec27b2e794efbb71dcb841a6f049b/users/50c9beba3f434ecbae20151fa9bfacd5/roles/beec000223e041209205627bfa0dbed1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:34:32.296920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3a5c5-a9fa-4007-8a9e-5d3f44455cd3 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:32.297804 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3a5c5-a9fa-4007-8a9e-5d3f44455cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:32.298252 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3a5c5-a9fa-4007-8a9e-5d3f44455cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:32.337877 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-80e3a5c5-a9fa-4007-8a9e-5d3f44455cd3 None None] MFA Rules not processed for user `0724af3124c64095b9717d38a144ee0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:32.339219 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-80e3a5c5-a9fa-4007-8a9e-5d3f44455cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:32.492283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1435/2909] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:34.564049 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be46715-ab77-450d-8985-f8cbe0a10a85 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:34.565000 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be46715-ab77-450d-8985-f8cbe0a10a85 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:34.565716 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be46715-ab77-450d-8985-f8cbe0a10a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:34.614792 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0be46715-ab77-450d-8985-f8cbe0a10a85 None None] MFA Rules not processed for user `50c9beba3f434ecbae20151fa9bfacd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:34.616144 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0be46715-ab77-450d-8985-f8cbe0a10a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:34.723502 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1475/2910] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:34.738516 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3a5c5-a9fa-4007-8a9e-5d3f44455cd3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:34.741426 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-80e3a5c5-a9fa-4007-8a9e-5d3f44455cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:34.826388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be46715-ab77-450d-8985-f8cbe0a10a85 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:34.828150 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0be46715-ab77-450d-8985-f8cbe0a10a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:34.837986 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3a5c5-a9fa-4007-8a9e-5d3f44455cd3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:34.846800 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09361b4-24a3-48a9-b68b-48e908d670a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:34.847900 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09361b4-24a3-48a9-b68b-48e908d670a4 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:34.848363 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09361b4-24a3-48a9-b68b-48e908d670a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:34.848490 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be46715-ab77-450d-8985-f8cbe0a10a85 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:34.849015 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09361b4-24a3-48a9-b68b-48e908d670a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:34.862545 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49036f-b807-462a-a677-50e79335347c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:34.863178 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49036f-b807-462a-a677-50e79335347c service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:34.863456 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49036f-b807-462a-a677-50e79335347c service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:34.863741 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49036f-b807-462a-a677-50e79335347c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:34.865742 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cf49036f-b807-462a-a677-50e79335347c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:34.866438 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:34:34.882298 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49036f-b807-462a-a677-50e79335347c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:34.884514 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49036f-b807-462a-a677-50e79335347c service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:34.917051 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1476/2911] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 16:34:34.935552 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09361b4-24a3-48a9-b68b-48e908d670a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:34.937497 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09361b4-24a3-48a9-b68b-48e908d670a4 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:34.949575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1436/2912] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:34:36.350557 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4ee9c-11ac-48bc-a2af-4150a03de226 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:36.351050 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4ee9c-11ac-48bc-a2af-4150a03de226 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:36.351152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4ee9c-11ac-48bc-a2af-4150a03de226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:36.371651 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4cd4ee9c-11ac-48bc-a2af-4150a03de226 None None] MFA Rules not processed for user `dbb4892506c04a178bf63327c4c77b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:36.372915 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4cd4ee9c-11ac-48bc-a2af-4150a03de226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:36.380314 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1477/2913] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:34:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:43.134382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b56b7-5aae-44a8-8bfd-773e99b7fe26 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:43.135007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b56b7-5aae-44a8-8bfd-773e99b7fe26 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:43.135007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b56b7-5aae-44a8-8bfd-773e99b7fe26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:43.156375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a27b56b7-5aae-44a8-8bfd-773e99b7fe26 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:43.157620 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a27b56b7-5aae-44a8-8bfd-773e99b7fe26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:43.223016 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1437/2914] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 16:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:43.245933 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4ee9c-11ac-48bc-a2af-4150a03de226 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:43.258754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4ee9c-11ac-48bc-a2af-4150a03de226 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:43.264334 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60f544-b109-4042-963e-a7c021e4d706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:43.265063 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60f544-b109-4042-963e-a7c021e4d706 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:43.265362 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60f544-b109-4042-963e-a7c021e4d706 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:43.265628 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60f544-b109-4042-963e-a7c021e4d706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:43.277103 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60f544-b109-4042-963e-a7c021e4d706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:43.278763 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60f544-b109-4042-963e-a7c021e4d706 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:43.290757 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1478/2915] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:34:47.451610 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382096a9-3d7b-4319-9694-ed838d9b0cf5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:47.452160 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382096a9-3d7b-4319-9694-ed838d9b0cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:47.452160 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382096a9-3d7b-4319-9694-ed838d9b0cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:47.476727 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-382096a9-3d7b-4319-9694-ed838d9b0cf5 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:47.478495 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-382096a9-3d7b-4319-9694-ed838d9b0cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:47.486686 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1438/2916] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 16:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:47.509239 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60f544-b109-4042-963e-a7c021e4d706 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:47.520563 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60f544-b109-4042-963e-a7c021e4d706 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:47.526388 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e3aa5-b956-48de-b8d6-f0403e87ec19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:47.527019 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e3aa5-b956-48de-b8d6-f0403e87ec19 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:47.527300 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e3aa5-b956-48de-b8d6-f0403e87ec19 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:47.527573 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e3aa5-b956-48de-b8d6-f0403e87ec19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:47.536957 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e3aa5-b956-48de-b8d6-f0403e87ec19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:47.538659 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e3aa5-b956-48de-b8d6-f0403e87ec19 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:47.556079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1479/2917] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:34:52.573548 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4a611-8051-4e43-a9fa-5c7fa54b77f4 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:52.574042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4a611-8051-4e43-a9fa-5c7fa54b77f4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:52.574169 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4a611-8051-4e43-a9fa-5c7fa54b77f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:52.594174 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8ce4a611-8051-4e43-a9fa-5c7fa54b77f4 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:52.595375 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8ce4a611-8051-4e43-a9fa-5c7fa54b77f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:52.603662 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1439/2918] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:52.627261 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e3aa5-b956-48de-b8d6-f0403e87ec19 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:52.638853 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e3aa5-b956-48de-b8d6-f0403e87ec19 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:52.644182 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c0cc9-48ac-4994-8677-e9adb31a23fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:52.644819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c0cc9-48ac-4994-8677-e9adb31a23fe service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:52.645208 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c0cc9-48ac-4994-8677-e9adb31a23fe service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:52.645503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c0cc9-48ac-4994-8677-e9adb31a23fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:52.654211 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c0cc9-48ac-4994-8677-e9adb31a23fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:52.655781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c0cc9-48ac-4994-8677-e9adb31a23fe service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:52.665241 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1480/2919] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:34:56.366024 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba73f8-e7f3-4077-96e4-8de6e35f1e6b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:56.366507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba73f8-e7f3-4077-96e4-8de6e35f1e6b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:56.366739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba73f8-e7f3-4077-96e4-8de6e35f1e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:56.396560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-37ba73f8-e7f3-4077-96e4-8de6e35f1e6b None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:56.398007 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-37ba73f8-e7f3-4077-96e4-8de6e35f1e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:56.457558 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1440/2920] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 21 16:34:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:56.470467 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c0cc9-48ac-4994-8677-e9adb31a23fe service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:56.471881 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5c6c0cc9-48ac-4994-8677-e9adb31a23fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:56.479041 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:34:56.550381 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c0cc9-48ac-4994-8677-e9adb31a23fe service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:56.555338 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9947a78-8992-406b-89a2-d32acd149fb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:56.555950 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9947a78-8992-406b-89a2-d32acd149fb7 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:56.556808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9947a78-8992-406b-89a2-d32acd149fb7 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:56.557097 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9947a78-8992-406b-89a2-d32acd149fb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:56.566503 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9947a78-8992-406b-89a2-d32acd149fb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:56.568113 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9947a78-8992-406b-89a2-d32acd149fb7 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:56.577193 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1481/2921] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:34:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:34:57.823051 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1b168-b67b-4d0c-a1bd-9707bd4c0d2c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:57.823959 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1b168-b67b-4d0c-a1bd-9707bd4c0d2c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:57.824411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1b168-b67b-4d0c-a1bd-9707bd4c0d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:57.889899 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a0f1b168-b67b-4d0c-a1bd-9707bd4c0d2c None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:34:57.893013 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a0f1b168-b67b-4d0c-a1bd-9707bd4c0d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:34:57.913869 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1441/2922] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:34:57.946258 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9947a78-8992-406b-89a2-d32acd149fb7 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:34:57.969274 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9947a78-8992-406b-89a2-d32acd149fb7 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:34:57.981042 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b13314-c62e-44a2-94bb-00e4b83e67b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:34:57.983511 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13314-c62e-44a2-94bb-00e4b83e67b4 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:34:57.984756 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13314-c62e-44a2-94bb-00e4b83e67b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:34:57.985928 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13314-c62e-44a2-94bb-00e4b83e67b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:34:58.000900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b13314-c62e-44a2-94bb-00e4b83e67b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:34:58.002815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b13314-c62e-44a2-94bb-00e4b83e67b4 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:34:58.018647 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1482/2923] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:35:02.136330 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e06d6-cdbf-4017-b3a8-3a36c27691dd None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:02.137102 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e06d6-cdbf-4017-b3a8-3a36c27691dd None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:02.137785 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e06d6-cdbf-4017-b3a8-3a36c27691dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:02.176624 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-cd0e06d6-cdbf-4017-b3a8-3a36c27691dd None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:35:02.179823 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cd0e06d6-cdbf-4017-b3a8-3a36c27691dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:02.195624 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1442/2924] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 16:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:35:02.219972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b13314-c62e-44a2-94bb-00e4b83e67b4 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:02.242205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b13314-c62e-44a2-94bb-00e4b83e67b4 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:02.260421 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb75b56-adee-421b-84d1-bdccdca1f72a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:02.261681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb75b56-adee-421b-84d1-bdccdca1f72a service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:02.262139 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb75b56-adee-421b-84d1-bdccdca1f72a service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:02.262580 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb75b56-adee-421b-84d1-bdccdca1f72a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:02.280734 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb75b56-adee-421b-84d1-bdccdca1f72a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:02.282469 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb75b56-adee-421b-84d1-bdccdca1f72a service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:02.299722 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1483/2925] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:35:12.165814 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=86 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:35:12.288771 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=42 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:35:12.843743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f71e14-34cd-4a1c-b66c-edd5569e0d2c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:12.844086 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f71e14-34cd-4a1c-b66c-edd5569e0d2c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:12.844454 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f71e14-34cd-4a1c-b66c-edd5569e0d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:12.866261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-01f71e14-34cd-4a1c-b66c-edd5569e0d2c None None] MFA Rules not processed for user `5e20281883414eed9d644e0eaab2ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:35:12.866261 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-01f71e14-34cd-4a1c-b66c-edd5569e0d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:12.873980 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1443/2926] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 21 16:35:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:35:12.887656 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb75b56-adee-421b-84d1-bdccdca1f72a service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:12.898706 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb75b56-adee-421b-84d1-bdccdca1f72a service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:12.904233 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3490206-c586-401d-8bd2-e823c0a289c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b28aaefcb154b228987362921f6476b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:12.904846 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3490206-c586-401d-8bd2-e823c0a289c2 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:12.905122 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3490206-c586-401d-8bd2-e823c0a289c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:12.905389 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3490206-c586-401d-8bd2-e823c0a289c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:12.913964 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3490206-c586-401d-8bd2-e823c0a289c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:12.915600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3490206-c586-401d-8bd2-e823c0a289c2 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:12.923693 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1484/2927] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 21 16:35:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 16:35:14.892239 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f71e14-34cd-4a1c-b66c-edd5569e0d2c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:14.893738 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-01f71e14-34cd-4a1c-b66c-edd5569e0d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:14.967121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f71e14-34cd-4a1c-b66c-edd5569e0d2c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:14.973785 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9c578-2839-45fd-8e69-59e68840ce16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd3076ca5a84ff7ada13065f9531f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:14.974399 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9c578-2839-45fd-8e69-59e68840ce16 service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:14.974678 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9c578-2839-45fd-8e69-59e68840ce16 service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:14.974949 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9c578-2839-45fd-8e69-59e68840ce16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:14.977218 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2ad9c578-2839-45fd-8e69-59e68840ce16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:14.993025 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9c578-2839-45fd-8e69-59e68840ce16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:14.995519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9c578-2839-45fd-8e69-59e68840ce16 service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:15.003995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3490206-c586-401d-8bd2-e823c0a289c2 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:15.006502 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c3490206-c586-401d-8bd2-e823c0a289c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:15.011176 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1444/2928] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:35:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:35:15.033754 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3490206-c586-401d-8bd2-e823c0a289c2 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:15.038829 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a02dc0-3f24-4acb-9d74-c7b41ff0547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:15.039468 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a02dc0-3f24-4acb-9d74-c7b41ff0547d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:15.040272 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a02dc0-3f24-4acb-9d74-c7b41ff0547d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:15.040551 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a02dc0-3f24-4acb-9d74-c7b41ff0547d admin admin] PATH_INFO: `/v3/users/0724af3124c64095b9717d38a144ee0b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:15.041911 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a02dc0-3f24-4acb-9d74-c7b41ff0547d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0724af3124c64095b9717d38a144ee0b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:15.046488 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a02dc0-3f24-4acb-9d74-c7b41ff0547d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:15.123383 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-39a02dc0-3f24-4acb-9d74-c7b41ff0547d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0724af3124c64095b9717d38a144ee0b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:15.124199 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-39a02dc0-3f24-4acb-9d74-c7b41ff0547d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0724af3124c64095b9717d38a144ee0b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:15.153682 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-39a02dc0-3f24-4acb-9d74-c7b41ff0547d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0724af3124c64095b9717d38a144ee0b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:15.165368 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-39a02dc0-3f24-4acb-9d74-c7b41ff0547d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0724af3124c64095b9717d38a144ee0b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:15.168454 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-39a02dc0-3f24-4acb-9d74-c7b41ff0547d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0724af3124c64095b9717d38a144ee0b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:15.188633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1485/2929] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:35:15 2022] DELETE /identity/v3/users/0724af3124c64095b9717d38a144ee0b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:35:15.418639 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9c578-2839-45fd-8e69-59e68840ce16 service placement] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:15.434711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9c578-2839-45fd-8e69-59e68840ce16 service placement] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:15.509703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:15.510337 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:15.510615 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:15.510904 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] PATH_INFO: `/v3/projects/85ba6e8727094ac4bb1dcba200babab6` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:15.512042 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ba6e8727094ac4bb1dcba200babab6)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:15.514001 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:15.560293 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ba6e8727094ac4bb1dcba200babab6', 'request_id': 'req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:15.566524 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ba6e8727094ac4bb1dcba200babab6', 'request_id': 'req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:15.573114 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ba6e8727094ac4bb1dcba200babab6', 'request_id': 'req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:15.585301 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] The token cache is being invalidate because project 85ba6e8727094ac4bb1dcba200babab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:35:15.585586 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:15.586198 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:15.587665 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1445/2930] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:35:15 2022] DELETE /identity/v3/projects/85ba6e8727094ac4bb1dcba200babab6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:35:16.630701 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a02dc0-3f24-4acb-9d74-c7b41ff0547d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:16.632121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-39a02dc0-3f24-4acb-9d74-c7b41ff0547d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:16.689820 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a02dc0-3f24-4acb-9d74-c7b41ff0547d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:16.739752 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c5aca-9e5a-4a0a-8304-7a03cf900319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:16.740359 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c5aca-9e5a-4a0a-8304-7a03cf900319 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:16.740639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c5aca-9e5a-4a0a-8304-7a03cf900319 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:16.740942 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c5aca-9e5a-4a0a-8304-7a03cf900319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:16.742957 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-337c5aca-9e5a-4a0a-8304-7a03cf900319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:16.774946 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:35:16.809438 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c5aca-9e5a-4a0a-8304-7a03cf900319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:16.810766 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c5aca-9e5a-4a0a-8304-7a03cf900319 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:16.820199 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1486/2931] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:35:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:35:25.582265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:35:26.815996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=16 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:35:37.282807 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:37.284283 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:37.352351 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34c81f-7ebe-4d8d-a830-fe8fcd6e1b64 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:37.357917 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3e18e-1cc5-462c-ac33-43cea2a497a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:37.358546 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e18e-1cc5-462c-ac33-43cea2a497a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:37.358817 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e18e-1cc5-462c-ac33-43cea2a497a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:37.359080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e18e-1cc5-462c-ac33-43cea2a497a9 admin admin] PATH_INFO: `/v3/users/a43a87036d66437eb64ea58231e41845` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:37.360205 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3e18e-1cc5-462c-ac33-43cea2a497a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43a87036d66437eb64ea58231e41845)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:37.362130 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3e18e-1cc5-462c-ac33-43cea2a497a9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:37.408267 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a0e3e18e-1cc5-462c-ac33-43cea2a497a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43a87036d66437eb64ea58231e41845'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:37.408966 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a0e3e18e-1cc5-462c-ac33-43cea2a497a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43a87036d66437eb64ea58231e41845'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:37.409575 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a0e3e18e-1cc5-462c-ac33-43cea2a497a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43a87036d66437eb64ea58231e41845'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:37.417289 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a0e3e18e-1cc5-462c-ac33-43cea2a497a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43a87036d66437eb64ea58231e41845'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:37.429186 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a0e3e18e-1cc5-462c-ac33-43cea2a497a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43a87036d66437eb64ea58231e41845'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:37.441888 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1446/2932] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:35:37 2022] DELETE /identity/v3/users/a43a87036d66437eb64ea58231e41845 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:35:37.620614 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c5aca-9e5a-4a0a-8304-7a03cf900319 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:37.631819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c5aca-9e5a-4a0a-8304-7a03cf900319 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:37.691562 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:37.692188 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:37.692463 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:37.692761 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e admin admin] PATH_INFO: `/v3/projects/883e6567776d472189f399b5548acc4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:37.693900 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=883e6567776d472189f399b5548acc4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:37.695785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:37.742576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883e6567776d472189f399b5548acc4c', 'request_id': 'req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:37.749001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883e6567776d472189f399b5548acc4c', 'request_id': 'req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:37.757143 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883e6567776d472189f399b5548acc4c', 'request_id': 'req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:37.768643 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e admin admin] The token cache is being invalidate because project 883e6567776d472189f399b5548acc4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:35:37.768956 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:37.769604 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b176b4f8-e7a3-4950-9a84-0ee866ea8e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:37.771077 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1487/2933] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:35:37 2022] DELETE /identity/v3/projects/883e6567776d472189f399b5548acc4c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:35:37.776527 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ed5b8-b703-4bad-a2f6-294ff461fe19 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:37.776918 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ed5b8-b703-4bad-a2f6-294ff461fe19 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:37.777211 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ed5b8-b703-4bad-a2f6-294ff461fe19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:37.797539 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e62ed5b8-b703-4bad-a2f6-294ff461fe19 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:35:37.798888 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e62ed5b8-b703-4bad-a2f6-294ff461fe19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:37.862927 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1447/2934] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:35:37.870862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c04184-7917-47c0-8904-205be2b35106 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:37.871146 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c04184-7917-47c0-8904-205be2b35106 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:37.871419 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c04184-7917-47c0-8904-205be2b35106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:37.890725 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-02c04184-7917-47c0-8904-205be2b35106 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:35:37.891922 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-02c04184-7917-47c0-8904-205be2b35106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:37.899776 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1488/2935] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:35:37.904541 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ed5b8-b703-4bad-a2f6-294ff461fe19 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:37.914217 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ed5b8-b703-4bad-a2f6-294ff461fe19 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:37.919619 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bca046-fdea-46fe-99c3-dcbea5f7cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:37.920216 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bca046-fdea-46fe-99c3-dcbea5f7cb25 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:37.920485 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bca046-fdea-46fe-99c3-dcbea5f7cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:37.920781 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bca046-fdea-46fe-99c3-dcbea5f7cb25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:37.921426 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bca046-fdea-46fe-99c3-dcbea5f7cb25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 16:35:37.921722 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bca046-fdea-46fe-99c3-dcbea5f7cb25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:37.923299 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bca046-fdea-46fe-99c3-dcbea5f7cb25 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:37.934728 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1448/2936] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 21 16:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 16:35:37.938995 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c04184-7917-47c0-8904-205be2b35106 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:37.948484 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c04184-7917-47c0-8904-205be2b35106 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:37.953079 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abbc47-b90e-441e-8a8f-beda6d9e4703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:37.953663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abbc47-b90e-441e-8a8f-beda6d9e4703 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:37.953951 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abbc47-b90e-441e-8a8f-beda6d9e4703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:37.954203 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abbc47-b90e-441e-8a8f-beda6d9e4703 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:37.954858 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abbc47-b90e-441e-8a8f-beda6d9e4703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:37.956749 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abbc47-b90e-441e-8a8f-beda6d9e4703 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:37.988478 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1489/2937] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 21 16:35:37 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 16:35:37.992891 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bca046-fdea-46fe-99c3-dcbea5f7cb25 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:38.003604 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bca046-fdea-46fe-99c3-dcbea5f7cb25 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:38.007242 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:35:38.062090 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa04ba-23af-443f-94c1-4622a7c825a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:38.062605 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa04ba-23af-443f-94c1-4622a7c825a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:38.062884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa04ba-23af-443f-94c1-4622a7c825a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:38.063156 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa04ba-23af-443f-94c1-4622a7c825a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:38.063801 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa04ba-23af-443f-94c1-4622a7c825a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:38.065753 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa04ba-23af-443f-94c1-4622a7c825a0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:38.089146 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1449/2938] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 21 16:35:37 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 16:35:38.093247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abbc47-b90e-441e-8a8f-beda6d9e4703 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:38.104005 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abbc47-b90e-441e-8a8f-beda6d9e4703 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:38.108600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434bf46-5591-4b55-9966-709650c5d784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:38.109229 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434bf46-5591-4b55-9966-709650c5d784 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:38.109510 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434bf46-5591-4b55-9966-709650c5d784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:38.109782 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434bf46-5591-4b55-9966-709650c5d784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:38.110447 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434bf46-5591-4b55-9966-709650c5d784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:38.112035 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434bf46-5591-4b55-9966-709650c5d784 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:38.121989 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1490/2939] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:35:38.125955 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa04ba-23af-443f-94c1-4622a7c825a0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:38.135878 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa04ba-23af-443f-94c1-4622a7c825a0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:38.140436 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb433f77-3347-4ecd-b9e0-537bf81e0fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:38.141081 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb433f77-3347-4ecd-b9e0-537bf81e0fee admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:38.141359 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb433f77-3347-4ecd-b9e0-537bf81e0fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:38.141635 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb433f77-3347-4ecd-b9e0-537bf81e0fee admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:38.142271 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb433f77-3347-4ecd-b9e0-537bf81e0fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:38.143851 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb433f77-3347-4ecd-b9e0-537bf81e0fee admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:38.154803 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1450/2940] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 21 16:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 16:35:38.158883 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434bf46-5591-4b55-9966-709650c5d784 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:38.169663 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434bf46-5591-4b55-9966-709650c5d784 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:38.174264 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6792cb6-9eb2-4c2d-84c6-fabefc18af89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:38.175006 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6792cb6-9eb2-4c2d-84c6-fabefc18af89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:38.175204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6792cb6-9eb2-4c2d-84c6-fabefc18af89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:38.175470 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6792cb6-9eb2-4c2d-84c6-fabefc18af89 admin admin] PATH_INFO: `/v3/projects/cb70c79413194be7935999d3c80c9242/users/af408791b7a24b6d8c451631ed306069/roles/e43d5cbe01fb477f98fbe79db2fd2e5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:38.190152 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6792cb6-9eb2-4c2d-84c6-fabefc18af89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb70c79413194be7935999d3c80c9242, user_id=af408791b7a24b6d8c451631ed306069, role_id=e43d5cbe01fb477f98fbe79db2fd2e5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:38.192821 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6792cb6-9eb2-4c2d-84c6-fabefc18af89 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:38.207457 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1491/2941] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 21 16:35:38 2022] PUT /identity/v3/projects/cb70c79413194be7935999d3c80c9242/users/af408791b7a24b6d8c451631ed306069/roles/e43d5cbe01fb477f98fbe79db2fd2e5c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:35:38.219140 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bc244-e6ae-4cb4-89c1-92bca3223aff None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:38.219451 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bc244-e6ae-4cb4-89c1-92bca3223aff None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:38.219726 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bc244-e6ae-4cb4-89c1-92bca3223aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:38.250560 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-771bc244-e6ae-4cb4-89c1-92bca3223aff None None] MFA Rules not processed for user `af408791b7a24b6d8c451631ed306069`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:35:38.252011 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-771bc244-e6ae-4cb4-89c1-92bca3223aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:38.316856 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1451/2942] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 16:35:38.327982 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6792cb6-9eb2-4c2d-84c6-fabefc18af89 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:38.329681 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e6792cb6-9eb2-4c2d-84c6-fabefc18af89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:38.360886 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:35:38.389245 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6792cb6-9eb2-4c2d-84c6-fabefc18af89 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:38.393001 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0377ad6-e60c-4bfa-a863-3f0791b967fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa61549530e648a0b774a784b0450162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:38.393603 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0377ad6-e60c-4bfa-a863-3f0791b967fc service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:38.393898 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0377ad6-e60c-4bfa-a863-3f0791b967fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:38.394148 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0377ad6-e60c-4bfa-a863-3f0791b967fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:38.403007 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0377ad6-e60c-4bfa-a863-3f0791b967fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:38.404423 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0377ad6-e60c-4bfa-a863-3f0791b967fc service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:38.413258 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1492/2943] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:35:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:35:48.313847 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:35:48.409121 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=14 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:35:48.497228 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bc244-e6ae-4cb4-89c1-92bca3223aff None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:48.560187 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bc244-e6ae-4cb4-89c1-92bca3223aff None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:48.564802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06624e-13ec-4ed1-a2e2-400e09a1ad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:48.565428 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06624e-13ec-4ed1-a2e2-400e09a1ad78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:48.565729 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06624e-13ec-4ed1-a2e2-400e09a1ad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:48.565986 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06624e-13ec-4ed1-a2e2-400e09a1ad78 admin admin] PATH_INFO: `/v3/users/af408791b7a24b6d8c451631ed306069` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:48.567100 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06624e-13ec-4ed1-a2e2-400e09a1ad78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af408791b7a24b6d8c451631ed306069)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:48.569056 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06624e-13ec-4ed1-a2e2-400e09a1ad78 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:48.618571 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b06624e-13ec-4ed1-a2e2-400e09a1ad78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af408791b7a24b6d8c451631ed306069'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:48.619588 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b06624e-13ec-4ed1-a2e2-400e09a1ad78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af408791b7a24b6d8c451631ed306069'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:48.620356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b06624e-13ec-4ed1-a2e2-400e09a1ad78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af408791b7a24b6d8c451631ed306069'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:48.633072 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b06624e-13ec-4ed1-a2e2-400e09a1ad78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af408791b7a24b6d8c451631ed306069'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:48.645886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b06624e-13ec-4ed1-a2e2-400e09a1ad78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af408791b7a24b6d8c451631ed306069'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:48.659411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1452/2944] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:35:48 2022] DELETE /identity/v3/users/af408791b7a24b6d8c451631ed306069 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:35:48.663926 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81d30d-52b3-4ffe-8560-3caf406b1033 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:48.664263 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81d30d-52b3-4ffe-8560-3caf406b1033 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:48.664516 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81d30d-52b3-4ffe-8560-3caf406b1033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:48.686105 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9d81d30d-52b3-4ffe-8560-3caf406b1033 None None] MFA Rules not processed for user `40395749310542bc824e993a4d655097`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 16:35:48.687313 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9d81d30d-52b3-4ffe-8560-3caf406b1033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:48.749994 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1493/2945] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 21 16:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 16:35:48.759990 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06624e-13ec-4ed1-a2e2-400e09a1ad78 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:48.761463 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8b06624e-13ec-4ed1-a2e2-400e09a1ad78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:48.818711 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06624e-13ec-4ed1-a2e2-400e09a1ad78 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:48.822743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22040ff6-3f89-49fb-af49-379e9cc8d06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:48.823346 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22040ff6-3f89-49fb-af49-379e9cc8d06b service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:48.823626 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22040ff6-3f89-49fb-af49-379e9cc8d06b service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:48.823899 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22040ff6-3f89-49fb-af49-379e9cc8d06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:48.833132 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22040ff6-3f89-49fb-af49-379e9cc8d06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:48.834554 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22040ff6-3f89-49fb-af49-379e9cc8d06b service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:48.843967 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1453/2946] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:35:49.106158 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81d30d-52b3-4ffe-8560-3caf406b1033 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:35:49.107600 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9d81d30d-52b3-4ffe-8560-3caf406b1033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:35:49.120210 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81d30d-52b3-4ffe-8560-3caf406b1033 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:35:49.124912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:35:49.125534 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:35:49.125812 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:35:49.126085 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] PATH_INFO: `/v3/projects/cb70c79413194be7935999d3c80c9242` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:35:49.127218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb70c79413194be7935999d3c80c9242)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:35:49.129290 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:35:49.175640 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb70c79413194be7935999d3c80c9242', 'request_id': 'req-8fb695a9-d18f-412a-87b1-851595e10bb0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:49.181156 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb70c79413194be7935999d3c80c9242', 'request_id': 'req-8fb695a9-d18f-412a-87b1-851595e10bb0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:49.189047 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb70c79413194be7935999d3c80c9242', 'request_id': 'req-8fb695a9-d18f-412a-87b1-851595e10bb0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:49.201364 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] The token cache is being invalidate because project cb70c79413194be7935999d3c80c9242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:35:49.201652 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:49.202291 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:35:49.203784 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1494/2947] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:35:49 2022] DELETE /identity/v3/projects/cb70c79413194be7935999d3c80c9242 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:35:58.839866 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:35:59.197916 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:37:20.258372 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22040ff6-3f89-49fb-af49-379e9cc8d06b service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:37:20.259835 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-22040ff6-3f89-49fb-af49-379e9cc8d06b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:37:20.339921 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22040ff6-3f89-49fb-af49-379e9cc8d06b service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:37:20.397638 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0db93-e2d4-4a4d-abc7-beea357e4f5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd3076ca5a84ff7ada13065f9531f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:37:20.398244 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0db93-e2d4-4a4d-abc7-beea357e4f5f service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:37:20.398526 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0db93-e2d4-4a4d-abc7-beea357e4f5f service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:37:20.398802 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0db93-e2d4-4a4d-abc7-beea357e4f5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:37:20.400528 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-67f0db93-e2d4-4a4d-abc7-beea357e4f5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:37:20.411519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0db93-e2d4-4a4d-abc7-beea357e4f5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:37:20.413098 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0db93-e2d4-4a4d-abc7-beea357e4f5f service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:37:20.423323 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1454/2948] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:37:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:37:30.419166 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=58 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:37:49.986815 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:37:49.988383 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:37:50.047277 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb695a9-d18f-412a-87b1-851595e10bb0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:37:50.050888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade4508-6ae0-4450-8a0a-98bf06248abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:37:50.051495 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade4508-6ae0-4450-8a0a-98bf06248abb service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:37:50.051775 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade4508-6ae0-4450-8a0a-98bf06248abb service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:37:50.052053 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade4508-6ae0-4450-8a0a-98bf06248abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:37:50.053819 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7ade4508-6ae0-4450-8a0a-98bf06248abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:37:50.064247 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade4508-6ae0-4450-8a0a-98bf06248abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:37:50.065996 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade4508-6ae0-4450-8a0a-98bf06248abb service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:37:50.074785 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1495/2949] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:37:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:37:50.186433 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0db93-e2d4-4a4d-abc7-beea357e4f5f service placement] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:37:50.197739 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0db93-e2d4-4a4d-abc7-beea357e4f5f service placement] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:37:50.202714 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d736f5-d1a5-41b4-a35d-bb1e7b21ecba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:37:50.203319 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d736f5-d1a5-41b4-a35d-bb1e7b21ecba service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:37:50.203599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d736f5-d1a5-41b4-a35d-bb1e7b21ecba service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:37:50.203866 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d736f5-d1a5-41b4-a35d-bb1e7b21ecba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:37:50.206410 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-83d736f5-d1a5-41b4-a35d-bb1e7b21ecba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:37:50.279121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d736f5-d1a5-41b4-a35d-bb1e7b21ecba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:37:50.280551 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d736f5-d1a5-41b4-a35d-bb1e7b21ecba service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:37:50.291464 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1455/2950] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:37:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:38:00.071280 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=26 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:38:00.286659 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=34 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:39:29.988342 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade4508-6ae0-4450-8a0a-98bf06248abb service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:39:29.989939 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7ade4508-6ae0-4450-8a0a-98bf06248abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:39:30.010649 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade4508-6ae0-4450-8a0a-98bf06248abb service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:39:30.014347 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27dea8-52af-473b-b5a4-bede24b926df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:39:30.014942 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27dea8-52af-473b-b5a4-bede24b926df service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:39:30.015218 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27dea8-52af-473b-b5a4-bede24b926df service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:39:30.015486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27dea8-52af-473b-b5a4-bede24b926df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:39:30.017249 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bd27dea8-52af-473b-b5a4-bede24b926df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:39:30.026639 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27dea8-52af-473b-b5a4-bede24b926df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:39:30.028611 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27dea8-52af-473b-b5a4-bede24b926df service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:39:30.036576 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1496/2951] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:39:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:39:33.723474 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d736f5-d1a5-41b4-a35d-bb1e7b21ecba service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:39:33.725790 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-83d736f5-d1a5-41b4-a35d-bb1e7b21ecba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:39:33.798841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d736f5-d1a5-41b4-a35d-bb1e7b21ecba service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:39:33.804779 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021099e-5da4-47ec-a882-ec718fb14ee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:39:33.805402 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021099e-5da4-47ec-a882-ec718fb14ee7 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:39:33.805738 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021099e-5da4-47ec-a882-ec718fb14ee7 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:39:33.805934 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021099e-5da4-47ec-a882-ec718fb14ee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:39:33.807642 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a021099e-5da4-47ec-a882-ec718fb14ee7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:39:33.821043 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021099e-5da4-47ec-a882-ec718fb14ee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:39:33.822668 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021099e-5da4-47ec-a882-ec718fb14ee7 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:39:33.841085 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1456/2952] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:39:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:39:33.898521 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27dea8-52af-473b-b5a4-bede24b926df service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:39:33.920893 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27dea8-52af-473b-b5a4-bede24b926df service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:39:33.924912 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd9fca-5ce0-428a-b6f7-cdc9c424edb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:39:33.925612 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd9fca-5ce0-428a-b6f7-cdc9c424edb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:39:33.925967 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd9fca-5ce0-428a-b6f7-cdc9c424edb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:39:33.926311 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd9fca-5ce0-428a-b6f7-cdc9c424edb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:39:33.928168 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-97fd9fca-5ce0-428a-b6f7-cdc9c424edb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:39:33.944075 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd9fca-5ce0-428a-b6f7-cdc9c424edb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:39:33.945808 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd9fca-5ce0-428a-b6f7-cdc9c424edb0 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:39:33.958324 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1497/2953] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:39:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:39:35.094382 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021099e-5da4-47ec-a882-ec718fb14ee7 service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:39:35.105663 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021099e-5da4-47ec-a882-ec718fb14ee7 service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:39:35.111561 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817719cf-4222-4289-93cc-f1894ddfe809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7ff08c990dc41b4811f97fecb7c4c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:39:35.112168 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817719cf-4222-4289-93cc-f1894ddfe809 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:39:35.112445 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817719cf-4222-4289-93cc-f1894ddfe809 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:39:35.112743 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817719cf-4222-4289-93cc-f1894ddfe809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:39:35.114507 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-817719cf-4222-4289-93cc-f1894ddfe809 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:39:35.176125 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817719cf-4222-4289-93cc-f1894ddfe809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:39:35.177767 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817719cf-4222-4289-93cc-f1894ddfe809 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:39:35.187192 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1457/2954] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:39:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:39:35.241460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd9fca-5ce0-428a-b6f7-cdc9c424edb0 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:39:35.250443 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd9fca-5ce0-428a-b6f7-cdc9c424edb0 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:39:35.254955 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9bb92-c85c-4093-b3a7-ada0a1046bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:39:35.255553 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9bb92-c85c-4093-b3a7-ada0a1046bdf service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:39:35.255827 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9bb92-c85c-4093-b3a7-ada0a1046bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:39:35.256094 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9bb92-c85c-4093-b3a7-ada0a1046bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:39:35.258204 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-81c9bb92-c85c-4093-b3a7-ada0a1046bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:39:35.272486 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9bb92-c85c-4093-b3a7-ada0a1046bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:39:35.273935 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9bb92-c85c-4093-b3a7-ada0a1046bdf service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:39:35.285225 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1498/2955] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:39:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:39:37.758797 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817719cf-4222-4289-93cc-f1894ddfe809 service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:39:37.768886 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817719cf-4222-4289-93cc-f1894ddfe809 service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:39:37.772439 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa17ca-871b-451e-8ca3-d7b9914220e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e765e2cc4c94243b00f919e8f8d01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:39:37.773076 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa17ca-871b-451e-8ca3-d7b9914220e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:39:37.773356 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa17ca-871b-451e-8ca3-d7b9914220e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:39:37.773627 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa17ca-871b-451e-8ca3-d7b9914220e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:39:37.775519 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8caa17ca-871b-451e-8ca3-d7b9914220e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:39:37.842888 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa17ca-871b-451e-8ca3-d7b9914220e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:39:37.844411 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa17ca-871b-451e-8ca3-d7b9914220e5 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:39:37.857824 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1458/2956] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:39:43.979195 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9bb92-c85c-4093-b3a7-ada0a1046bdf service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:39:43.981205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-81c9bb92-c85c-4093-b3a7-ada0a1046bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:39:43.997376 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9bb92-c85c-4093-b3a7-ada0a1046bdf service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:39:44.002341 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617a15-17d4-49db-b0a5-b24d602d1b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:39:44.002972 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617a15-17d4-49db-b0a5-b24d602d1b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:39:44.003248 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617a15-17d4-49db-b0a5-b24d602d1b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:39:44.003520 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617a15-17d4-49db-b0a5-b24d602d1b6a admin admin] PATH_INFO: `/v3/users/dbb4892506c04a178bf63327c4c77b5c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:39:44.004660 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31617a15-17d4-49db-b0a5-b24d602d1b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbb4892506c04a178bf63327c4c77b5c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:39:44.006593 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31617a15-17d4-49db-b0a5-b24d602d1b6a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:39:44.057837 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-31617a15-17d4-49db-b0a5-b24d602d1b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbb4892506c04a178bf63327c4c77b5c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.058496 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-31617a15-17d4-49db-b0a5-b24d602d1b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbb4892506c04a178bf63327c4c77b5c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.073781 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-31617a15-17d4-49db-b0a5-b24d602d1b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbb4892506c04a178bf63327c4c77b5c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.080891 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-31617a15-17d4-49db-b0a5-b24d602d1b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbb4892506c04a178bf63327c4c77b5c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.081633 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-31617a15-17d4-49db-b0a5-b24d602d1b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbb4892506c04a178bf63327c4c77b5c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.097927 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1499/2957] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:39:43 2022] DELETE /identity/v3/users/dbb4892506c04a178bf63327c4c77b5c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:39:44.290703 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa17ca-871b-451e-8ca3-d7b9914220e5 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:39:44.302265 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa17ca-871b-451e-8ca3-d7b9914220e5 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:39:44.331920 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:39:44.360184 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:39:44.360841 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:39:44.361121 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:39:44.361390 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] PATH_INFO: `/v3/projects/59dcf94535a841ddaba47c978a683b89` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:39:44.362490 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59dcf94535a841ddaba47c978a683b89)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:39:44.364377 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:39:44.409683 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59dcf94535a841ddaba47c978a683b89', 'request_id': 'req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.415671 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59dcf94535a841ddaba47c978a683b89', 'request_id': 'req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.421790 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59dcf94535a841ddaba47c978a683b89', 'request_id': 'req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.433599 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] The token cache is being invalidate because project 59dcf94535a841ddaba47c978a683b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:39:44.433882 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.434491 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.435952 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1459/2958] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:39:44 2022] DELETE /identity/v3/projects/59dcf94535a841ddaba47c978a683b89 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:39:44.439993 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617a15-17d4-49db-b0a5-b24d602d1b6a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:39:44.441460 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-31617a15-17d4-49db-b0a5-b24d602d1b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:39:44.454896 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617a15-17d4-49db-b0a5-b24d602d1b6a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:39:44.515224 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09b882-442b-42df-9b32-0b3acd05dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:39:44.516215 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09b882-442b-42df-9b32-0b3acd05dd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:39:44.516545 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09b882-442b-42df-9b32-0b3acd05dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:39:44.516856 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09b882-442b-42df-9b32-0b3acd05dd56 admin admin] PATH_INFO: `/v3/users/50c9beba3f434ecbae20151fa9bfacd5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:39:44.518014 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09b882-442b-42df-9b32-0b3acd05dd56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c9beba3f434ecbae20151fa9bfacd5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:39:44.520072 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09b882-442b-42df-9b32-0b3acd05dd56 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:39:44.535403 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:39:44.568106 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f09b882-442b-42df-9b32-0b3acd05dd56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c9beba3f434ecbae20151fa9bfacd5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.568783 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f09b882-442b-42df-9b32-0b3acd05dd56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c9beba3f434ecbae20151fa9bfacd5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.580862 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f09b882-442b-42df-9b32-0b3acd05dd56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c9beba3f434ecbae20151fa9bfacd5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.587779 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f09b882-442b-42df-9b32-0b3acd05dd56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c9beba3f434ecbae20151fa9bfacd5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.588472 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f09b882-442b-42df-9b32-0b3acd05dd56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c9beba3f434ecbae20151fa9bfacd5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.601558 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1500/2959] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 21 16:39:44 2022] DELETE /identity/v3/users/50c9beba3f434ecbae20151fa9bfacd5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 16:39:44.780352 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:39:44.781939 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:39:44.795700 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bd25c-f9bf-4a86-9f5a-34541cc5f81a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:39:44.854179 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f545f-d6bc-403a-9a91-8d56ca084b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40395749310542bc824e993a4d655097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8aed661a1ae4dc6adb9120d20a01acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:39:44.854805 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f545f-d6bc-403a-9a91-8d56ca084b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:39:44.855080 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f545f-d6bc-403a-9a91-8d56ca084b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:39:44.855345 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f545f-d6bc-403a-9a91-8d56ca084b57 admin admin] PATH_INFO: `/v3/projects/fa5ec27b2e794efbb71dcb841a6f049b` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:39:44.856470 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f545f-d6bc-403a-9a91-8d56ca084b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa5ec27b2e794efbb71dcb841a6f049b)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:39:44.858393 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f545f-d6bc-403a-9a91-8d56ca084b57 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:39:44.905207 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bf1f545f-d6bc-403a-9a91-8d56ca084b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa5ec27b2e794efbb71dcb841a6f049b', 'request_id': 'req-bf1f545f-d6bc-403a-9a91-8d56ca084b57'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.911547 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bf1f545f-d6bc-403a-9a91-8d56ca084b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa5ec27b2e794efbb71dcb841a6f049b', 'request_id': 'req-bf1f545f-d6bc-403a-9a91-8d56ca084b57'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.917226 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bf1f545f-d6bc-403a-9a91-8d56ca084b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa5ec27b2e794efbb71dcb841a6f049b', 'request_id': 'req-bf1f545f-d6bc-403a-9a91-8d56ca084b57'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.918884 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:39:44.930723 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bf1f545f-d6bc-403a-9a91-8d56ca084b57 admin admin] The token cache is being invalidate because project fa5ec27b2e794efbb71dcb841a6f049b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 16:39:44.931010 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bf1f545f-d6bc-403a-9a91-8d56ca084b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.931633 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bf1f545f-d6bc-403a-9a91-8d56ca084b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 16:39:44.933158 dv-cinder-858621-1-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1460/2960] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 21 16:39:44 2022] DELETE /identity/v3/projects/fa5ec27b2e794efbb71dcb841a6f049b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 16:39:54.598205 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:39:54.929159 dv-cinder-858621-1-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:42:25.250737 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09b882-442b-42df-9b32-0b3acd05dd56 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 16:42:25.252251 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6f09b882-442b-42df-9b32-0b3acd05dd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:42:25.342817 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09b882-442b-42df-9b32-0b3acd05dd56 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 16:42:25.400265 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3cd2f-0d63-4ce7-bcab-04cee7b98663 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd3076ca5a84ff7ada13065f9531f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78142a67f69a4ba58113cc7c8dc269b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 16:42:25.400888 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3cd2f-0d63-4ce7-bcab-04cee7b98663 service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 16:42:25.401164 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3cd2f-0d63-4ce7-bcab-04cee7b98663 service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 16:42:25.401431 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3cd2f-0d63-4ce7-bcab-04cee7b98663 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 16:42:25.403140 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0dd3cd2f-0d63-4ce7-bcab-04cee7b98663 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 16:42:25.413948 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3cd2f-0d63-4ce7-bcab-04cee7b98663 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 16:42:25.415491 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3cd2f-0d63-4ce7-bcab-04cee7b98663 service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 16:42:25.425190 dv-cinder-858621-1-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1501/2961] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 21 16:42:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 16:42:35.420970 dv-cinder-858621-1-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=67 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}